1 of 39

PY5 Shared Priorities

OpenCI Award: OCI 21-38296

2 of 39

PY5 Shared Priorities - Genesis

  • Builds on prior work to develop a better integrated and coordinated program
    • Program Wide Goals and metrics developed in PY3

  • Recognized need for integrated planning ahead of a Project Year
    • previously shared plans; but this was after they were fairly mature
    • harder to align at this stage particularly without overarching priorities

  • Establishing Shared Priorities and engaging across teams early in the planning process allows for stronger alignment
    • supports harmonization of all award teams’ efforts

3 of 39

PY5 Shared Priorities

  • Improve User Experience
    • better user guidance, personalization of the user experience, and better insights through usage analysis,
  • Increase the Value Delivered to Resource Providers (RPs)
    • easier integration processes, simpler and more effective tools, …
  • Solidify the Programmatic Foundation for Transition
    • modernizing tools, updating documentation and policies, and improving cross-program operational alignment, capturing lessons learned, …
  • Better Capture and Articulate ACCESS Scientific Impact
    • publications data, new captured metrics, new analysis of existing data captured, …

4 of 39

Improve User Experience

  • ACO: Refine and clearly communicate governance processes, strengthen internal program communication channels, and actively engage community through events, communications, and surveys to improve user experience.
  • Operations: Streamline allocations/accounting workflows, simplify user account/profile management, improve AI and other resource descriptions (CiDeR), redesign Operations web presence.
  • Metrics: Provide personalized resource recommendations (“User Like Me”), personalized monthly usage/job efficiency reports, integrate XDMoD insights for users into ACCESS OnDemand.
  • Support: Enhance early-stage onboarding, deliver impactful hands-on training, and modernize support tools, including ARA, SDS, and chatbot capabilities.
  • Allocations: Improve confirmation messaging, and ensure users know how to access awarded resources.

5 of 39

Increase the Value Delivered to Resource Providers

  • ACO: Leverage advisory bodies (EAB, RAC) to systematically integrate RP feedback, track and resolve active recommendations, and ensure RP perspectives inform program‑level decision‑making.
  • Operations: Improve RP integration processes including staff onboarding/offboarding, cybersecurity documentation, and coordination workshops; expand perfSONAR nodes and regional networking.
  • Metrics: Automated custom reports and analytics for RP’s thru XDMoD
  • Support: Establish standardized templates and a consistent onboarding experience through collaboration with RP, while strengthening partnerships with regional communities.
  • Allocations: Replace AMIE, working with RPs to ensure that the changes ease integration effort and provide better access to data that RPs require.

6 of 39

Solidify Programmatic Foundation for Transition

  • ACO: Transition planning, including governance continuity, tools and processes documentation, identifying lessons learned, and preparing reports to support a smooth handoff to successor awards.
  • Operations: Update all ACCESS policies and documentation; finalize cybersecurity policies; complete decommissioning instructions. Streamline technology portfolio.
  • Metrics: Improve documentation of analytics framework and reporting pipelines, harden data capture pipelines from resource providers, capture lessons learned from NAIRR pilot integration
  • Support: Package reusable training materials, documentation, and tools; ensure long-term sustainability of APIs and artifacts.
  • Allocations: Address technical debt (OS upgrades, software framework updates), strengthen security vetting, and prepare continuity plans.

7 of 39

Better Capture & Articulate ACCESS Scientific Impact

  • ACO: Enhance visibility and impact through communications and tracking community engagement events to best articulate ACCESS outcomes and value
  • Operations: Highlight STEP program outputs.
  • Metrics: Expand publication metrics, funding data reporting, improve XDMoD custom reports tab, PEARC26 paper on ‘The Scientific Impact�of ACCESS”
  • Support: Demonstrate training impact and user success; integrate support tools to advance NAIRR visibility.
  • Allocations: Promote publications and citation metrics; amplify impactful science highlights.

8 of 39

METRICS Shared Priority Details

9 of 39

Metrics: Improve User Experience

  • User Like Me” based resource recommender for new and existing users
    • Leverage XDMoD data
    • Should be pervasive and easily discoverable
    • Integrate with allocations, support, operations, etc

Example integration into ACCESS OnDemand

Recommendation for other systems based on job type and similar users

ACCESS OnDemand Portal

10 of 39

Metrics: Improve User Experience

  • Custom Reports: Mail users monthly summaries of usage and job efficiency/throughput metrics
    • Report based on info already available thru XDMoD portal
    • Integrate with “User Like Me” to recommend other resources for job submittal

User Job Efficiency: Jobs broken out by percent CPU Utilization

User’s wait times versus average wait times

11 of 39

Metrics: Improve User Experience

  • Provide ACCESS OnDemand Users with XDMoD based summaries of job efficiencies
    • Improve discoverability of ACCESS XDMoD data
    • Already available in open-source versions of XDMoD and OnDemand

Individual job level efficiency

Overall job efficiency summary

Core hours efficiency summary

12 of 39

Metrics: Increase the Value Delivered to Resource Providers

13 of 39

Metrics: Solidify Programmatic Foundation for Transition

  • Improve documentation of analytics framework and reporting pipelines
  • Harden data capture pipelines from resource providers
    • Usage and performance data
  • Capture lessons learned from NAIRR pilot integration

Simplified architecture for ACCESS XDMoD Instance. Data are ingested from the NAIRR XRAS database, the ACCESS Allocations database and from log files from ACCESS allocated resources

14 of 39

Metrics: Better Capture & Articulate ACCESS Scientific Impact

  • Expand publication metrics
    • Work with Allocations team to pull in publication information to XDMoD
  • Funding data reporting
    • Update existing XSEDE custom charts for ACCESS
    • Incorporate data from additional public databases of NIH RePORTER and usaspending.gov
  • Improve XDMoD custom reports tab
    • Interactive custom report using analytics�framework
  • PEARC26 Paper on ‘The Scientific Impact of ACCESS”

15 of 39

SUPPORT Shared Priority Details

16 of 39

Support: Improve User Experience

Focus:�Deliver practical, example-driven training experiences that help users build real skills and confidence with AI, HPC, and data workflows.

  • Walk users through real workflows, tools, and tasks
  • Develop short, focused training modules tied to common user needs
  • Provide step-by-step materials, templates, and guided examples
  • Strengthen partnerships with regional communities and ACCESS-affiliated groups
  • Adapt workshop topics based on user feedback and observed support patterns

ACCESS Goals 1, 2, 3, 4, 5

17 of 39

Support: Increase the Value Delivered to RP’s

  • Ambassadors/guides to help people with early-stage needs on resources
  • Develop or share templates among RPs to improve onboarding consistency
  • Encourage use and discoverability of tools which means less burden on RPs/Ticket system
  • Support consistency across RPs and ACCESS wherever possible

Focus:�Make it easier for new users—especially those exploring AI or HPC for the first time—to understand where to begin and how to navigate ACCESS resources.

ACCESS Goals 2, 3, 4

18 of 39

Support: Solidify the Programmatic Foundation for Transition

Focus:�Provide ACCESS users with clear, technically advanced support tools by enhancing and integrating services such as ARA, SDS, and the Chatbot, thus streamlining support and lowering barriers to entry.

  • Continue to improve development and integration between ARA, SDS, KB, and the Chatbot to ensure intuitive, guided support
  • Strengthen connections between documentation, support channels, and resource discovery tools
  • Incorporate user feedback from PY4–PY5 to refine tool behavior and coverage
  • Update documentation for longevity and accessibility based on feedback
  • Package workshop materials, examples, and guides for continued reuse
  • Create summaries of effective practices and lessons learned

ACCESS Goals 1, 2, 3, 4, 5

19 of 39

Support: Better Capture and Articulate ACCESS Scientific Impact

  • Data Collection:
    • Surveys
    • Onboarding challenges
    • Tool usage
    • Workshop investment/attendance

20 of 39

OPERATIONS Shared Priority Details

21 of 39

Operations: Improve User Experience

  • Streamline allocations/accounting workflows
  • Simplifying user account/profile management
  • Improve ACCESS resource and software discovery
  • Improve CiDeR for AI and other resource descriptions
  • Improve Operations web presence
  • Improve Ticketing System per stakeholder experiences

22 of 39

Improve CiDeR Resource Descriptions

  • Introduce CPU, GPU, and AI resource partitions
  • Ability to associate features with partitions
  • Enable TOP500, ML and other benchmark advertising
  • Retire a bunch of legacy descriptive fields

23 of 39

Operations: Increase the Value Delivered to RP’s

  • Improve RP integration processes
  • Introduce RP staff onboarding/offboarding processes
  • Update & improve cybersecurity documentation and policies
  • Expand perfSONAR nodes and regional networking
  • Plan & deliver Fall 2026 RP Workshop

24 of 39

Operations: Solidify Programmatic Foundation for Transition

  • Update all policies and documentation
  • Refresh and finalize cybersecurity policies
  • Complete resource decommissioning instructions
  • Simplify multiple technology stacks and processes
    • Replacing legacy software search with�Globus Search pilot
    • Jira Service Management improvements
    • Web stack upgrade

25 of 39

Operations: Better Capture & Articulate Scientific Impact

  • Highlight STEP program outputs
  • Capture project innovations in product format (conference papers, position papers, etc.)

26 of 39

ACO Shared Priority Details

27 of 39

ACO - Improve User Experience

�The ACO will assist the community and improve their experience by:

ACO Priority

How this Improves User Experience

  • Communications and Outreach
    • Track community‑building and engagement events
    • Improve reach and impact of ACCESS communications
    • Engage community through events, newsletters, communications channels, and surveys
    • Define goals for PEARC26 and SC26 to maximize booth impact
    • Maintain coordinated, multi‑channel communications plan
    • Monitor communications metrics
  • Ensures users (researchers and educators) stay informed about ACCESS
  • Provides timely, consistent communication reducing confusion and barriers to use
  • Captures user feedback that directly guides improvements in tools, support, and processes
  • Reinforces ACCESS visibility at major conferences, strengthening direct engagement with users
  • Uses metrics to refine communication strategies, resulting in more effective messaging
  • Encourages two‑way communication that supports continuous program improvement

28 of 39

ACO - Improve User Experience

ACO Priority

How this Improves User Experience

  • Evaluation
    • Conduct and analyze Community Survey
  • Provides data‑driven understanding of user satisfaction and service gaps
  • Project Office
    • Leverage EAB and RAC recommendations
    • Track and address recommendations with EC
    • Manage conference attendance
    • Support EC, RPs, SCs, and WGs
  • Ensures community feedback from advisory bodies results in visible program improvements
  • Increases consistency and coordination across ACCESS teams, reducing friction for users
  • Enables direct user engagement at conferences, fostering stronger relationships and awareness
  • Governance
    • Further refine SC/WG procedures
    • Improve communication channels between EC and SCs/WGs
  • Improves responsiveness and clarity in internal governance, which translates into better‑aligned services for users

29 of 39

ACO - Increase the Value Delivered to RPs

The ACO will increase the value delivered to Resource Providers by improving collaborations and strengthening interdependencies within ACCESS:

ACO Priority

How this Delivers Value to the Resource Providers

  • Communications and Outreach
    • Track community‑building and engagement events
    • Improve reach and impact of communications
  • Expands the audience for RP resources by increasing awareness of ACCESS capabilities
  • Ensures RPs receive feedback that directly informs improvements to processes and collaboration
  • Highlights RP contributions through stronger communications, increasing visibility and community engagement
  • Evaluation
    • Conduct Resource Provider Survey
  • Supports better alignment between RPs and the broader ACCESS program

30 of 39

ACO - Increase the Value Delivered to RPs

The ACO will increase the value delivered to Resource Providers by improving collaborations and strengthening interdependencies within ACCESS:

ACO Priority

How this Delivers Value to the Resource Providers

  • Project Office
    • Leverage EAB/RAC recommendations and track follow‑up
    • Manage Quarterly ACCESS meetings
    • Manage conference attendance
    • Track tasks and award deliverables
    • Support EC, EAB, RPs, SCs, and WGs
  • Ensures feedback leads to concrete actions that benefit integration and operations
  • Provides opportunities for RPs to engage face‑to‑face with ACCESS teams, strengthening collaboration
  • Improves visibility into progress on program tasks and deliverables, enhancing trust and coordination
  • Governance
    • Further refine SC/WG procedures
    • Improve communication channels between EC and SCs/WGs
  • Streamlines governance processes, reducing overhead for RPs and improving operational clarity
  • Strengthens communication pathways, enabling faster resolution of RP issues and needs

31 of 39

ACO - Solidify the Programmatic Foundation for Transition

The ACO will solidify the programmatic foundation for transition by:

ACO Priority

How this Solidifies the Foundation for Transition

  • Communications and Outreach
    • Transfer communications tools (e.g., Constant Contact) to next awardees
    • Archive access‑ci.org in the Wayback Machine
    • Transition social media accounts
    • Share PY5 Communications Plan
    • Determine tradeshow booth transfer and manage transition
    • Document communications/web lessons learned
  • Preserves key communication assets, preventing loss of audiences and continuity
  • Ensures the next program can begin with existing infrastructure rather than recreating it
  • Maintains historical and web content for continuity, transparency, and reference
  • Reduces transition costs for the next awardee through asset transfer
  • Helps the new program onboard faster by providing documented lessons learned
  • Evaluation
    • ACO’s External Evaluator facilitates Executive Council (EC) focus group on Lessons Learned
    • ACO’s External Evaluator creates final summative evaluation of ACO activities and impact

  • Leverages institutional memory of how the EC evolved over the course of the program
  • Helps the new program’s EC onboard faster and more effectively
  • Helps the new program’s ACO onboard faster by providing report of ACO’s evolution and accomplishments

32 of 39

ACO - Solidify the Programmatic Foundation for Transition

The ACO will solidify the programmatic foundation for transition by:

ACO Priority

How this Solidifies the Foundation for Transition

  • Project Office
    • Develop transition plans for tools, processes, and capabilities
    • Prepare for project close‑out and final reporting
  • Ensures a smooth handoff of operational knowledge to the successor program
  • Reduces service disruption at the end of the award lifecycle
  • Governance
    • Further refine SC/WG procedures
    • Improve communication channels between EC and SCs/WGs
  • Provides clear governance documentation that the next program can adopt or adapt
  • Improves internal coordination, supporting stability during and after transition

33 of 39

ACO - Better Capture and Articulate ACCESS Scientific Impact

The ACO will better capture and articulate ACCESS’s scientific impact by:

ACO Priority

How this Better Captures and Articulates Scientific Impact

  • Communications and Outreach
    • Track community‑building and engagement events (Engagement Tracker)
    • Continuous improvement of communications reach and impact
    • Develop and implement communication plans highlighting ACCESS impact
  • Increases visibility of science and education enabled by ACCESS resources
  • Ensures messaging across channels consistently emphasizes impacts and outcomes
  • Strengthens internal understanding of ACCESS contributions through survey insights
  • Expands reach to external audiences, highlighting scientific achievements powered by ACCESS
  • Evaluation
    • Conduct Community Survey
  • Supports the creation of data‑driven stories showing program value

34 of 39

ACO - Better Capture and Articulate ACCESS Scientific Impact

ACO Priority

How this Better Captures and Articulates Scientific Impact

  • Project Office
    • Leverage EAB/RAC recommendations
    • Track and address recommendations with EC
    • Support impactful ACCESS staff participation in conferences
    • Conduct efficient transition planning and project close‑out
  • Ensures recommendations related to scientific impact are addressed
  • Provides opportunities at conferences to communicate ACCESS‑enabled science
  • Facilitates consistent messaging and coordination across teams, improving quality of impact narratives
  • Uses transition planning to document ACCESS achievements for future reference
  • Governance
    • Refine SC/WG procedures
    • Improve communication channels between EC and SCs/WGs
  • Strengthens governance processes, supporting more coherent presentation of program outcomes

The ACO will better capture and articulate ACCESS’s scientific impact by:

35 of 39

Allocations Shared Priority Details

36 of 39

Allocations: Improve User Experience

Improved allocation confirmation messaging, ensuring users know how to access awarded resources

  • What messaging can we improve on the portal page?
  • Not everyone goes back to the portal – how can we best use email or other channels?

37 of 39

Allocations: Increase value to RPs

AMIE

  • Value: easier integration process, easier troubleshooting, more flexibility for RP actions
  • Development in collaboration with Operations and RPs
  • Currently working to finish a first draft of API spec, will be circulated to RPs for review

ACCESS Allocations

RPs

AMIE

38 of 39

Allocations: Solidify Foundation for Transition

  • Address Technical Debt
    • OS Upgrades, language and framework updates (Ruby, Rails, Javascript libraries, CSS Frameworks)

  • Engage with the other tracks to

strengthen security vetting

  • Prepare continuity plans
    • Documentation of allocations process and policies
    • Documentation of technical architecture
    • Packaging data as needed

39 of 39

Allocations: Capture and Articulate Scientific Impact

  • Improved publications collection (work began in PY4)
    • Require publications annually, and before any supplement/extension/renewal
    • Improved interfaces for adding publication

  • Amplify science highlights
    • Collaborate with Comms to promote visibility
    • Work with Metrics team to improve data and analytics of publications