Public Review

Review

Preprint

(author released)

Final version

Curate

Publish

Credit: Rowan Cockett

?

Credit: Rowan Cockett

The future: integration of doing and sharing science

Scientist-led publishing: Scientists should do the research and publish it; they should determine when and what to publish and how to correct the published record with input from peers

Workshop Setup

• Janelia Research Campus, Dec 10 - 12, 2024�
• Facilitated by Kristen Ratan, David Stern, Jakob Voigts and me�
• 41 attendees
• Researchers
• Innovators
• OS experts

​

Purpose

To define principles and construct visions for the future of research communication, moving from abstract ideas and one-off experiments to a holistic model that can be incentivized

Framing: Incentive owners are searching for a solution to incentivize. We’re here to leverage our experience and expertise to solve this problem together.

“How the &%$# are we going to do it?”

Workshop Structure

• Very Short Lightning Talks�
• Group Discussions/Brainstorming�
• Breakout Sessions
• Role-playing exercises to explore solutions from the perspective of certain stakeholder groups

Principles for the Container

Content

Format

Production Process

Business Model

/Sustainability

Attribution/Credit

• Accurate
• Complete (include all relevant outputs)
• AI-interpretable
• Data-centric
• Modular

• FAIR
• Machine-readable
• AI-actionable
• Flexible
• Sufficient metadata

• Researcher-driven
• Transparent
• Scalable
• Adaptable
• Versionable
• Establish provenance
• Embrace LLMs, AI checks

• Free for authors & readers
• Affordable to host/run
• Decentralized
• Respect data sovereignty /rights
• Low barrier to entry

• Link to contributors
• Use CRedIT-like system
• Align incentives with contributions

Principles for the Consumption Ecosystem

Accessibility

Validation & Integrity

Review & Asses’t

Curation & Filtering

Other/Aspirational

• To both humans and machines
• Offline and online access

• Human and AI-generated
• Allow certification by trusted entities
• Identity verification, COIs clarifies

• Author- and community-driven
• Transparent where possible
• Allow anonymity
• Diversity of entities

• Can take many forms, performed by many actors and occur at any point
• Simple mechanisms to endorse/recommend

​

• Foster trust
• Global & Inclusive
• Support community and collaboration

Stakeholder Perspectives

Researchers

Reviewers

Funders

Institutional

Leaders

Public

• Modular
• Minimal assembly required
• Fine-grained credit
• Rapid predicative signals of impact
• Market for overlays/recommendations

• Simplified reviewing process
• Recognition & credit for reviewing
• Persistent reviews that are available to others
• Option for anonymity

• Promotion of continuous science
• Ability to measure impact, validate reproducibility & rigor
• Sustainable, open infra
• Emphasis on data, code and protocol availability and machine accessibility

• Mechanisms to precisely evaluate research excellence
• Surfacing and rewarding publishing & non-publishing activities (collab)
• Better control
• Rational pricing

• Access to reliable information
• Journalistic style
• Lay summaries
• Media options

Next Steps

Future Workshops: Continue the conversation with focused workshops on specific topics. Build a community-driven plan and accelerate collaborative efforts. Engage a larger community to maintain momentum and generate further opportunities for ideation and collaboration.

​

• Infrastructure: Refine the research container, improve interoperability, and build community collaboration. Incorporate existing frameworks and technologies, and ensure open-source, modularity, and ease of deployment.�
• Incentives: Align incentives between institutions and scientists. Lobby incentive owners to financially support the new publishing environment and incentivize releasing scientific results in this new model. �
• Evaluation and Trust: Seed diverse mechanisms to introduce scientists to the new environment, encourage transparency throughout the consumption ecosystem, and support participation.��

Comments

Welcome!