EngRes Team Summit
Day 2
October 26, 2022
EngRes Team Summit
Lightning Talks
October 25, 2022
Todayโs Schedule
9:00 - Why Roadmapping (this way) - Juan
9:30 - PL Network Roadmapping Tool (WIP) - Reid
9:40 - Draft 2023 Goals and Metrics - Molly
10:00 - Working Session: Team Roadmaps (1.5h)
11:30 - Break โ๏ธ
11:45 - 2023 Roadmap & Priorities
12:45 - Closing Thank Youโs
13:00 - Lunch ๐ฅ
Why Roadmapping (this way)
October 26th, 2022
PL EngRes WG
Throughout PLโs history, weโve experimented with dozens of planning tools and roadmaps.
Throughout PLโs history, weโve experimented with dozens of planning tools and roadmaps.
Teams always have different requirements, nuances, and preferences => teams need different tools for their own work.
Throughout PLโs history, weโve experimented with dozens of planning tools and roadmaps.
Teams always have different requirements, nuances, and preferences => teams need different tools for their own work.
And, weโve arrived at a set of requirements for inter-team & user-focused roadmaps.
And, weโve arrived at a set of requirements for inter-team & user-focused roadmaps.
Key Guiding Principle: ๏ฟฝ Roadmaps have diff. purposes โ different Zoom Levels
Zoom 1
Zoom 2
Zoom 3
Zoom 4
Weโve arrived at a fine-tuned set of requirements for inter-team & user-focused roadmaps.
Zoom 1
High-level plan
User Roadmap
Zoom 2
Zoom 3
Engineering breakdown
Orients and aligns stakeholders against valuable progress indicators
(other teams/startups can plan against quarter-year scale milestones)
User Roadmap
Need a way to integrate & cross-ref
Need a way to externalize plan, progress, & dependencies publicly
Inspiration
Communicates wider themes & milestones across upcoming improvements, easily sharable in public talks!
Key requirement: 1 slide, visual, in time.
Sub-Ecosystem Roadmap
This, but machine readable
& Interlinkable
In a convenient, easy to use, familiar way (github issues)
Roadmapping Tool
October 26th, 2022
PL EngRes WG
Prompt
2023 Goals & Metrics
October 26th, 2022
PL EngRes WG
EngRes 2023 Strategy
Keep critical systems running, growing, releasing, scaling, and secure
(1) Critical System Stewardship
Hyperscale + accelerate the talent & teams contributing to PL Stack protocols
(2) Growing Team & Network
Upgrade Filecoin with new L2 capabilities, shardable chain-space, & compute over data
(4) Compute over Filecoin State & Data
Scale data onboarding & CDN-speed retrievals to drive supralinear adoption w lighthouse users
(3) Robust Storage & Retrieval
PLv9 Principles
For EngRes
2023 Goals
2023 Goals
2023 Goals
2023 Goals
Working Session:
Team Roadmaps
October 26th, 2022
PL EngRes WG
โ๏ธ Coffee Breakโฆ
Next session starts in 15 min
๐ฃIcebreaker Topic:
Who is doing something cool you hope to collaborate with or support next year?
PL EngRes Project Roadmaps
October 26th, 2022
Molly Mackinlay
๐บ Roadmap Presentations
EngRes 2023 Strategy
Keep critical systems running, growing, releasing, scaling, and secure
(1) Critical System Stewardship
Hyperscale + accelerate the talent & teams contributing to PL Stack protocols
(2) Growing Team & Network
Upgrade Filecoin with new L2 capabilities, shardable chain-space, & compute over data
(4) Compute over Filecoin State & Data
Scale data onboarding & CDN-speed retrievals to drive supralinear adoption w lighthouse users
(3) Robust Storage & Retrieval
EngRes 2023 Strategy
Keep critical systems running, growing, releasing, scaling, and secure
(1) Critical System Stewardship
Hyperscale + accelerate the talent & teams contributing to PL Stack protocols
(2) Growing Team & Network
Upgrade Filecoin with new L2 capabilities, shardable chain-space, & compute over data
(4) Compute over Filecoin State & Data
Scale data onboarding & CDN-speed retrievals to drive supralinear adoption w lighthouse users
(3) Robust Storage & Retrieval
EngRes 2023 Strategy
Keep critical systems running, growing, releasing, scaling, and secure
(1) Critical System Stewardship
Hyperscale + accelerate the talent & teams contributing to PL Stack protocols
(2) Growing Team & Network
Upgrade Filecoin with new L2 capabilities, shardable chain-space, & compute over data
(4) Compute over Filecoin State & Data
Scale data onboarding & CDN-speed retrievals to drive supralinear adoption w lighthouse users
(3) Robust Storage & Retrieval
IPFS Stewards: 2023 Priorities
@Reid
IPFS Stewards: 2023 Roadmap
@Reid
IPFS Stewards: 2023 Roadmap
@Reid
ProbeLab: 2023 Priorities
@yiannis
Area 1: Verify correct operation and optimize core stack protocols - focus: DHT, Gossipsub
Importance: Improve user-perceived QoS, help optimize other implementations
Area 2: Improve and productionize our Monitoring & Measurement Infrastructure
Importance: The ecosystem can easily consume our results and re-use our tools
Area 3: Improve libp2p privacy guarantees
Importance: Satisfy long-standing community and user request
๐ Secure
Building on libp2p improves an application's security posture. We minimize vulnerabilities and act rapidly to address and report issues.
๐ฅฝ Specified
We thoroughly specify the libp2p framework and its suite of supported protocols, independent of language or implementation. Through specifications, we coordinate and drive future developments.
๐ชจ Stable
Releases do not unknowingly break deployed features. We maintain cross-version compatibility across libp2p releases and implementations. Deprecations are well-communicated.
๐ Performant
We ensure comparable performance to widely used protocols on the Internet. We avoid performance degradations in new releases.
libp2p Tenets ๐๏ธ - libp2p is:
@marten-seemann
These tenets form the foundation for features and initiatives in implementation roadmaps.
As a result, we generally prioritize filling any gaps in these tenets above other work.
libp2p: 2023 Priorities
๐ก Connectivity: expand libp2p ecosystem ๐ค browsers
Why:
๐ Performance: prove libp2p is fast, make it even faster
Why:
โ๏ธ Interoperability: prove libp2p is interoperable
Why:
well tested, battle-hardened, & backwards compatible software
@marten-seemann
libp2p: 2023 Roadmap
@marten-seemann
Q4
Q1
Q4
Q1
Q4
Q4
libp2p: 2023 Priorities
๐ก Connectivity: expand libp2p ecosystem ๐ค browsers
How:
๐ Performance: Prove libp2p is fast
How:
โ๏ธ Interoperability: prove libp2p is interoperable
How:
@marten-seemann
libp2p: '22 Q4-'23 Q1 Roadmaps ๐บ
@marten-seemann
ฯ
The test-plans roadmap is complementary to the Go, Rust, and JS roadmaps.
It aims to encompass the stability and performance tenets of the libp2p team. Projects outlined here are shared priorities of the different implementations.
libp2p: '22 Q4-'23 Q1 Roadmaps ๐บ
@marten-seemann
IP JS: 2023 Priorities
@Alex
IPFS-in-JS: 2023 Priorities
202211 - communicate the IPFS-in-JS state
202212 - Double team capacity
@achingbrain
IPFS-in-JS: 2023 Priorities
202301 - โPomegranateโ execution plan
2023Q1 - โv1โ of โPomegranateโ released
2023Q2 - EngRes ceases maintaining โlegacy js-ipfsโ
@achingbrain
IPFS GUI and Tools team โ IG&T โ Ignite: 2023 Priorities
@russell
Ignite: 2023 Roadmap
@russell
IPLD: 2023 Priorities
1. Documentation | Focusing on the onboarding journey |
2. Distributed Data Structures | Document / describe / specify existing data structures. Develop and implement missing critical pieces, including ordered maps. |
3. CAR Consolidation | Support and consolidate work being invested in CAR as a primary transport format with varied use. |
4. Testing & Compliance | Consolidate fixtures; develop negative fixtures for core components. |
Rust | Maturity & completeness of basic components, support FVM and Iroh |
Go | Stability, usability and performance |
JavaScript | Higher-level APIs for combining, layering, lensing |
WASM | Roadmap! |
@rvagg
Core Priorities: Resourcing, team-rebuilding, forming an aligned, cross-language IPLD vision and tooling
Important work items:
Lotus & Actors: 2023 Priorities
@jennijuju
1๏ธโฃ Driving research to production
2๏ธโฃ Define the identity of Lotus as a client implementation
3๏ธโฃ Robust Storage: Modular Lotus Miner
Lotus & Actors: Drive research to production
@jennijuju
1๏ธโฃ Driving research to production
Q4 2022 ๐ฆFilecoin v17 Shark Upgrade
Q1 2023 ๐Filecoin FEVM Upgrade
Q2 2023 ๐๏ธUser Programmable Storage Markets
Q3 2023 ๐ฐ๏ธ Excellence Programmable Storage Markets: Halo2, User Cron & beyond
2๏ธโฃ Define the identity of Lotus as a client implementation
Q1 2023 Hardening Lotus Code Base: Drop EOL-service code
Q2 2023 Lotus Client Experience: Easy deployment, Filecoin client API standard, Light Client
3๏ธโฃ Robust Storage: Modular Lotus Miner
Q4 2022 ๐Flexible Scheduler
Q1 2023 ๐งท Standalone Sealing Manager Process
Q2 2023 ๐ช Updatable Storage
Q3 2023 ๐งโ๐ฌ Redundant Proving System
Fil-Infra: 2023 Priorities
@ognots
PLAY ME
Sentinel: 2023 Priorities
๐บ Lily (Filecoin Chain Indexer)
๐พ PLDW (PL Data Warehouse)
๐ซ Community
@birdy
CryptoEconLab, Core Protocol WG: 2023 Priorities
@tom
Main Objectives:
Key Milestones for next 6 months:
CEL
Layer 2 Incentives
Ecosystem Solutions
Core Protocol
Filecoin Protocol Research
ResDev for Filecoin Layer 2s
Communication and Education
Drand: 2023 Priorities
Area 1: Refactor codebase to support next stage of development
Importance: Increase confidence in codebase, reduce risk of incidents and downtime
Area 2: Drive Community Engagement: Create easier onboarding for developers and users of drand
Importance: Increase drand adoption
Area 3: LoE Engagement
Importance: Create team spirit and more active involvement of the 16+ partners
@yiannis
Docs: 2023 Priorities
@jennijuju
EngRes 2023 Strategy
Keep critical systems running, growing, releasing, scaling, and secure
(1) Critical System Stewardship
Hyperscale + accelerate the talent & teams contributing to PL Stack protocols
(2) Growing Team & Network
Upgrade Filecoin with new L2 capabilities, shardable chain-space, & compute over data
(4) Compute over Filecoin State & Data
Scale data onboarding & CDN-speed retrievals to drive supralinear adoption w lighthouse users
(3) Robust Storage & Retrieval
Level-up EngRes Team Growth: 2023 Priorities
@momack
Growing the Team and Network
October 26th, 2022
PL EngRes WG
EngRes Events: 2023 Priorities
@yuni
๐Partner with PLN Events teams to:
| โฉ 2024 Events Calendar by Nov โฉ Playbook + Tips for Event Planning |
๐Continue to plan IPFS and other Starfleet Sponsored Events:
| โฉ Overall increase in attendance
|
๐คGrow the IPFS Community
| โฉ Help launch in 3 different regions โฉ At least 4 IPFS + Friends Popups |
๐Care about the world
| โฉ Partner organizations IDโd โฉ Donating at least 10% of supplies โฉ Minimal food goes to waste |
๐ฐCommunicate
| โฉ At least 4 Newsletters (1/ quarter) |
CryptoEconLab, Ecosystem WG: 2023 Priorities
@dave
Main Objectives:
Key Milestones for next 6 months:
CEL
Layer 2 Incentives
Ecosystem Solutions
Core Protocol
Filecoin Protocol Research
ResDev for Filecoin Layer 2s
Communication and Education
IPDX: 2023 Priorities
@galargh
Testground is THE distributed/decentralised systems testing platform
User Goals
Project Requirements
We work together
You can count on us
IPDX: 2023 IPDX Roadmap
@galargh
IPDX: 2023 Testground Roadmap
@galargh
EngRes 2023 Strategy
Keep critical systems running, growing, releasing, scaling, and secure
(1) Critical System Stewardship
Hyperscale + accelerate the talent & teams contributing to PL Stack protocols
(2) Growing Team & Network
Upgrade Filecoin with new L2 capabilities, shardable chain-space, & compute over data
(4) Compute over Filecoin State & Data
Scale data onboarding & CDN-speed retrievals to drive supralinear adoption w lighthouse users
(3) Robust Storage & Retrieval
Storage and Retrieval
October 26th, 2022
PL EngRes WG
Bedrock: 2023 Priorities
Bedrock is a Team of (Platform) Teams
@jacob / lauren
Retrieval Markets WG: 2023 Priorities
What are the 1-3 main areas your team is focused on next year, and why are they important to the wider PLN / networks?
@patrickwoodhead
Saturn: 2023 Priorities
What are the 1-3 main areas your team is focused on next year, and why are they important to the wider PLN / networks?
@ansgar
Station: 2023 Priorities
@Miro
CryptoNet Lab: Storage Product 2023 Priorities
@nickle
CryptoNet Lab: Storage Product 2023 Priorities
@nickle
FIPs
Storage Protocols
CryptoNet Lab: Storage Product 2023 Priorities
@nickle
Bifrost: 2023 Priorities
@jesse
DAG House: 2023 Priorities
@dchoi
EngRes 2023 Strategy
Keep critical systems running, growing, releasing, scaling, and secure
(1) Critical System Stewardship
Hyperscale + accelerate the talent & teams contributing to PL Stack protocols
(2) Growing Team & Network
Upgrade Filecoin with new L2 capabilities, shardable chain-space, & compute over data
(4) Compute over Filecoin State & Data
Scale data onboarding & CDN-speed retrievals to drive supralinear adoption w lighthouse users
(3) Robust Storage & Retrieval
FVM: 2023 Roadmap
@raulk
Prios:
FilCrypto: 2023 Priorities
@shawnrader
Consensus Lab: 2023 development roadmap
23Q1
IPC in Spacenet
Scalability stress tests
23Q2
Use cases on Spacenet
EC patch on Mainnet
23Q3
IPC on Mainnet
23Q4++
Lurk zk execution
Parallel FVM execution
Basic Milestones and Priorities (IPC, EC)
Objectives | 4: upgrades FIL with new L2 capabilities | 4: upgrades FIL with new L2 capabilities 1: keeping critical systems secure | 4: upgrades FIL with new L2 capabilities 3: enhancing decentralised CDN architectures | 4: upgrades FIL with new L2 capabilities |
Unlocks | Test subnets for computation (Bacalhau) and coordination (Saturn) | You get to sleep better at night | New capabilities for FVM applications | Computation-intensive applications, improved security and decentralisation |
Consensus Lab: upcoming IPC milestones
Consensus Lab: 2023 research roadmap [WIP]
Randomised consistent broadcast, formalising general SMR, Starfish (EC mainnet consensus alternative),
formal verification and model checking
(1) Critical System Stewardship
dOnlyFans, Turning ConsensusDay into a full-fledged conference, more external academic grants
(2) Growing Team & Network
IPVM, deduplication of transaction dissemination, weaker-than-total-order semantics, dataflow-driven rust-based consensus framework, subnet consensus protocols
(4) Compute over Filecoin State & Data
dOnlyFans
(5) Actual business model
โบ๏ธ Familiar
Our users want to focus on great new solutions, not rebuilding things that already worked elsewhere. We must meet them where they are to bridge the gap and help them adopt Compute over Data. This means providing them tools and platforms that feel both familiar and better than their existing solutions.
๐ Secure
Data being run on a Compute over Data network is often among the most important companyโs have. We must meet and exceed our userโs security expectations. These include:
๐ชจ Reliable
Customers have high expectations for Compute over Data platforms about performance, uptime and completion of jobs. Beyond just ensuring a โnumber of 9sโ, we must also deliver a platform that is stable from release to release, has stated upgrade and compatibility policy, and has been thoroughly tested for stated supported configurations.
๐ท๏ธ Best Price/Performance
Compute over Data platforms have price/performance ratios that are extremely well understood. For a given job, we must be able to meet or beat these measurements for the vast majority of use cases.
CoD Tenets ๐๏ธ - Bacalhau is:
@aronchick
Dec 2022 | | M1: Data permanence powered by FIL+. Improved performance and 2x examples.๏ฟฝDashboard for visualizing jobs. | | M1: FIL+ integration launches, CPs doing the job can โwinโ verified deals first, much simplified setup |
Mar 2023 | | M2: Support for WASM; Improved reliability. Faster REPL (local code -> executing remotely -> feedback). API/client reaches 1.0. Grant program & โBacalhau Seasonโ starts. | | M2: Unified control plane across nodes and metrics dashboard. Partner program for CP to augment their storage systems. Multiple executors support. API/server reaches 1.0. |
Jun 2023 | | M3: Streamlined developer experience (with lots of syntactic sugar). Support for DAGs, Federated Reads and Rich Local Client | | M3: Additional deal engines, Support for up to โ unreliable nodes in a job. |
Sep 2023 | | M4: Consensus & verification of deterministic jobs. Website for data & common jobs. Arbitrary networking via gateway. | | M4: โAnyone can be a compute providerโ via rich client execution in Station. Reputation system highlights trustworthy compute providers. Clustered deployments with internode connectivity. |
CoD: 2023 Roadmap
@aronchick
End Users
Compute Providers
Dec 2022 | | M1: Data permanence powered by FIL+. Improved performance and 2x examples.๏ฟฝDashboard for visualizing jobs. | | M1: FIL+ integration launches, CPs doing the job can โwinโ verified deals first, much simplified setup |
Mar 2023 | | M2: Support for WASM; Improved reliability. Faster REPL (local code -> executing remotely -> feedback). API/client reaches 1.0. Grant program & โBacalhau Seasonโ starts. | | M2: Unified control plane across nodes and metrics dashboard. Partner program for CP to augment their storage systems. Multiple executors support. API/server reaches 1.0. |
Jun 2023 | | M3: Streamlined developer experience (with lots of syntactic sugar). Support for DAGs, Federated Reads and Rich Local Client | | M3: Additional deal engines, Support for up to โ unreliable nodes in a job. |
Sep 2023 | | M4: Consensus & verification of deterministic jobs. Website for data & common jobs. Arbitrary networking via gateway. | | M4: โAnyone can be a compute providerโ via rich client execution in Station. Reputation system highlights trustworthy compute providers. Clustered deployments with internode connectivity. |
CoD: 2023 Roadmap
@aronchick
End Users
Compute Providers
CryptoEconLab, Layer 2 WG: 2023 Priorities
@maria
Main Objectives:
Key Milestones for next 6 months:
CEL
Ecosystem Solutions
Core Protocol
Filecoin Protocol Research
ResDev for Filecoin Layer 2s
Communication and Education
Layer 2 Incentives
CryptoNet Lab: Research & Compute 2023 Priorities
@nickle
CryptoNet Lab: Research & Compute 2023 Priorities
@nickle
FIPs
Medusanet.xyz
CryptoNet Lab: Research & Compute 2023 Priorities
@nickle
Applied Research
EngRes 2023 Strategy
Keep critical systems running, growing, releasing, scaling, and secure
(1) Critical System Stewardship
Hyperscale + accelerate the talent & teams contributing to PL Stack protocols
(2) Growing Team & Network
Upgrade Filecoin with new L2 capabilities, shardable chain-space, & compute over data
(4) Compute over Filecoin State & Data
Scale data onboarding & CDN-speed retrievals to drive supralinear adoption w lighthouse users
(3) Robust Storage & Retrieval
@molly
๐
๐
๐
๐
๐
๐
๐
Thank you to all our presenters!
Closing Thank Youโs
October 26th, 2022
Molly Mackinlay
@molly
๐
๐
๐
๐
๐
๐
๐
๐ฟ your thank youโs!
@molly
Meeting Rooms Day 2
@katalia
Room: Chiado I & II (Breakout Room #1+2)
Time: All Day
Team: ENGRES TEAM SUMMIT
Room: Chiado III (Breakout Room #3)
Time: 2-7pm
Team: CRYPTONET
Room: Lapa I (Breakout Room #4)
Time: 9am-2pm
Team: EngRes Team Breakout
Room: Castelo IV
Time: 2-4pm
Team: People Managers Sync
Room: Alfama II
Time: 2-5pm
Team: NetOps Team Summit
Room: Lapa II (Breakout room #5)
-Time: 9am-2pm
Team: EngRes Team Breakout
-Time: 2-7pm
Team: FilDev
Meeting Rooms Day 2
@katalia
ENGRES TEAM SUMMIT
ENGRES TEAM SUMMIT
CRYPTONET
NETOPS TEAM SUMMIT
-EngRes Team Breakout ๏ฟฝ-Bedrock
-EngRes
Team
Breakout ๏ฟฝ-FilDev
Unconfs
Reminder
Unconfs
Reminder - Launchpad
๐ฅ Lunch Breakโฆ
๐EngRes People Managers - please be back in 1 hour
๐ฃIcebreaker Topic:
Who or what has made a positive impact in your life this year? How are you going to pay it forward?
People Manager Sync
October 26th, 2022
Steve Loeppky
Template Slide
EngRes Team Summit
Roadmap Presentations
October 25, 2022
EngRes Team Summit
Roadmap Presentations
October 25, 2022
Template Slide