1 of 10

2 of 10

Yuan Tang (Akuity and Argo)

Ning Xu (Map Infra at TuSimple)

Automating Map-building Pipelines for Safe Autonomous Driving with Argo Workflows at TuSimple

3 of 10

Why we choose Argo Workflows

Open Source
Kubernetes Native
Availability & Scalability
Rich Features
Collaborations and Support

Workflow Engine is one of the foundational tools in the map building process. When we compared different workflow tools, we chose Argo Workflows for these reasons.

Open Source: it gives us the opportunity to read the source code and make necessary changes if needed.

Kubernetes Native: all our services are hosted on Kubernetes, and it makes perfect sense to have a Kubernetes native workflow engine for easier management and maintenance.

Availability & Scalability: We value availability and scalability a lot, and that is what Argo Workflows brings us.

Rich Features: There are a lot of features needed in the map building process, especially when human efforts are needed in the middle of a workflow, we need to pause the workflow and wait for the human input.

Collaborations & Support: we have received very good collaboration and support from Akuity to help us with some critical features.

4 of 10

Collaboration: Akuity and TuSimple

Domain Requirements

Retry on arbitrary nodes
Event aggregation customization

Collaboration between Akuity and Tusimple

Issue report
Test iteration

5 of 10

Use Cases at TuSimple

Map Data Processing

Single Bag Pipeline
Patch Pipeline

CI/CD

Applications Deployment
Deployment Pipeline (Integration -> Staging -> Production)

6 of 10

Community Use Cases

Machine Learning Pipelines

CI/CD and Infrastructure Automation

Data Processing / ETL

Running a Data Replication Pipeline on Kubernetes with Argo

Others

awesome-argo: A Curated List of Awesome Projects and Resources Related to Argo

7 of 10

Community Contributions

800+ contributors
Mentoring and contributors meeting
40 core maintainers from over 10 organizations

CNCF project rankings of developer velocity based on project activity

8 of 10

Community Adoption

200+ end user companies, 14k+ Slack members, 25k+ GitHub stars, 6k+ forks

9 of 10

Community Feedback and Support

Feedback

Annual User Survey (2022, 2021, and 2020)
In-app Survey in Argo Workflows UI

Support

GitHub issues (bug reports, enhancement requests, mentoring requests)
GitHub discussions (Q&A, showcases)
Slack (project-specific channels, 14k+ Slack members)
Contributors meeting

10 of 10

Thank you! Questions?

Talk with us on the CNCF Slack: https://argoproj.github.io/community/join-slack/
Yuan Tang @TerryTangYuan on Slack, Twitter, LinkedIn, etc.
Ning Xu @Ning on Slack