AI in Production
Aisha Yusaf
orra Co-Founder
Ezo Saleh
orra Co-Founder
Expertise in Applied AI and DeepTech since 2017. Tech veteran with over 20 years of experience at BBC R&D, JP Morgan Chase, and various startups. Specialises in optimizing complex systems, including distributed systems and Kubernetes tooling.
Launched an AI-powered children's camera game and a podcast audience insights platform. Graduate of Central Saint Martins and London Business School. Excels at achieving innovative solutions through multi-disciplinary collaboration.
WRANGLING WILD AGENTS
βIn March 2024 we built AI agents to scale buyer and seller onboarding for our marketplace startup.
We hit major production problems like service coordination, cascading errors and unnecessary agent calls racking up expensive LLM cost. With experience in distributed systems and developer tooling we decided to pivot.β
Firsthand AI Agent Challenges
Challenges to Deploying Agents
Latency
Slow workflows due to large data processing
Cost
Chatty agents driving up LLM costs
Reliability
Cascading errors making systems unpredictable
Integration
Difficulty integrating agents with existing infrastructure
Expectations vs Reality
Where 'just three agents talking' becomes a distributed systems PhD thesis
Key Realisations
Adaptive execution planning
Domain understanding
Balancing autonomy & control
The Missing Glue Layer
TECH DEEP DIVE
Monolithic Architecture
Monolithic Architecture
π
Architecture Rethink
Architecture Rethink w/ orra
How it works
Multi-agent Architecture w/ Planning
π
Multi-agent w/ Reliable Consistency
β
π
π₯
β
Multi-agent w/ Reliable Consistency
How it works
π
promote revertability
β
Multi-agent w/ Reliable Plans
π
βΌοΈ
βΌοΈ
Multi-agent w/ Reliable Plans
How it works
π
β
Thank You!
Aisha Yusaf
orra Co-Founder
Ezo Saleh
orra Co-Founder