1 of 54

Agent Engineering

Why

latent.space

smol.ai/news

2 of 54

How is AI Engineering doing?

3 of 54

The Evolution of the AI Engineer

Rise of AI Engineer

The 1000x AI Engineer

AI Engineering Without Borders

4 of 54

The Evolution of the AI Engineer (old)

5 of 54

The Evolution of the AI Engineer (now)

MLE POV

SWE POV

6 of 54

The Evolution of the AI Engineer (ideal)

MLE

SWE

AIE

7 of 54

The Evolution of the AI Engineer (ideal)

MLE

SWE

AIE

test time

compute

inference time

compute

reasoning

8 of 54

why we are

all-in on agents

9 of 54

The Evolution of the AI Engineer conf

10 of 54

how we chose

your speakers

11 of 54

just make everything agentic?

12 of 54

how we chose

your speakers

vendor pitches

13 of 54

have you tried rubbing an agent on it?

Agent + RAG = Agentic RAG!

Agent + CodeGen = Bolt! Windsurf Cascade!

Agent + Search = Deep Research!

Agent + Vision = Computer Use Agent!

Agent + Voice = SuperDial! Method Financial!

Agent + Wearable = Bee!

Agent + Finance = BrightWave/Bloomberg/BlackRock!

Agent + Money = Solana/Stripe!

14 of 54

“2025 is the year of agents”

15 of 54

16 of 54

“name a buzzword everyone is tired of hearing”

17 of 54

https://latent.space/p/adept - March 2024

18 of 54

go ahead

define “agent”

SlidesCarnival

August 19, 2024

19 of 54

Definitions of Agent based on POV

MLE

SWE

AIE

"A system that perceives its environment through sensors and acts upon that environment through actuators to achieve specific goals."

???

"LLM calls in a for loop"

20 of 54

“An AI system component that performs non-trivial, multi-step operations that previously would have required a human.” - @DanielMiessler

“An AI system that's capable of carrying out and completing long running, open ended tasks in the real world.” - @Dan_Jeffries1

LLM Control Flow

Encoded Intent

Long-Running Memory

Multi-Step Planning

Delegated Authority

“a system that is trusted to make impactful decisions on behalf of me”

Tool-using LLMs

“agent = llm + memory + planning + tools + while loop” - swyx

"The more agentic an application is, the more an LLM decides the control flow of the application" - @hwchase17

Metaphors

Reductiveness

“control system for future states” - @plinz

Specific Examples

Code Interpreter

Deep Research

Operator

"LLM calls in a for loop"

“An agent is a system that can pursue a goal-oriented behavior, adapt along the way to achieve its goals.”

21 of 54

OpenAI’s new Agents Definition

SlidesCarnival

August 19, 2024

22 of 54

soooo

why now?

SlidesCarnival

August 19, 2024

23 of 54

24 of 54

why agents now?

Better capabilities

SlidesCarnival

August 19, 2024

Better tool use

100% Structured Output, BFCLv3

Better tools (AX)

MCP, Sandboxes, Browsers, Search

Memory/RAG frameworks/DBs

Long inference/reasoning

Better/More data

MMLU/GPQA Saturation

25 of 54

model diversity

26 of 54

1000x cheaper GPT4

27 of 54

RL Finetuning

28 of 54

why agents now?

Better capabilities

Better tool use

100% Structured Output, BFCLv3

Better tools (AX)

MCP, Sandboxes, Browsers, Search

Memory/RAG frameworks/DBs

Model diversity

GPT5, DeepSeek r3, Gemini 2, Claude 4, Grok 3, Llama 4, Qwen 3, TML, SSI

1000x cheaper GPT4

Cheap inference, Open models, Distillation improvements, VC funding

RL Finetuning

DPO, GRPO, Just saying “wait…”

Charge what it delivers to customer

Not free/$20/what it costs to make

Outcomes vs Cost-plus

Multi-agent research

Building Effective Agents, LLM as Judge

CrewAI, AutoGen, PydanticAI…

10x Inference Speed

30 tok/s -> 1000+ tok/s

Long inference/reasoning

Better/More data

MMLU/GPQA Saturation

29 of 54

why agents now?

Better capabilities

Long inference/reasoning

latent.space/p/jan-2024

100% Structured Output, BFCLv3

latent.space/p/benchmarks-201

Better tool use

MCP, Sandboxes, Browsers, Search

latent.space/p/browserbase

Better tools (AX)

Model diversity

GPT5, DeepSeek r3, Gemini 2, Claude 4, Grok 3, Llama 4, Qwen 3, TML, SSI

latent.space/p/2024-startups

1000x cheaper GPT4

Cheap inference, Open models, Distillation improvements, VC funding

latent.space/p/reasoning-price-war

DPO, GRPO, Just saying “wait…”

see Will Brown’s talk

RL Finetuning

Charge what it delivers to customer

Not free/$20/what it costs to make

latent.space/p/bret

Outcomes vs Cost-plus

Building Effective Agents, LLM as Judge

CrewAI, AutoGen, PydanticAI…

latent.space/p/2024-agents

30 tok/s -> 1000+ tok/s

latent.space/p/inference-fast-and-slow

Multi-agent research

10x Inference Speed

30 of 54

Agent use cases

Killer Use Cases

  • Coding Agents
  • Support Agents
  • Deep Research
  • Transcribing ++

Up and Coming

  • Screensharing
  • Outbound Sales
  • Hiring
  • Education - speak
  • Finance
  • Personal AI

Please Stop Making Fetch Happen

  • Flight Booking
  • Instacart orders
  • Astroturfing Reddit

looking at you y combinator

31 of 54

Agent PMF — ChatGPT.com

https://chatgpt.com/share/67b7fbe4-6204-8012-ba5c-21574623a93e

32 of 54

Agent PMF — ChatGPT.com

https://chatgpt.com/share/67b7fbe4-6204-8012-ba5c-21574623a93e

ChatGPT stopped

growing for a year

with GPT4/4 Turbo

33 of 54

1B users by 2026 from Reasoning/Agents

34 of 54

The Evolution of the AI Engineer (ideal)

MLE

SWE

AIE

test time

compute

inference time

compute

reasoning

models

agents

software

ML pipeline

ADLC

SDLC

35 of 54

(Bonus) AI Eng Advice

  1. Mind Agent Security: OWASP LLM Top 10 (eg Prompt Injections)
  2. Less (Knobs) is More: latent.space/p/notebooklm
  3. AI UX: Editable Plans - Devin got it right
  4. AI UX: Give people a way to OPT OUT OF YOUR AGENT (and reset)
  5. Be Evals-First: Online, Offline, and Living Evals
    • Agents don’t rise to the level of your tweets…
    • … they fall to the level of your evals
  6. Have a Data Strategy: Data Flywheel, Data Ingestion, Synthetic Data
    • Small minds look at prompts
    • Average minds look at evals
    • Great minds look at data

36 of 54

Thank You! Enjoy the show!

(btw get in early on the next one: ai.engineer/2025)

swyx.io / @swyx

latent.space / youtube.com/@latentspacepod

ai.engineer / @aiDotEngineer

smol.ai/news / @smol_ai

37 of 54

38 of 54

Thank You

(enjoy the show!)

tweet @ swyx to say hi!

SlidesCarnival

August 19, 2024

39 of 54

    • Introduction
    • About Us
    • Our Projects
    • Chapter Title
    • Chapter Title

SlidesCarnival

August 19, 2024

40 of 54

Welcome to Presentation

I'm Rain, and I'll be sharing with you my beautiful ideas. Follow me at @reallygreatsite to learn more. Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit an.

SlidesCarnival

August 19, 2024

41 of 54

Our company was created with the vision to be the best in the industry.

Who we are?

Elaborate on your topic here. Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. A diam maecenas sed enim ut sem viverra aliquet eget.

SlidesCarnival

August 19, 2024

Who we are?

Elaborate on your topic here. Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. A diam maecenas sed enim ut sem viverra aliquet eget.

Who we are?

Elaborate on your topic here. Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. A diam maecenas sed enim ut sem viverra aliquet eget.

42 of 54

About Us

SlidesCarnival

August 19, 2024

43 of 54

Our History

Presentations are communication tools that can be used as demonstrations, lectures, speeches, reports, and more. It is mostly presented before an audience. It serves a variety of purposes, making presentations powerful tools for convincing and teaching.Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit.

SlidesCarnival

August 19, 2024

44 of 54

Mission Vision

Presentations are communication tools that can be used as demonstrations, lectures, speeches, reports, and more. It is mostly presented before an audience. It serves a variety of purposes, making presentations powerful tools for convincing and teaching.Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit.

SlidesCarnival

August 19, 2024

45 of 54

Meet the Team

John Doe

position

SlidesCarnival

August 19, 2024

Jane Doe

position

John Doe

position

46 of 54

Our Projects

SlidesCarnival

August 19, 2024

47 of 54

SlidesCarnival

August 19, 2024

Project One

Elaborate on your project here.

Project One

Elaborate on your project here.

Project One

Elaborate on your project here.

48 of 54

Project One is lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt.

SlidesCarnival

August 19, 2024

49 of 54

Project Two

Presentations are communication tools that can be used as demonstrations, lectures, speeches, reports, and more. It is mostly presented before an audience. It serves a variety of purposes, making presentations powerful tools for convincing and teaching.Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt.

SlidesCarnival

August 19, 2024

50 of 54

SlidesCarnival

August 19, 2024

Gallery

51 of 54

Market Research

Presentations are communication tools that can be used as demonstrations, lectures, speeches, reports, and more. It is mostly presented before an audience. It serves a variety of purposes, making presentations powerful tools for convincing and teaching.Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit.

+88%

Elaborate on the statistic here.

+400k

Elaborate on the statistic here.

-12%

Elaborate on the statistic here.

SlidesCarnival

August 19, 2024

52 of 54

Contact Us

123 Anywhere St., Any City,ST 12345

123-456-7890

hello@reallygreatsite.com

reallygreatsite.com

@reallygreatsite

SlidesCarnival

August 19, 2024

53 of 54

This presentation template

uses the following free fonts:

You can find these fonts online too.

TITLES:

DM SERIF DISPLAY

HEADERS:

DM SERIF DISPLAY

BODY COPY:

DM SANS

Use these design resources in your Canva Presentation.

DON'T FORGET TO DELETE THIS PAGE BEFORE PRESENTING.

Resource Page

FONTS

DESIGN ELEMENTS

COLORS

#FFFFFF

#1F1F1F

54 of 54

This presentation template is free for everyone to use thanks to the following:

Happy designing!

for the presentation template

for the photos

Credits

Pexels, Pixabay