1 of 35

Tuana Çelik

FOSDEM 2024

AI & ML Devroom

Using Haystack to Build Custom Functionality for LLM Applications

2 of 35

One day, I was bored…

FOSDEM 2024 Tuana Çelik

3 of 35

One day, I was bored…

👩🏼‍💻🤝🧑🏻‍💻

FOSDEM 2024 Tuana Çelik

4 of 35

One day, I was bored…

🤯

FOSDEM 2024 Tuana Çelik

5 of 35

One day, I was bored…

FOSDEM 2024 Tuana Çelik

6 of 35

One day, I was bored…

FOSDEM 2024 Tuana Çelik

7 of 35

  • Fully open-source framework built in Python for custom LLM applications

Haystack (2.0-Beta)

FOSDEM 2024 Tuana Çelik

8 of 35

  • Fully open-source framework built in Python for custom LLM applications
  • Provides tools that developers need to build state-of-the-art NLP systems

Haystack (2.0-Beta)

FOSDEM 2024 Tuana Çelik

9 of 35

  • Fully open-source framework built in Python for custom LLM applications
  • Provides tools that developers need to build state-of-the-art NLP systems
  • Building blocks: Pipelines & Components

Haystack (2.0-Beta)

FOSDEM 2024 Tuana Çelik

10 of 35

Pipeline (RAG)

FOSDEM 2024 Tuana Çelik

11 of 35

urls

Pipeline (indexing)

FOSDEM 2024 Tuana Çelik

12 of 35

Because of ✨Components✨

FOSDEM 2024 Tuana Çelik

13 of 35

Because of ✨Components✨

FOSDEM 2024 Tuana Çelik

14 of 35

Because of ✨Components✨

FOSDEM 2024 Tuana Çelik

15 of 35

  • A simple interface for the creation of custom components.
  • User defined number of inputs and outputs

Haystack (2.0-Beta): Custom Components

FOSDEM 2024 Tuana Çelik

16 of 35

  • A simple interface for the creation of custom components.
  • User defined number of inputs and outputs

Haystack (2.0-Beta): Custom Components

FOSDEM 2024 Tuana Çelik

17 of 35

Haystack (2.0-Beta): Custom Components

FOSDEM 2024 Tuana Çelik

18 of 35

  • Build a custom component that takes top_k �and returns the contents and URLs �of these articles

The Hacker News Fetcher

FOSDEM 2024 Tuana Çelik

19 of 35

The Hacker News Fetcher

FOSDEM 2024 Tuana Çelik

20 of 35

The TL;DR Pipeline

FOSDEM 2024 Tuana Çelik

21 of 35

The TL;DR Pipeline

FOSDEM 2024 Tuana Çelik

22 of 35

The Prompt Builder

FOSDEM 2024 Tuana Çelik

23 of 35

The Prompt Builder

FOSDEM 2024 Tuana Çelik

24 of 35

The Prompt Builder

FOSDEM 2024 Tuana Çelik

25 of 35

The Final Product

FOSDEM 2024 Tuana Çelik

26 of 35

Other (questionable) projects

FOSDEM 2024 Tuana Çelik

27 of 35

GitHub issues from meeting notes

FOSDEM 2024 Tuana Çelik

28 of 35

Validating the output

29 of 35

GitHub Issue Generator Pipeline

30 of 35

Custom Component: Output Validator

31 of 35

GitHub Issue Generator Pipeline

32 of 35

GitHub Issue Generator Pipeline

33 of 35

The TL;DR Pipeline

FOSDEM 2024 Tuana Çelik

34 of 35

The GitHub Issue Pipeline

FOSDEM 2024 Tuana Çelik

35 of 35

Resources

Thank you!

@Haystack_AI

@tuanacelik

/in/tuanacelik