1 of 35

Tuana Çelik

FOSDEM 2024

AI & ML Devroom

Using Haystack to Build Custom Functionality for LLM Applications

2 of 35

One day, I was bored…

FOSDEM 2024 Tuana Çelik

​

3 of 35

One day, I was bored…

👩🏼‍💻🤝🧑🏻‍💻

FOSDEM 2024 Tuana Çelik

​

4 of 35

One day, I was bored…

🤯

FOSDEM 2024 Tuana Çelik

​

5 of 35

One day, I was bored…

Hugging Face Space

FOSDEM 2024 Tuana Çelik

​

6 of 35

One day, I was bored…

Hugging Face Space

FOSDEM 2024 Tuana Çelik

​

7 of 35

  • Fully open-source framework built in Python for custom LLM applications

Haystack (2.0-Beta)

FOSDEM 2024 Tuana Çelik

​

8 of 35

  • Fully open-source framework built in Python for custom LLM applications
  • Provides tools that developers need to build state-of-the-art NLP systems

Haystack (2.0-Beta)

FOSDEM 2024 Tuana Çelik

​

9 of 35

  • Fully open-source framework built in Python for custom LLM applications
  • Provides tools that developers need to build state-of-the-art NLP systems
  • Building blocks: Pipelines & Components

​

Haystack (2.0-Beta)

FOSDEM 2024 Tuana Çelik

​

10 of 35

Pipeline (RAG)

FOSDEM 2024 Tuana Çelik

​

11 of 35

urls

Pipeline (indexing)

FOSDEM 2024 Tuana Çelik

​

12 of 35

Because of ✨Components✨

FOSDEM 2024 Tuana Çelik

​

13 of 35

Because of ✨Components✨

FOSDEM 2024 Tuana Çelik

​

14 of 35

Because of ✨Components✨

FOSDEM 2024 Tuana Çelik

​

15 of 35

  • A simple interface for the creation of custom components.
  • User defined number of inputs and outputs

Haystack (2.0-Beta): Custom Components

FOSDEM 2024 Tuana Çelik

​

16 of 35

  • A simple interface for the creation of custom components.
  • User defined number of inputs and outputs

Haystack (2.0-Beta): Custom Components

FOSDEM 2024 Tuana Çelik

​

17 of 35

Haystack (2.0-Beta): Custom Components

FOSDEM 2024 Tuana Çelik

​

Integrations

18 of 35

  • Build a custom component that takes top_k �and returns the contents and URLs �of these articles

The Hacker News Fetcher

FOSDEM 2024 Tuana Çelik

​

Try it out

19 of 35

The Hacker News Fetcher

FOSDEM 2024 Tuana Çelik

​

Try it out

20 of 35

The TL;DR Pipeline

FOSDEM 2024 Tuana Çelik

​

21 of 35

The TL;DR Pipeline

FOSDEM 2024 Tuana Çelik

​

22 of 35

The Prompt Builder

FOSDEM 2024 Tuana Çelik

​

Try it out

23 of 35

The Prompt Builder

FOSDEM 2024 Tuana Çelik

​

Try it out

24 of 35

The Prompt Builder

FOSDEM 2024 Tuana Çelik

​

Try it out

25 of 35

The Final Product

Hugging Face Space

FOSDEM 2024 Tuana Çelik

​

26 of 35

Other (questionable) projects

FOSDEM 2024 Tuana Çelik

​

27 of 35

GitHub issues from meeting notes

FOSDEM 2024 Tuana Çelik

​

28 of 35

Validating the output

Tutorial 📓

29 of 35

GitHub Issue Generator Pipeline

30 of 35

Custom Component: Output Validator

31 of 35

GitHub Issue Generator Pipeline

32 of 35

GitHub Issue Generator Pipeline

33 of 35

The TL;DR Pipeline

FOSDEM 2024 Tuana Çelik

​

34 of 35

The GitHub Issue Pipeline

FOSDEM 2024 Tuana Çelik

​

35 of 35

Resources

Haystack 👇

Haystack 2.0 Docs 👇

Thank you!

@Haystack_AI

@tuanacelik

/in/tuanacelik