Welcome to day 4 of 6.S093!

How to ship almost anything with AI

Sundai Club Team

January, 2025

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Part 0: Hackers

Sundai Club Team

January, 2025

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

• Get together every sunday
• Build AI MVP apps
• Launch them into users’ hands by end of day

Our Mission

​

1.⁠ ⁠⁠⁠Grow the best hackers

• learn to build fast with AI, together
• ship based apps that gain $$$

​

​

​

​

2.⁠ Spread hacker mindset

• teach the skills we learn at MIT and beyond

​

​

​

​

​

​

​

What is a hacker?

​

def hacker_vs_engineer():

​

​

• → fast
• → uses structure
• → flexible, prototypes

• → meticulous
• → builds structure
• → stable, robust
• ​

• /ˌenjəˈnir/

• /ˈhakər/

What does hacker look like?

What does a sundai hacker look like?

What does a sundai hacker do?

2. Our Culture

def sunday():

​

/ˈsənˌdā,ˈsəndē/

2. Our Culture

def sunday():

​

/ˈsənˌdā,ˈsəndē/

2. Our Culture

• 1. rest day
• ​

def sunday():

​

/ˈsənˌdā,ˈsəndē/

2. Our Culture

• 1. rest day
• 2. devotion day

def examples(‘sunday’):

​

​

2. Our Culture

def examples(‘sunday’):

​

​

• → take time for yourself
• ​

• 1. rest

​

​

​

​

​

​

​

​

• ​

2. Our Culture

def examples(‘sunday’):

​

​

• → take time for yourself
• → meet people you love
• ​

• 1. rest

​

​

​

​

​

​

​

​

• ​

2. Our Culture

def examples(‘sunday’):

​

​

• → take time for yourself
• → meet people you love
• → frolic, have fun
• ​

• 1. rest

​

​

​

​

​

​

​

​

• ​

2. Our Culture

def examples(‘sunday’):

​

​

• → take time for yourself
• → meet people you love
• → frolic, have fun
• → take your mind away
• from ‘structured’ work
• ​

• 1. rest

​

​

​

​

​

​

​

​

• ​

2. Our Culture

def examples(‘sunday’):

​

​

• → take time for yourself
• → meet people you love
• → frolic, have fun
• → take your mind away
• from ‘structured’ work
• → experiment
• ​

• 1. rest

​

​

​

​

​

​

​

​

• ​

2. Our Culture

def examples(‘sunday’):

​

​

• 1. rest

​

​

​

​

​

​

​

​

• ​

• → take time for yourself
• → meet people you love
• → frolic, have fun
• → take your mind away
• from ‘structured’ work
• → experiment
• → do something different, learn
• ​
• ​

2. Our Culture

def examples(‘sunday’):

​

​

• 1. rest

​

​

​

​

​

​

​

​

• ​

• → take time for yourself
• → meet people you love
• → frolic, have fun
• → take your mind away
• from ‘structured’ work
• → experiment
• → do something different, learn
• → be a kid / with your kids
• ​

2. Our Culture

def examples(‘sunday’):

​

​

• → dedicate quality time to those you love
• [kids, family, community]
• ​

• 1. rest

​

​

​

​

​

​

​

​

• 2. devote

• → take time for yourself
• → meet people you love
• → frolic, have fun
• → take your mind away
• from ‘structured’ work
• → experiment
• → do something different, learn
• → be a kid / with your kids
• ​

2. Our Culture

def examples(‘sunday’):

​

​

• 1. rest

​

​

​

​

​

​

​

​

• 2. devote

• → take time for yourself
• → meet people you love
• → frolic, have fun
• → take your mind away
• from ‘structured’ work
• → experiment
• → do something different, learn
• → be a kid / with your kids
• ​

2. Our Culture

• → dedicate quality time to those you love
• [kids, family, community]
• → dedicate time to your core beliefs
• ​
• ​

def examples(‘sunday’):

​

​

• 1. rest

​

​

​

​

​

​

​

​

• 2. devote

• → take time for yourself
• → meet people you love
• → frolic, have fun
• → take your mind away
• from ‘structured’ work
• → experiment
• → do something different, learn
• → be a kid / with your kids
• ​

2. Our Culture

• → dedicate quality time to those you love
• [kids, family, community]
• → dedicate time to your core beliefs
• → be at peace
• ​

def examples(‘sunday’):

​

​

• 1. rest

​

​

​

​

​

​

​

​

• 2. devote

• → take time for yourself
• → meet people you love
• → frolic, have fun
• → take your mind away
• from ‘structured’ work
• → experiment
• → do something different, learn
• → be a kid / with your kids
• ​

2. Our Culture

• → dedicate quality time to those you love
• [kids, family, community]
• → dedicate time to your core beliefs
• → be at peace
• ​

And now it’s time for…

Intros

Let’sssss goooooooo!

Part 0: Course logistics

Sundai Club Team

January, 2025

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Course structure

Mon

Mini-projects

Final Project

Tue

Wed

Thu

Fri

Mon

Sun

Front End

Back End

Final Project Pitches

AI systems

Final Project, Guardrails & Ethics

Payment Systems + Guest Lectures

4-163 !

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Course structure

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Course structure

Mon

Mini-projects

Final Project

Tue

Wed

Thu

Fri

Mon

Sun

Front End

Back End

Final Project Pitches

AI systems

Final Project, Guardrails & Ethics

Payment Systems + Guest Lectures

4-163 !

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Course structure

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Course structure

Mon

Mini-projects

Final Project

Tue

Wed

Thu

Fri

Mon

Sun

Front End

Back End

Final Project Pitches

AI systems

Final Project, Guardrails & Ethics

Payment Systems + Guest Lectures

4-163 !

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Sundai Hack

https://partiful.com/e/JkxAeydFv6FLQUoXQsHl

Mention that you are from the IAP class and tag the project that you’ve built!

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Course structure

Mon

Mini-projects

Final Project

Tue

Wed

Thu

Fri

Mon

Sun

Front End

Back End

Final Project Pitches

AI systems

Final Project, Guardrails & Ethics

Payment Systems + Guest Lectures

4-163 !

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Project requirements

• Some AI component
• LLM / Vision / Audio / Graphs …
• Simple and easy to use front-end
• Deployed
• (optional) fine-tuning
• (optional) backend / DB / storage
• (optional) user logins

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Final projects info

• Groups 2-3 ppl (solo is also ok)
• Display your project on

https://projects.iap.sundai.club/

• Present on Monday starting at 10am
• 5 min per team
• 2 min for questions
• Live demo
• Sign up for a slot here �https://tinyurl.com/2zew5rju

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Questions ?

​

Sundai Club Team

January, 2025

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Part 1: Web analytics

​

Sundai Club Team

January, 2025

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Why ?

Before

Today

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

How ?

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

What ?

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Data collection

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

However ..

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

However ..

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Anyways

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Anyways

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Anyways

!!!

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Part 2: LLM Guardrails

​

Sundai Club Team

January, 2025

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Guardrails: Why?

• LLMs are unpredictable by nature
• No deterministic behaviour
• Requires extensive prompt sanitization

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Guardrails: What’s the worst that can happen?

• Users hack your app
• Token overhaul
• Users stuck waiting and waiting and waiting…
• User data gets leaked…
• Your app randomly breaks

​

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Prompt injections

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Prompt injections

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Prompt injections

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Prompt injections

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Prompt injections: understanding special tokens

https://www.llama.com/docs/model-cards-and-prompt-formats/llama3_1/#-special-tokens-

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Prompt injections: understanding special tokens

https://www.llama.com/docs/model-cards-and-prompt-formats/llama3_1/#-special-tokens-

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Prompt injections

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Prompt injection game

https://gandalf.lakera.ai/do-not-tell-and-block

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Token overhaul

• You are the one paying for tokens
• Avoid input token overhaul
• Avoid output novels…

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Token overhaul

• You are the one paying for tokens
• Avoid input token overhaul
• Avoid output novels…

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Token overhaul

• You are the one paying for tokens
• Avoid input token overhaul
• Avoid output novels…

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Good UX: Timeouts - when app freezes

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Good UX: Rate limits - when app stops working

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Guardrails: frameworks

Querying the Web:

Exa.ai, Perplexity

​

Presentations:

Gamma

​

Unified APIs:

llangchain, litellm, openrouter

​

Finetuning LLMs:

unsloth.ai, modal

​

IDE:

Cursor, Windsurf (Codeium)

Replit

​

Graphical Dev:

Langflow, stackai,

flowise, diffy.ai

​

Prompt Dev:

Wordware

​

Agents:

Autogen, CrewAI,

LangGraph

Self!

​

GuardRails:

LLMGuard, Lakera

HiveAI, NSFW-detect (Replicate)

Local:

Ollama + Ollama WebUI

​

RAG databases:

Pinecone, ChromaDB, Weaviate

Pgvector (PostgreSQL)

​

RAG indexing:

Llangchain, Llamaindex

​

Small LLMs:

Gemma 2B,

Mistral 8B, Llama 8B

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Guardrails: Sundai Hack - AI wall

https://www.sundai.club/

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Guardrails: LLMGuard - simple

https://llm-guard.com/get_started/quickstart/

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Guardrails: LLMGuard - Multilayered

https://llm-guard.com/get_started/quickstart/

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Now a break! �See you at 11:35 am

Sundai Club Team

January, 2025

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club

Now lunch break! �See you at 1:45pm for the workshop

Sundai Club Team

January, 2025

Mini test for today's lecture.

Please fill in to get the attendance!��https://forms.gle/DmMEpJJqTnVj87g99

​

MIT 6.S093 How to ship almost anything with AI

iap.sundai.club

sundai_club