PixDiet
A personalised AI nutritionist in your pocket
🥕
🍓
🥦
2
WHO: Everybody needs nutrition advices
From people with chronic disease (obesity, renal failure…) to startupers running triathlon everybody can use Nutritional advices… Yet less than half of French people consult a dietician over their lifetime..
Matthieu
Medical condition:
Objectives:
Persona 1: Chronic disease patient
Julien
Medical condition:
Objectives:
Persona 2: Hard working startuper
Carla
Medical condition:
Objectives:
Persona 3: first time marathon runner
🧑🦰
🧑🦱
🧔♀️
💵
“it's too expensive”
“I am not really sick/ legitimate”
“Pre-made programs are too constraining”
❌
❌
Introducing PixDiet a Personalised AI nutritionist in your pocket
Realtime: replies directly
Multimodal: understands images and can classify food
Personalised: knows your meal history and med condition
Domain expert: trained on nutritionist expert knowledge.
How we built it ?
Pixtral 12b
The first ever finetune of Pixtral 12b !
PixDiet
food pic
items
dataset: 6k pairs of (image, items)
AI generated nutritionist comment
pasta, cheese
….
….
this pasta salad provides a good mix of carbs from the fusilli, fats from the cheese, and some vitamins from the rocket and sun-dried tomatoes. However, as a marathon runner, you might need more protein and fiber to support muscle recovery and sustained energy ……….
Step 2: Training
Step 1: Synthetic database creation
Step 3: Demo
🥕
🍓
🥦
Synthetic dataset creation, finetuning, gradio demo running fully on HuggingFace space
5
Appendix: Before/ After finetune (qualitative benchmark)
6
Appendix (links)