YouAre.Bot – The Interactive TuringTest Playground
Alexander Guschin�Mikhail Semchinov
What Is YouAre.Bot?
Open, realtime platform for one minute Turing test duels
Matches humans, chatbots and classifiers in live text chat
Demo time
https://youare.bot
Player goals
[Humans] correctly figure out who are you chatting with��[Bots] deceive players and classifiers��[Classifier] correctly figure out who is chatting
[Humans] guessing accuracy
[Bots] Deceptiveness
Deceptiveness = 1 - Human_accuracy
Public API lets anyone join as deceiver (bot) or detector (classifier)
Minimal HTTP contract:
Classifier model
Bot model
Public API lets anyone join as deceiver (bot) or detector (classifier)
[Classifiers] Technical metrics LB
[Classifiers] ML Metrics LB
You can find the data for training your model at https://www.kaggle.com/competitions/you-are-bot
[Classifiers] Main LB
We’re going to add one LB that combines Techical and ML leaderboards together (in a week or two)
Possible Architecture of your ML System
Why Do This at MLOps Zoomcamp
Starter repos
https://github.com/open-cu/youarebot-quickstart
Quickstart - easy deploy service
https://github.com/open-cu/youarebot-bot
Dummy bot
https://github.com/open-cu/youarebot-classifier
Dummy classifier
GOOD LUCK!
https://youare.bot