1 of 17

YouAre.Bot – The Interactive TuringTest Playground

​

​

​

Alexander Guschin�Mikhail Semchinov

2 of 17

What Is YouAre.Bot?

3 of 17

Open, realtime platform for one minute Turing test duels

4 of 17

Matches humans, chatbots and classifiers in live text chat

5 of 17

Demo time

https://youare.bot

6 of 17

Player goals

[Humans] correctly figure out who are you chatting with��[Bots] deceive players and classifiers��[Classifier] correctly figure out who is chatting

7 of 17

[Humans] guessing accuracy

[Bots] Deceptiveness

Deceptiveness = 1 - Human_accuracy

8 of 17

Public API lets anyone join as deceiver (bot) or detector (classifier)

9 of 17

Minimal HTTP contract:

Classifier model

Bot model

10 of 17

Public API lets anyone join as deceiver (bot) or detector (classifier)

11 of 17

[Classifiers] Technical metrics LB

12 of 17

[Classifiers] ML Metrics LB

You can find the data for training your model at https://www.kaggle.com/competitions/you-are-bot

13 of 17

[Classifiers] Main LB

We’re going to add one LB that combines Techical and ML leaderboards together (in a week or two)

14 of 17

Possible Architecture of your ML System

15 of 17

Why Do This at MLOps Zoomcamp

  • It’s a great practice for tools and technologies you are learning at MLOps Zoomcamp
  • It’s as close to a real ML production as an educational project could get :)
  • Publish your repo and include it in your resume — it’s a great way to showcase your skills and highlight your expertise

16 of 17

Starter repos

https://github.com/open-cu/youarebot-quickstart

Quickstart - easy deploy service

https://github.com/open-cu/youarebot-bot

Dummy bot

https://github.com/open-cu/youarebot-classifier

Dummy classifier

17 of 17

GOOD LUCK!

https://youare.bot