1 of 5

Janus Bot

Simple NLP+RL

Expanded presentation: here

2 of 5

Bot Overview: 2 stages

2. Messaging

1. Order Generation

Execute n rounds in a turn

3 of 5

Messaging

Board State

Received Messages

Previously Executed Moves

Encode Obs

Transformers, GNNs, etc.

Recipient of Message*

Send DAIDE orders

Send Random orders**

Output Action Probabilities

Observation Information

*Each agent performs this process once for each other agent in the game | **Maybe just a different set of believable orders

4 of 5

Concrete Example

Round 1: Messages

A

B

C

Random

DAIDE orders

True

DAIDE orders

Round 1: Compute and store orders

A

B

C

Orders

Orders

Orders

* A potential backstab

After n of these rounds, agents submit their final orders to the game

Round 2: Messages

A

B

C

Round 2: Compute and store orders

Orders

Orders

Orders

*

A

B

C

5 of 5

Expected Results

  • Bots will send true moves to allies and random moves to enemies

  • When backstabbing allies, bots will send orders to their allies that differ from their true orders

  • Bots which can communicate will be more performant