1 of 10

1

Will your bot be the ultimate survivor?

The Resiliency of Intelligent Automation Systems Challenge

2 of 10

The resiliency of automation system challenge

  • Held under IJCAI 23 competition and challenges
    • The competition started on April 2, 2023
    • The competition ended on July 2, 2023

​

  • The Goal
    • Participants were asked to create an AI bot that completes 4 web automation tasks
    • The AI bot's resiliency was tested by manipulating the UI

​

  • Seven teams registered for the challenge
  • The best result achieved by Eden Shuker from Bar Ilan University
    • She managed to solve 2 out of 4 tasks by using semantic similarity techniques

​

​

​

2

3 of 10

The tasks

3

4 of 10

The excel spreadsheet with users info

4

5 of 10

5

6 of 10

6

7 of 10

7

8 of 10

8

9 of 10

Conclusion

  • Trust and resiliency of digital automation systems are super important
  • Building such systems is hard even for developers
  • The first challenge focused on building automation that is resilient to UI changes
  • The next challenge (IJCAI24?) might focus on:
    • No code resiliency
    • Resiliency in combining multiple automation?
    • Resiliency in NL content for LLMs
    • Decisions: When should the bot come back to the user and not try to self-heal?

​

​

​

9

10 of 10

Thanks

10