1 of 9

ASL AI

Gigabyte Gang (Team 8)

Nicole Hu, Shreya Perumalla

Madhumita Narayan, Celina Anwar

2 of 9

Problem + Track

Thought Process:

  • Tech-based solutions for people with disabilities.

  • Inspired by LING 250!

  • What if we flipped the switch?

  • Individuals support the hard of hearing community.

Issue Being Addressed:

Increasing accessibility to ASL education and removing barriers to learn.

3 of 9

Our Mission

-> Support and empower the hard of hearing community.

-> Foster an inclusive ASL learning environment.

-> Bridge the gap between both communities through resources.

4 of 9

Features - ASL AI

-> ASL Detection

-> Text to ASL

-> Resources

Runtime: https://asl-ai.streamlit.app/

5 of 9

Example Testing

6 of 9

Tech Stack

IDE: VSCode

Version Control: GitHub

Backend: Python

API for model: Roboflow

Frontend/Deployment: Streamlit

A special thanks to our mentor, Ayush!

7 of 9

Reflection

Bugs:

  • Finding a model
  • Installing necessary components
  • Customize style frontend

Successes:

  • Incorporating roboflow API
  • Learned how to use Streamlit
  • Creating a website

8 of 9

Longevity/Next Steps

  • Enhance model accuracy, create our own
  • Transform ASL Learn tool to become more interactive
    1. Add flashcard capability
    2. Accuracy tracking for personalized study sessions
  • Add video-to-text feature allowing users get real time translations

9 of 9