1 of 7

TEAM100 - Polistack: Agenda

  1. Problem Description - Liam, 1 min
  2. Data Exploration - Liam, 2 min
  3. Data Pre-Processing and Representation - Arjun + Rishabh, 4 min
  4. Models Used - Arjun, 3 min
  5. Model Performance and Results - Christian, 3 min
  6. System Architecture / Demo - Rishabh, 10 min

2 of 7

1. Problem Description

Understanding what policies impact you and your community is difficult.

Polistack helps you discover policies that impact your life, and gives you tools to influence outcomes.

3 of 7

2. Data Exploration

  • Bills from Congress.gov
  • Sentiment from Twitter
  • Data is interesting, clean, complete.
  • Opens the door to more interesting application development.
  • MEAN: 2,292
  • STD_DEV: 5,351
  • MIN: 57
  • MAX: 37,856

Up next: Rishabh

4 of 7

3. Data Preprocessing & Representation

Project Overview:

  • Django project: congress.gov API, MongoDB storage.
  • 8000 bills, associated tweets.�

Data Handling:

  • Preprocessing ensures quality, analysis efficiency.
  • Clean, transform, prepare JSON data.

Efficient Retrieval:

  • Indexing accelerates search, retrieval.
  • Applied to bills, tweets for optimized queries.

MongoDB Advantage:

  • MongoDB for JSON, scalability.
  • Schema designed for performance.

User Engagement:

  • Intuitive data display on frontend.
  • Users explore bills, linked tweets seamlessly.

Query Optimization:

  • Handle extensive data with techniques.
  • Aggregation pipelines, optimized queries, caching.

Up next: Arjun

5 of 7

4. Models Used

  • Native text indexing
  • B-Tree
  • Case folding
  • Tokenization
  • Language-specific stemming
  • Language-specific stop word removal
  • Weighting fields
  • Document scoring
    • ​

​

Up next: Christian

6 of 7

5. Model Performance and Results

​

Discounted Cumulative Gain

  • Starting Small
  • Showcase Queries on www.polistack.com

​

  • List of Found Stop Words:
    • Act
    • Department
    • Infrastructure
    • Defense

​

Up next: Rishabh

7 of 7

6. System Architecture / Demo

Backend:

  • Django
  • Django Debug Toolbar
  • Requests
  • PyMongo
  • Gunicorn
  • MongoDB

Frontend:

  • jQuery
  • JavaScript
  • HTML
  • CSS

UI Framework:

  • Django Bootstrap 5

Deployment:

  • Vercel (Used for deploying the Django app)
  • GitHub