1 of 15

HIP Expo

May 2021

Century High School, Senior

Ben Hroblak

Sykesville Campus 2020-2021 year

1

2 of 15

HIP Team

2

Shannon Lilly

Electrical Engineer

​

Ben Hroblak, Senior

Century High School

​

Mark Ingle

Mechanical Engineer

​

University of Maryland College Park

Mechanical Engineering

​

Honors Program (UH)

3 of 15

Project Description / Background

  • Description
    • Design and build a smart mirror that can collect and display biometric data through a user-friendly interface for purposes of healthcare in hospitals or nursing homes.
  • Background
    • The pandemic has led to new precautions doctors must take while effectively doing their job. A device that can reduce contact in a hospital setting would greatly benefit the patients and healthcare workers.
  • Purpose
    • Created in order to reduce the number of tasks a medical professional must complete when caring for a patient. The smart mirror can perform simple tasks such as taking temperature in order to reduce exposure and save time.

​

​

​

3

4 of 15

Project Requirements

  • The Raspberry Pi, monitor, and sensors must fit inside the frame behind the mirror
  • The mirror interface must be comprehensive and easy to use
  • The mirror must be able to collect and track biometric data such as body temperature and glucose levels
  • The display must show the values on the screen
  • A frame must be constructed to house the electronics and securely hold the mirror
  • The smart mirror must be mounted at the correct height, so the sensors are accurate
  • Wi-Fi connection with Alexa Echo Device

4

5 of 15

Approach / Process

  • Researched methods of measuring and displaying biometric data
    • Body temperature, glucose levels, oxygen levels, heartbeat, etc.
    • Monitors, speakers, Alexa
  • Decided to use a 27” monitor and a Raspberry Pi for the main electronics
  • Ordered parts online
  • Test the basic functions of the sensors
    • Wrote a python script to read a person’s temperature
    • Tested the functionality of Alexa commands (turning the display off, changing pages)
  • Constructed a frame for the mirror and electronics
  • Added modules to connect the sensors to the Magic Mirror code
  • Utilized the notifications system to allow Alexa to control temperature sensor
  • Set up a website for continuous glucose monitoring (CGM)
  • Connected an existing notifications app for taking medications

​

​

​

5

6 of 15

Electronics Diagrams

6

Raspberry Pi

Speakers

Display

Sensors

Power

Image Processing Server

Notification API

Glucose Monitoring Website

Display

Temperature Sensor and camera

Raspberry Pi

Power splitter

Speaker

7 of 15

Features

  • Motion sensing camera
  • Temperature sensor
  • Image processing server
  • Capability to utilize more sensors
  • Single power cord for display and electronics

​

  • Wi-Fi capability for up-to-date information
  • Customizable layout depending on the situation
  • Alexa control for navigation and biometric readings
  • Notifications system for medications
  • Displayed data separated into three pages

​

7

�

8 of 15

Temperature Sensor Process

  • Temperature sensor values displayed on the screen using software modules and user commands
  • Process is identical for changing pages using Alexa commands

8

Command is given to an Amazon Echo Device

Command is processed and module alerts other modules

Command is sent to module over home Wi-Fi

Temperature module receive notification of command

Temperature module processes command

A timer begins to track how long the box is visible

Temperature module makes green box visible on display

A separate sensor module records and displays real-time values

9 of 15

Data Collection Sequence

Sequence is triggered through a notification sent by the Alexa module when the user says “Alexa, take my temperature”

9

10 of 15

Alexa Commands

  • Each action is listed as a device in the Alexa App
  • Alexa module can execute terminal commands
    • Useful for running temperature sensor C script
    • Enables the mirror to enter “sleep mode”
  • Alexa module communicates through a notification system

10

11 of 15

Challenges/Obstacles

11

  • Choosing sensors that we could integrate in a reasonable amount of time and stay within our budget
  • Finding a way to link the sensors we used to the Magic Mirror modules
  • Learning a new coding language (JavaScript)
  • Figuring out the notifications system between modules to display temperature
  • Information on full Alexa integration was vague and the lack of support for the microphone on Raspberry Pi was causing issues
  • Creating a box that shows the user where to position their head for an accurate body temperature reading

​

12 of 15

Learning Highlights / Conclusion

12

  • Expanded my knowledge of JavaScript, C, CSS, and Python
  • Learned how infrared temperature sensors work and how to control them
  • Learned the science behind how a one-way glass panel works
  • Learned more about the engineering design process
  • Adapted to working on the project completely from home
  • Learned how to use the Alexa Voice Service for creating a built-in Alexa device

​

13 of 15

Connection to Northrop Grumman

  • Applicable Technologies at Northrop Grumman
    • Sensors
    • Data Collection
    • Embedded processors
    • Software
    • Mechanical design
  • Future Project Ideas
    • Creating a network for use in a hospital
      • Monitoring multiple mirrors at once
      • Creating notifications/reminders for individual mirrors
    • Adding more sensors
      • Oxygen levels, heartrate, etc.
      • Facial recognition

​

13

14 of 15

Questions?

14

15 of 15

15