Eyebot x Tufts
04/30/2025
Final Presentation
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
FINAL PRESENTATION
Picture yourself behind the frames of a first time Eyebot user
04/30/2025
SENIOR HFE CAPSTONE PROJECT
FINAL PRESENTATION
You make it past the first letter test without any problems,
04/30/2025
Then you have to take your glasses off,
SENIOR HFE CAPSTONE PROJECT
FINAL PRESENTATION
–leaving you vulnerable and confused.
04/30/2025
To figure out what is happening, you have to lean in to read instructions, adding extra strain.
SENIOR HFE CAPSTONE PROJECT
Problem Statement
People struggle with the current Eyebot kiosk because the guidance is different from what an eye doctor would provide, and aren’t able to complete the test.
We want to
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Human Factors Opportunity
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Users could be supported with non-invasive, multimodal guidance.
Hypothesis
If we add sound and light guidance to the Eyebot eye scan test,
Users will have faster
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
The Process
Research
Prototyping & Testing
Findings
FINAL PRESENTATION
04/30/2025
Initial Ideation
Recommendations
SENIOR HFE CAPSTONE PROJECT
FINAL PRESENTATION
Research:
Understanding the problem space
04/30/2025
SENIOR HFE CAPSTONE PROJECT
04/30/2025jkui,ol;’/[]/
�
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Task Analysis
Self-ethnography
Background Research
Competitive Analysis
Interviews
Key Insights
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
It is hard and disorienting to do things without glasses.
Eye exams are complicated!
A health kiosk
shouldn’t be invasive.
FINAL PRESENTATION
Ideating:
How might we incorporate sound and light communication?
04/30/2025
SENIOR HFE CAPSTONE PROJECT
Where to Make Changes
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
We identified areas of opportunity based on our task analysis and feedback from Riley on multimodal communication
Adding Sound and Light
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Pairing with segmented lights
Testing potential sounds
FINAL PRESENTATION
Testing Iterations:
How do we design a test to investigate our hypothesis?
04/30/2025
SENIOR HFE CAPSTONE PROJECT
Prototyping
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
At a Glance
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
| Light and Sound | Physical | Methods | Interface |
V1 n=7 | 2 different sound combos: 14/100 and 2/7, same lights | Top screen visible, angles and distance between screens not accurate. | Each participant completes flow 4 times in a randomized order, notified of forced errors. | Original Figma with tutorial videos and color. |
V2 n=28 | 14 for error, 100 for verification, and 2 for test complete, same lights | Top screen set back behind clear window, measurements corrected | Each participant goes through flow once: either with control or light/sound, not notified of forced errors. | Grayscale Figma with pre-test questions, removed arrows. |
Light and Sound
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
| Light and Sound |
V1 n=7 | 2 different sound combos: 14/1 and 2/7, same lights |
V2 n=28 | 14 for error, 1 for verification, and 2 for test complete, same lights |
Sound 1:
Sound 7:
Sound 14:
Sound 2:
Verification
Error
Physical
Making a higher fidelity prototype was necessary to get accurate results
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
| Physical | Methods | Interface |
V1 n=7 | Top screen visible, angles and distance between screens not accurate. | Each participant completes flow 4 times in a randomized order, notified of forced errors. | Original Figma with tutorial videos and color. |
V2 n=28 | Top screen set back behind clear window, measurements corrected | Each participant goes through flow once: either with control or light/sound, not notified of forced errors. | Grayscale Figma with pre-test questions, removed arrows. |
Testing Methods
| Methods | Methods | Interface |
V1 n=7 | Each participant completes flow 4 times in a randomized order, notified of forced errors. | Each participant completes flow 4 times in a randomized order, notified of forced errors. | Original Figma with tutorial videos and color. |
V2 n=28 | Each participant goes through flow once: either with control or light/sound, not notified of forced errors. | Each participant goes through flow once: either with control or light/sound, not notified of forced errors. | Grayscale Figma with pre-test questions, removed arrows. |
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Avoided repeated exposure which increased perceived usability
Interface
Found ways to isolate the function of light and sound
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
| Interface | Methods | Interface |
V1 n=7 | Original Figma with tutorial videos and color. | Each participant completes flow 4 times in a randomized order, notified of forced errors. | Original Figma with tutorial videos and color. |
V2 n=28 | Grayscale Figma with pre-test questions, removed arrows. | Each participant goes through flow once: either with control or light/sound, not notified of forced errors. | Grayscale Figma with pre-test questions, removed arrows. |
FINAL PRESENTATION
Returning to the eye scan after taking off your glasses,
04/30/2025
At this point, you are vulnerable and confused.
SENIOR HFE CAPSTONE PROJECT
FINAL PRESENTATION
Luckily, Eyebot is here to support you along every step of the way.
04/30/2025
We will now do a demo of a multimodal Eyebot kiosk!
Reading doesn’t have to be the only way to figure out what to do.
SENIOR HFE CAPSTONE PROJECT
Lights
FINAL PRESENTATION
04/30/2025
SENIOR HFE CAPSTONE PROJECT
Split by groups of six LEDs
Sounds
FINAL PRESENTATION
04/30/2025
SENIOR HFE CAPSTONE PROJECT
Screens
FINAL PRESENTATION
Lower Fidelity Screens
04/30/2025
SENIOR HFE CAPSTONE PROJECT
Hardware
FINAL PRESENTATION
04/30/2025
SENIOR HFE CAPSTONE PROJECT
Mimicking Hidden Scanner and Screen
FINAL PRESENTATION
Metrics:
What did we actually test?
04/30/2025
SENIOR HFE CAPSTONE PROJECT
Our version of Eyebot
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Blue changing to green to communicate the step was completed
Pulsing lights to indicate action needed
Verification noise plays at the end to signify moving on
Testing Metric A
Prompted action reaction time
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Metric A: Time from prompt (Place Glasses Here) to state (Glasses in, Hands off)
Light and sound condition
Testing Metric A
Prompted action reaction time
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Metric A: Time from prompt (Place Glasses Here) to state (Glasses in, Hands off)
Control condition
Our version of Eyebot
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Blue to signify “look here,” a neutral color with a health focus
Lights segmented to surround the screen to focus on
Testing Metrics
Screen-to-screen reaction time
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Metric B: Time from prompt (Look at top screen) to state (Stabilized head, Constantly looking)
Light and sound condition
Testing Metric B
Screen-to-screen reaction time
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Metric B: Time from prompt (Look at top screen) to state (Stabilized head, Constantly looking)
Control condition
Our version of Eyebot
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Red to indicate an error, something went wrong in the surrounded section
Lights segmented by screen, communicating different things in each section
Blue to signify “look here,” a neutral color with a health focus
Error noise would play to alert people
Testing Metric C
Error recovery time
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Metric C: Time from prompt (Error Message) to state (Looking down at the bottom screen)
Light and sound condition
Testing Metric C
Error recovery time
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Metric C: Time from prompt (Error Message) to state (Looking down at the bottom screen)
Control condition
Our version of Eyebot
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Red to indicate an error, something went wrong in the surrounded section
Lights segmented to surround the screen to focus on
Error noise would play to alert people
Testing Metric D
Error recovery time
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Metric D: Time from prompt (Error Message) to state (Looking down at the bottom screen)
Light and sound condition
Testing Metric D
Error recovery time
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Metric D: Time from prompt (Error Message) to state (Looking down at the bottom screen)
Control condition
Our version of Eyebot
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Green to indicate complete
Lights segmented to surround the screen where the step was completed
Verification noise plays to signify moving on
Testing Metrics
Screen-to-screen reaction time
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Metric E: Time from prompt (Scan Done) to state (Looking down at the bottom screen)
Light and sound condition
Testing Metrics
Screen-to-screen reaction time
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Metric E: Time from prompt (Scan Done) to state (Looking down at the bottom screen)
Control condition
FINAL PRESENTATION
Testing Results: Did our changes impact the user experience?
04/30/2025
SENIOR HFE CAPSTONE PROJECT
Participant Overview
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
33
5
67.7%
total number of version 2 testing participants
of participants wear glasses or contacts regularly
Non-Native English Speakers
[-4.25, +7]
Range of user prescriptions
60.6%
Number of participants aged 21-22
Findings
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Majority of users found the instructions easy to understand.
“Straightforward and clearly worded!”
“I knew what to do after I got that error- it was clear”
“I wondered what the error was, after reading it, it became obvious what’s next”
“It felt intuitive”
Findings
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Users felt uncertain when switching their gaze and wanted more communication.
“I wish there was an arrow down like the arrow up”
"Whoops you stopped looking - it would've helped to tell me how long"
“You could add ‘don't look away until a check mark appears’"
“counterintuitive for having more text and instructions after looking up”
Findings
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Users thought the light and sound choices were intuitive, but…
“one was positive, sound was not stressful or jarring”
"(Light was) good indicator of when to look down"
“when something happens- I'm used to that with phones”
“good chime, bah nah when something bad happened- it’s universal”
Findings
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
…most users tended not to notice the lights or sounds.
“I didn’t see light when everything was going fine, but I noticed when it changed color to red or green”
“I didn’t notice (sound)- that means it was good- wasn't distracting, but good at guiding you”
“I didn't notice at all- except red (?) when I had done something wrong”
“I noticed they (lights) were on but I didn't notice the purpose of them”
Findings
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
No statistically significant differences when comparing the control group to the light/sound groups during glasses prompt, errors, or scan finished prompt.
For Metric B (time in seconds from “look up” prompt to constantly looking at top screen), Wilcoxon Rank-Sum test returned with p-value = 0.01628.
Light design aided users when switching between the bottom to the top screen.
Notable: Color-Blind Participants
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
1 Birch J. Worldwide prevalence of red-green color deficiency. J Opt Soc Am A Opt Image Sci Vis. 2012 Mar 1;29(3):313-20. doi: 10.1364/JOSAA.29.000313. PMID: 22472762.
Recommendations
Multimodal Feedback
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Verification:
Error:
Test Complete:
Recommendations
Clarify User Instructions:
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Recommendations
Revised Onboarding:
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Recommendations
Amount of Information:
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Future Directions
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Implement multimodal options in current Eyebot locations - gain insights on a more diverse user group.
Test different “families” of sounds - is one more attention-grabbing?
Test different decibels of sounds – what is the optimal volume in a mall?
More metrics with accurate measurements- look away errors, time to look up, etc.
FINAL PRESENTATION
Thanks! Questions?
04/30/2025
SENIOR HFE CAPSTONE PROJECT
Appendix A:
Research
SENIOR HFE CAPSTONE PROJECT
Self-Ethnography Initial Impressions
SENIOR HFE CAPSTONE PROJECT
(Working) Task Analysis
SENIOR HFE CAPSTONE PROJECT
(Working) Task Analysis
SENIOR HFE CAPSTONE PROJECT
(Working) Task Analysis
SENIOR HFE CAPSTONE PROJECT
(Working) Task Analysis
SENIOR HFE CAPSTONE PROJECT
(Working) Task Analysis
SENIOR HFE CAPSTONE PROJECT
(Working) Task Analysis
SENIOR HFE CAPSTONE PROJECT
(Working) Task Analysis
SENIOR HFE CAPSTONE PROJECT
Interview Notes
SENIOR HFE CAPSTONE PROJECT
Interview Notes
SENIOR HFE CAPSTONE PROJECT
Takeaway #1: Understanding and Awareness of Procedures
SENIOR HFE CAPSTONE PROJECT
Takeaway #2: Result Delivery Preferences
SENIOR HFE CAPSTONE PROJECT
Takeaway #3: Attitudes Toward Automated/Kiosk-Based Eye Exams
SENIOR HFE CAPSTONE PROJECT
Appendix B:
Ideation
SENIOR HFE CAPSTONE PROJECT
User Flow Improvement Suggestions
SENIOR HFE CAPSTONE PROJECT
User Flow Improvement Suggestions
SENIOR HFE CAPSTONE PROJECT
User Flow Improvement Suggestions
SENIOR HFE CAPSTONE PROJECT
Demonstration
03/11/25
RESEARCH SYNTHESIS
SENIOR HFE CAPSTONE PROJECT
Opportunity Area | Reasoning |
Demonstration of light and sound cues (2.b.a) | User may feel pressed for time and want to skip the video immediately leading to a misunderstanding in the steps. User may feel relieved that there’s instruction in a different form instead of text. �Users may feel fatigued and be distracted during the video due to its longer format.��Users may be surprised by sounds or lights if not previously introduced. |
Progress Communication
03/11/25
RESEARCH SYNTHESIS
SENIOR HFE CAPSTONE PROJECT
Opportunity Area | Reasoning |
During eye scan (2.b.h) | Users may feel confused about how long they need to stare at the hot air balloon. ��Users may want to know the current status of the scan. User may look away before the process has concluded. |
Progress Communication
03/11/25
RESEARCH SYNTHESIS
SENIOR HFE CAPSTONE PROJECT
Top Screen
Top Screen
Digital LED progress bar
Hardware LED progress bar
Verification
03/11/25
RESEARCH SYNTHESIS
SENIOR HFE CAPSTONE PROJECT
Opportunity Area | Reasoning |
When user adjusts location of feet to line (assuming line stickers still being used) (2.b.c) | There are multiple ways to be misaligned (too close, too far, leaning). |
When glasses are placed on scanner (2.b.e.a) | Users may be prompted to restart due to a failed scan, leading to frustration. |
When machine is done adjusting (up and down) (2.b.f.c) | Calibration is confusing due to user and machine both responding at the same time. |
After auto-refractor/ scanning process (2.b.i) | Glasses users have limited perception without their glasses — they may feel vulnerable and confused. Users may be focused only on the top screen. |
Verification
03/11/25
RESEARCH SYNTHESIS
SENIOR HFE CAPSTONE PROJECT
Potential Sounds
Sound 7
Sound 8
Sound 9
Sound 1
Sound 2
Sound 3
Sound 4
Sound 5
Sound 6
Verification
03/11/25
RESEARCH SYNTHESIS
SENIOR HFE CAPSTONE PROJECT
Potential Visual
Text specific to use step- actionable instructions
Glasses Positioning
03/11/25
RESEARCH SYNTHESIS
SENIOR HFE CAPSTONE PROJECT
Opportunity Area | Reasoning |
Placing glasses into scanner (2.b.e.a) | There are many ways to misalign glasses (placed upside down, placed in the wrong area, placed with dirty lenses). |
Taking glasses out of scanner (2.b.j) | User may not realize they can pick up their glasses now. Users with limited vision may struggle to find their glasses. |
Glasses Positioning
03/11/25
RESEARCH SYNTHESIS
SENIOR HFE CAPSTONE PROJECT
Lights around glasses slot pulsing to indicate region.
Possible change of color to denote cleaning needed.
User Positioning
03/11/25
RESEARCH SYNTHESIS
SENIOR HFE CAPSTONE PROJECT
Opportunity Area | Reasoning |
When user adjusts location of feet to line (assuming line stickers still being used) (2.b.c) | There are multiple ways to be misaligned (too close, too far, leaning). Users may want real-time guidance to reduce number of errors due to body or head misalignment. |
When user needs to look at top screen (2.b.f.a) | User may not know where to look or looks at bottom screen rather than top. |
When user focuses on balloon (2.b.g) | Same as above. |
User Positioning
03/11/25
RESEARCH SYNTHESIS
SENIOR HFE CAPSTONE PROJECT
Eye/head alignment
Hot/cold position indication
Differentiating screen to look at
Redirecting attention
Appendix C:
Testing & Results
SENIOR HFE CAPSTONE PROJECT
Testing Design
04/30/2025
FINAL PRESENTATION
SENIOR HFE CAPSTONE PROJECT
Sound Test (1-8).1
SENIOR HFE CAPSTONE PROJECT
Sound Test (9-16).1
SENIOR HFE CAPSTONE PROJECT
Sound Test (1-8).2
SENIOR HFE CAPSTONE PROJECT
Sound Test (9-16).2
SENIOR HFE CAPSTONE PROJECT
Sound Test (1-8).3
SENIOR HFE CAPSTONE PROJECT
Sound Test (9-16).3
SENIOR HFE CAPSTONE PROJECT
SENIOR HFE CAPSTONE PROJECT
Prototype Tests V2.1
SENIOR HFE CAPSTONE PROJECT
Prototype Tests V2.2
SENIOR HFE CAPSTONE PROJECT
Appendix D:
Statistical Analysis
SENIOR HFE CAPSTONE PROJECT
R Code
SENIOR HFE CAPSTONE PROJECT