CS 69/169 Wearable Computing
Sensors embedded in phones and wearables are driving innovation in many new areas of computing, including, mobile health, quantified-self, and gaming. We will study advances in wearable computing with emphasis on mobile sensing applications. We will discuss the latest technical papers in this emerging field, program Moto 360 Android watches, mine and analyze sensor streams, and work on group projects.
Kudos: The programming assignments and the notes for this class are adapted from Deepak Ganesan’s class on Mobile Health Sensing and Monitoring. I would like to express my thanks to Deepak for so openly sharing his material. Thank you Deepak!
We had some totally amazing wearable projects. We have two winners for best project:
Location: 108 Kemeny.
Time: Monday 3-4.50 pm, Thursday 4-5.50 pm
Seminar leader: Andrew T. Campbell
Office hours: Monday 5-6 pm, Friday 5-6 pm
Unofficial TA: Rui Wang
We are using Piazza
Reading and presenting papers: 20%
Programming assignments: 40%
Group project: 30%
Participation in discussion in class: 10%
We will implement the following apps on the Android Wear. Please submit your labN.zip (N=1-4) to Rui.Wang.GR@dartmouth.edu
There will be 4 labs:
Lab 1: Step Counter (Due Tuesday Jan 19, 11.59 pm)
Lab 2: Activity Classifier (Due Thursday Jan 28, 11.59 pm) -- please see notes in week 4
Lab 3: Stress Meter (Due Friday Feb 5, 11.59 pm) - you goal is an watch version of StressMeter
Lab 4: Speech Detection (Due Tuesday Feb 16, 11.59 pm) -- please see notes in week 6
No more labs, now we focus on wearable projects;
Lane, Nicholas D., et al. "A survey of mobile phone sensing." Communications Magazine, IEEE 48.9 (2010): 140-150.
Monday: Rui Wang, Fanglin Chen, Zhenyu Chen, Tianxing Li, Gabriella Harari, Stefanie Tignor, Xia Zhou, Dror Ben-Zeev, and Andrew T. Campbell. "StudentLife: Assessing Mental Health, Academic Performance and Behavioral Trends of College Students using Smartphones." In Proceedings of the ACM Conference on Ubiquitous Computing. 2014. (Presenter: Andrew)
Thursday: Rui Wang, Gabriella Harari, Peilin Hao, Xia Zhou, and Andrew T. Campbell. "SmartGPA: How Smartphones Can Assess and Predict Academic Performance of College Students." To be presented at ACM Conference on Ubiquitous Computing (UbiComp 2015), Osaka, Japan from Sep. 7-11, 2015 (Presenter: Rui)
Assignment: set up the Moto 360s watches, run Hello World.
Please read this: Keshav, S. (2007). How to read a paper. ACM SIGCOMM Computer Communication Review, 37(3), 83-84.
And check out How to give a good presentation
Monday: Mark Weiser. The Computer for the 21st Century, Scientific American, September 1991, pp. 94-104. (Presenters: Varun and Rawan)
Gregory Abowd, What Next, Ubicomp? Celebrating an Intellectual Disappearing Act.. Proc. UbiComp 2012. (Presenters: Michael and Naofumi)
Thursday: report on some cool app you found on the phone, something you have written for Android wear, discuss the assignment, brainstorm projects.
Starner, Thad. "The challenges of wearable computing: Part 2." IEEE Micro 4 (2001): 54-67.
Monday: The pitch. Each student gets 2 minutes and 2 slides to pitch an Android wear project.
Thursday: Gruenerbl, Agnes, et al. "Smart-watch life saver: Smart-watch interactive-feedback system for improving bystander cpr." Proceedings of the 2015 ACM International Symposium on Wearable Computers. ACM, 2015. (Presenters: Tianlong; and Ayan)
Lyons, Kent. "What can a dumb watch teach a smartwatch?: informing the design of smartwatches." Proceedings of the 2015 ACM International Symposium on Wearable Computers. ACM, 2015. (Presenters: Rui Chen and Haider)
Here are some notes associated with the activity recognition assignment.
Monday: Professor Xing-Dong Yang will give a talk on his work on design of wearables. The title of his talk is: “Towards wearable Interaction that go beyond the touchscreen”
Tuesday: CS Colloquium special event -- not to be missed by this class: “Leveraging Wearables and the Internet of Things for Learning & Task Performance”, Tovi Grossman (Autodesk Research)
Thursday: The two papers below were suggested by Professor Yang.
Rekimoto, Jun. "Gesturewrist and gesturepad: Unobtrusive wearable interaction devices." Wearable Computers, 2001. Proceedings. Fifth International Symposium on. IEEE, 2001. (Presenters: Asad and Feng).
Laput, Gierad, et al. "EM-Sense: Touch Recognition of Uninstrumented, Electrical and Electromechanical Objects." Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM, 2015. (Presenters: Ruizhen and Vishal Gaurav).
Due Thursday: Webpage for project. Include, project name, team, ½ dozen slides on the project idea, MVC and anything else that helps to flush it out.
Monday: Each group will demo their StressMeter solution -- have a single slide. Note, we will only have class between 3-4.10 PM. Then we will head to the departmental colloquium for an interesting and relevant talk on applied machine learning. See Sandra email for the announcement. Starts 4.15 pm.
Note, the final assignment is out Monday. Please read these [notes], [slides], and the [assignment]. The basic idea is implementation of speech detection and visualization on the watch -- I do not know anyone that has done this before; so we will learn a lot.
Thursday: Weigel, Martin, et al. "iSkin: flexible, stretchable and visually customizable on-body touch sensors for mobile computing." Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2015. (Presenters: Naofumi and Rawan)
Cohn, Gabe, et al. "Humantenna: using the body as an antenna for real-time whole-body interaction." Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2012. (Presenters: Michael and Suleman)
Monday: Each group should give a 5-10 minute project update; including (a) final idea; (b) final team; (c) systems architecture diagram (MVC for example) of the main components; and (d) initial timeline and milestones.
Tuesday: last lab due.
Thursday: Lane, Nicholas D., et al. "Zoe: A cloudless dialog-enabled continuous sensing wearable exploiting heterogeneous computation." Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 2015. (Presenters: Varun and Vishal Gaurav)
Cornelius, Cory, et al. "A wearable system that knows who wears it."Proceedings of the 12th annual international conference on Mobile systems, applications, and services. ACM, 2014. (Presenters: Tianlong and Haider)
Project office hours: Andrew will have office hours M-Thurs 2-3 PM and Friday 3-4 PM for projects. But we will meet for all class periods collectively in the classroom.
Sign up for all show and tells -- here
Group project: 30%. I will weigh your project grade on effort and complexity of the app you are incrementally designing and developing during the project phase. Please but in huge effort and you will get a good grade. If your app is simple and can be completed with a week’s effort by the team you will get a poor grade. I want to give out good grades. Be energized. Get excited. Be proud of your app.
The project phase is quick. Two weeks. You have formed your teams. You have a webpage. You have initial concepts down. Those ideas will very likely changes during the next two weeks. Be prepared to be adaptive.
Monday: show_and_tell_1 (5%): Design focus: The design has to be complete. You need to present it to the class. Final MVC diagram. You also have to demonstrate incremental progress of your app implementation. You have to show working components during show and tell. It is all about showing technology. You have to discuss the current development and challenges you are trying to overcome before Thursday’s S&T.
Thursday: show_and_tell_2 (5%): Implementation focus: You have to demonstrate incremental progress in your app. You have to show working components during show and tell. You have to discuss the current development and challenges you are trying to overcome before next Monday.
Tuesday (3-5 PM): show_and_tell_3 (5%) Implementation focus: You have to demonstrate incremental progress in your app. You have to show working components during show and tell. You have to discuss the current development and challenges you are trying to overcome by Thursday.
Thursday (4-6 PM): show_and_tell_4 (5%) Integration and user testing focus: You are coming to the end game. Is the client and server side complete? If the app ready to upload to play. All students in the class have to be able to download and use your app on demo day.
Monday March 7, 3-5.30 PM: demo day (10%)! It is here. You will make a short presentation: the idea, how it changed, lessons learnt. The class will download your app and score it via a survey. The tech has to work or you will get a poor grade for demo day.