Question

Responses/Discussion

What research questions and/or constructs do you wish you could study, but it isn’t feasible? (Especially consider bottlenecks or “sacred cows”)

• How do the types of gestures affect the quality of proof that students provide during game play?
• How could we study behaviors and interactions of multiple groups of K-12 students working in a makerspace?

What new possibilities are you imagining? What new challenges or ethics considerations emerge?

• How do you capture more subtle gestures?
• How do you combine / triangulate multiple data streams (audio, skeleton pose, spatial data, etc.)? - You mentioned the predictability of measures depend on data contexts. What does the training and analysis pipeline look like?
• How do you check for data reliability and validity?

Question

Responses/Discussion

What research questions and/or constructs do you wish you could study, but it isn’t feasible? (Especially consider bottlenecks or “sacred cows”)

Which sequences of student actions in virtual labs are associated with learning? Which inquiry strategies might these be associated with?

​

How do discussion processes around difficult topics differ in heterogeneous versus homogeneous groups?

What new possibilities are you imagining? What new challenges or ethics considerations emerge?

How to find the optimal balance between level of details and noise?

Question

Responses/Discussion

What research questions and/or constructs do you wish you could study, but it isn’t feasible? (Especially consider bottlenecks or “sacred cows”)

​

What new possibilities are you imagining? What new challenges or ethics considerations emerge?

​

Question

Responses/Discussion

What research questions and/or constructs do you wish you could study, but it isn’t feasible? (Especially consider bottlenecks or “sacred cows”)

• Constructs in audio recordings of interviews (teachers/students) can we analyze context?
• Can we match higher level constructs (e.g, identity) to patterns of participation in the classroom (that are easy for computers to detect, but hard for humans to see)?

What new possibilities are you imagining? What new challenges or ethics considerations emerge?

• If you’re looking for something specific in a large data corpus, sort through “high-level” patterns (working individually / together; mapping relative positions of students) for later human analysis.
• Embodied learning tied to spatial positioning (ex. Walking geometry)

Question

Responses/Discussion

What research questions and/or constructs do you wish you could study, but it isn’t feasible? (Especially consider bottlenecks or “sacred cows”)

What are the different ways that teachers facilitate group work? How these ways impact student learning/conversations?

​

What new possibilities are you imagining? What new challenges or ethics considerations emerge?

How this software can shift analytic representation of teaching to feedback representation for teachers?

​

How can this software help identify turn taking in a way that identifies small group members roles in the conversation?

Question

Responses/Discussion

What research questions and/or constructs do you wish you could study, but it isn’t feasible? (Especially consider bottlenecks or “sacred cows”)

• Patterns of interruptions in people’s talk? How does that affect inclusion?
• When is a good timing for a teacher to intervene? Not to interrupt the flow of collaboration but scaffold the discussion in a productive way?
• Using gestures for scaffolding language learning?
• Syncing multiple data sources for master data set (chat data, audio, video data)

What new possibilities are you imagining? What new challenges or ethics considerations emerge?

• Ethics challenges of how to share findings about gestures when it’s a visual kind of data (protecting confidentiality)
• What if some students in a room don’t consent to use their video data

Question

Responses/Discussion

What research questions and/or constructs do you wish you could study, but it isn’t feasible? (Especially consider bottlenecks or “sacred cows”)

• Understand the discourse pattern and behavior pattern of students and the teacher from classroom video
• Understand objects/key phases from experiment video, and understand students’ thoughts and behaviors through their conversation
• Bottlenecks - Identify meaningful moments from one-hour-long videos for transcription
• Bottlenecks - Background noise, cross-talking between participants

What new possibilities are you imagining? What new challenges or ethics considerations emerge?

• Technology to capture behavioral pattern, especially in a group
• Easily train the computer to learn about identifying key phases in a video (e.g., phenomena showing in an experiment)

Question

Responses/Discussion

What research questions and/or constructs do you wish you could study, but it isn’t feasible? (Especially consider bottlenecks or “sacred cows”)

• Ayesha: Computer-based coding of Productive Disciplinary Engagement; human coders rely on a lot of contextual factors
• Reyhaneh: focused more on content of discussion; exploring individual contributions to discussions; emergent variations in learner-design approach? Explore students individual contributions in group work and how it impacts their design approach?
• Enrique: function and timing of gestures e.g. do students use metaphoric gesture when presenting their idea than narrating their observation. Gesture and linguistic repertoire.

What new possibilities are you imagining? What new challenges or ethics considerations emerge?

• Privacy/anonymity considerations when sharing data, even if participants have given consent for data collection and analyses.
• The politics of the body and the embodied cultural practices! How do algorithms recognize these as crucial? Facial expressions!
• Whose bodies are being recognized by the technology? Who is designing these technologies and with whose bodies in mind?
• Relationship between tools and militarization/policing?

Question

Responses/Discussion

What research questions and/or constructs do you wish you could study, but it isn’t feasible? (Especially consider bottlenecks or “sacred cows”)

Zikai Alex Wen (special education & computer science)

How to design intelligent tutoring systems that allow special education students learn independently by interacting with physical manipulatives?

-Bottleneck: AV data process algorithms are not aware of educational context.

​

Francis Castro (computing education)

Based on how learners talk about their strategies for solving (programming) problems, how do we teach strategies in ways that speak to the practices in their disciplines?

What new possibilities are you imagining? What new challenges or ethics considerations emerge?

Zikai Alex Wen (special education & computer science)

Teachers and students will use mixed reality devices (e.g., Oculus Quest (VR) or Microsoft Hololens (AR)) to help them teach/learn in multimodalities.

How do we process AV data from the mixed reality devices to provide intelligent tutoring for special education students?

​

Francis Castro (computing education)

(New for me) Stress detection while solving problems - what relationship does (detected) stress have with the programming process(es) learners are employing? (e.g. what do these relationships look like?)