1 of 32

2 of 32

Welcome to HFES2020 Human–AI–Robot Teaming Technical Group (HART TG) Business Meeting!

1:05 pm–3 pm ET, Thursday, Oct 1, 2020

  • See chat for link to detailed agenda and the slides
  • TG introduction
  • Networking (breakout session #1)
  • TG planning and discussion (breakout session #2)

3 of 32

Housekeeping

  • Attendees
  • Turn mic OFF (unless speaking)
  • Turn camera ON (if possible)
    • Turn off if low-bandwidth / poor connection
  • Post questions to speakers on Chat like so:

QUESTION to @speaker name: Lorem ipsum dolor sit amet?

4 of 32

Opening Remarks

Nancy Cooke, Ph.D.

Past HFES president

Director of the Center for Human, AI, and Robot Teaming

Arizona State University

5 of 32

Introduction of HART TG

(2020–present)

Lixiao Huang, PhD., Arizona State University

TG Chair

6 of 32

HART TG Mission

The Human–AI–Robot Teaming (HART) TG strives to organize human factors and ergonomics (HF/E) researchers’ efforts in the state-of-art of Human–AI–Robot Teaming research and applications, collectively address the critical theoretical and practical challenges, and provide interdisciplinary solutions that enhance human factors research with advanced technology testbeds and analytics techniques. The HART TG also aims to use the strength of HF/E community to help AI/robotics researchers to advance their research development.

7 of 32

Scope of HART TG

Essential Components:

  1. Human user(s)
  2. Artificial intelligence and/or embodied robots
  3. Teaming: interdependency and joint goal(s)

*** Interdisciplinary research is a big plus

*** HART TG not competing with other TGs but just focused

*** Aiming to bridge Human Factors and AI/Robotics

*** Trying to create a sense of belonging for AI/Roboticists in HFES

8 of 32

HART TG Officers 2020-2021

Lixiao Huang, PhD

ASU

TG Chair

Eric Holder, PhD

ARL

TG Program Chair

Joe Lyons, PhD

AFRL

TG Program Chair Codesignate

Erin Chiou, PhD

ASU

TG Program Chair Codesignate

Tristan Endsley, PhD

Draper

TG Secretary and Treasurer

Ruikun Luo, PhD Candidate

UMich

TG Webmaster &

Newsletter Editor

9 of 32

TG Membership

  • Due: $5 per year
  • Benefits:
    • Networking
    • Collaborations on research, consulting, outreach, and practices
    • TG community forum access
    • TG officer election and TG development
    • HFES conference HART TG session chair and co-chair opportunities
    • HART TG paper reviewer opportunities
  • So far we have 47 paid members as of 10/1/2020

10 of 32

Join today with three steps

  1. Create an account at HFES.org
    • Option #1: Join with full HFES membership (additional benefits and fees) and HART TG
    • Option #2: Only join HART TG membership through “HFES Connect”
  2. Find the technical groups
  3. Select HART TG and pay $5

Check out our website for a step-by-step instruction on how to join HART TG on the new HFES website:

  • http://hfes-hart.weebly.com/membership.html

11 of 32

HART TG Communication

  • HART TG member forum on the HFES website (PRIMARY):
    • join the HART TG to gain access
  • TG email: hart.hfes@gmail.com
  • Officers emails on the TG website
  • Website: http://hfes-hart.weebly.com/
  • Twitter: @hart_tg_hfes

12 of 32

Breakout Session #1 Social Networking

  • 10 min
  • Name
  • Organization
  • Background
  • Topics (optional):
    • What is your favorite activity during COVID19?
    • What attracted you to HART TG?

13 of 32

HFES2020 HART TG Submissions

Eric Holder, PhD., Army Research Lab,

TG Program Chair

14 of 32

Overview

We hit the ground running!

  • In our first year and not being officially listed we still got:
    • 27 total submissions, 16 accepted (59%)
    • 9 lecture presentations
    • 5 posters
    • 2 panel discussions
    • We are looking to expand on that in 2021 as we build, grow and become more established

15 of 32

Topic Areas (current)

  • 2 Panel Sessions (Thursday, Oct 8, afternoon)
    • Human, AI, Robot Teaming and the future of work: barriers and opportunities for advancement
    • Transdisciplinary Team Research to develop theory of mind in human-AI teams
  • 2 Lecture Sessions (Friday, Oct 9)
    • HART factors in system design and training
    • Managing perceptions and relationships in HART
  • Posters cover a variety from design of submarine workstations to methods for capturing knowledge structures to visual information degradation, reinforcement learning and complacency

16 of 32

Topic Areas (future)

  • Continue to focus on exploring the current themes
  • Expand a wider net to include:
    • Lessons learned and best practices in HART
    • More interdisciplinary submissions and demonstrations
      • Human–AI teaming (including Explainable AI)
      • Human–Robot teaming
      • Human–Autonomy teaming
      • Human–Agent teaming
      • Human–Machine teaming
    • HART methods
    • Ethics in HART

17 of 32

HART TG Balance and Budget

Tristan Endsley, PhD., Draper,

TG Secretary and Treasurer

18 of 32

Budget Overview

  • Current balance: $1195
  • Budget for 2021 will be posted at next business meeting
  • Potential cost for future activities (to be discussed in the breakout session#2)
    • Innovation video contest awards
    • TG social events
    • Best student paper awards
    • Student/mentor programs
  • We are looking for thoughts on what activities we want to support as our TG grows!
  • Focus on near term activities that will have impact

19 of 32

HART TG Interest Survey 2020 Feedback

Lixiao Huang, PhD., TG Chair

20 of 32

What are the biggest challenges we (HFES) need to address to advance human, AI, and robot teaming?

  1. Testbed challenges:
    • e.g., “many state-of-art testbeds developed in other societies are not designed or tested with human factors methods”;
  2. Interdisciplinary collaboration challenges:
    • e.g., “getting all the key stakeholders involved in conversations and working our way towards common language and collaborative projects.”
  3. Measurement and analytics challenges:
    • e.g., “better measurement techniques for the HFE concepts of interest”
  4. Research topics challenges:
    • e.g., ethical/empathy in non-human agents; understanding robots’ goals, etc.

21 of 32

What ideas and approaches would be effective to get more involvement of a wider range of researchers in AI, robotics, and HRI to come to HFES?

  • Personal invitation
  • Advertising at other related conferences
  • Inviting exciting keynote speakers from other fields to HFES
  • Also consider how HFES can create alliances/partnerships with other technical societies and organizations in the fields of AI, robotics, HRI, and exoskeletons
  • Long-term effort to educate and engage stakeholders
  • Competitions that different stakeholders can involve

22 of 32

Panel Topic Suggestions(lead)

  1. Can robots be teammates? (Nancy Cooke)
  2. Advances in Human-AI Ethics Research (Sylvain Bruni)
  3. Human-Centered Assessment of Hybrid Teams (Sylvain Bruni)
  4. Defining Standards for Designing and Developing Human-AI-Robot Teams (Sylvain Bruni)�
  5. Promote state-of-art deliverables in more impactful or broader ways of information distribution (none)
  6. Practitioner stories of HART successes and failures (lessons learned and best practices) (none)
  7. Human-AI Teaming as Inter-species Communication (none)

23 of 32

Related Conferences

HRI

Wearable Robotics Conference (WearRACon) and the IISE Applied Ergonomics Conference

AHFE

CHI

RSS

HCII

CogSIMA

MORS

RO-MAN

Military Operational Research Society

  • Partnership
  • Workshops

24 of 32

Keynote Speaker Nominees

Name

Area of expertise or potential topic

Reasons for the recommendation

Daniel Serfaty

AI and humans

Hear he will integrate an AI teammate into the talk

Julie Shah

Collaborative Robotics

She's a rising star in the field, who is sensitive to human factors and ergonomics

Conor Walsh

wearable robotics

Multidisciplinar professor and designer of wearable robotics and exosuits from the Harvard Wyss Institute

Maja Matarić

social robotics

She's famous and good speaker

Nancy Cooke

cognitive science and HART

Expert in human-autonomy teaming research

Matthew Bolton

Human-Machine Teaming. Formal Methods

He's developing a Test-case Generation method for Human-Machine teams

25 of 32

Other activities

  • Resource library
  • Working groups
  • Consider topics for the Human Factors Prize effort

26 of 32

Chris Reid

Hongwei Hsiao

27 of 32

Breakout Session #2 Response to the interests survey feedback

  • 30 min
  • Designate a person to take notes:
  • Designate one person to report back at the end
  • Topics:
    • Which topic(s) are you most interested in? Any further development ideas? How would you like to be involved?

28 of 32

Breakout Session #2 Report Back

  • 20 min
  • Each group representative has 4 min
  • Post questions in the chat, and we will ask after the reports

29 of 32

Report back

30 of 32

Any other comments and announcements from our members?

31 of 32

Announcements

  1. HFES2020 has sent out the Hubb link on Tuesday, Sep. 29th.
  2. IEEE IROS has free registration this year (Never happened before! May not happen again). A good opportunity to learn more about AI and robotics research and how Human Factors can be plugged in.
  3. ErgoX website
  4. Journal special issue on “Contextualized Affective Interactions with Robots in Frontiers in psych and Frontiers in Robotics and AI, due Dec 11, 2020.

32 of 32

Closing Remarks

Thank you and have a fruitful conference at the HFES2020 next week!