1 of 26

2 of 26

4-5pm: Human-AI-Robot Teaming Technical Group (HART TG) Annual Business

5-6pm: Bring Your Own Robot (BYOR) Social Networking

6:30 pm Optional dinner at Johnny Pistolas

3 of 26

Agenda

  • 4pm:
    • Introduction of TG
    • TG progress in 2023
    • TG plans in 2024
    • Questions and Feedback from TG members
  • 5pm:
    • BYOR Social event

4 of 26

Introduction of HART TG (3.5 year old since April 2020)

Lixiao Huang, PhD., Arizona State University

HART TG Chair

Kelly Neville, PhD, MITRE

HART TG Chair-elect

5 of 26

HART TG Mission

The Human–AI–Robot Teaming (HART) TG strives to organize human factors and ergonomics (HF/E) researchers’ efforts in the state-of-art of Human–AI–Robot Teaming research and applications, collectively address the critical theoretical and practical challenges, provide interdisciplinary solutions that enhance human factors research with advanced technology testbeds and analytics techniques, and use the strength of HF/E community to help AI/robotics researchers to advance their research development.

6 of 26

HART TG Progress in 2023

  1. Membership
  2. Member engagement activities
  3. Outreach activities
  4. Science advancement: HFES Annual Conference

7 of 26

Membership from 2020-2023

Year

Members

As of

2020

96

10/2020

2021

316

1/25/2022

2022

309

12/15/2022

2023

300

10/11/2023

8 of 26

Monthly HART TG Member Conversations

Dates

Topics

Speaker

Jan 31, 2023

Studying Team Interactions with Mathematical Models

Lucero Rodriguez (ASU)

Feb 28, 2023

Responsible human control of AI Systems: Thoughts toward how to define and measure

Chris Miller (SIFT)

Mar 28, 2023

Use of GPT models to assess human-AI interaction longitudinally: Testbed development

Nate Tenhundfeld (UAH)

Apr 25, 2023

Training aviators to better understand, use, and trust automation technologies

Scott Scheff (HF Designworks, Inc.)

May 30, 2023

Interest of passive exoskeletons to preserve health and safety at work

Bérenger LE TELLIER(Ergosanté)

Jun 27, 2023

Initial results of HAT outreach surveys and future plans

Jim McCarthy(Sonalysts, Inc.)

Jul 25, 2023

Human-guided autonomous trucking

Tekin Meriçli (Locomation)

Aug 22, 2023

Can human explain robots?

Ransalu Senanayake (ASU)

Sep 26, 2023

Designing robot teams to support health & wellness for older adults

Samuel Olatunji (UIUC)

9 of 26

Outreach

  • Connecting with other related conferences and communities
    • Ericka Rovira served as a reviewer for HRI
    • Mica Endsley gave a webinar at IEA about HFE perspectives on Artificial Intelligence and the future of work
    • Encouraging submissions to HRI
  • Inviting speakers from other communities to our monthly member conversations
  • Inviting NASA Suits Project Team to join our HART TG Social Event

10 of 26

HFES2023 HART TG Submissions

Joseph Lyons, PhD., Air Force Research Laboratory

HART TG Annual Conference Program Chair

Guliz Tokadli, PhD., Collins Aerospace

HART TG Annual Conference Program Chair-elect

11 of 26

Overview

Lots of interest and involvement,

even more than last year!

  • Breakdown
    • 60 total submissions, 34 accepted
    • 24 Lecture presentations
    • 8 Posters
    • 3 Discussion Panels
  • We continue to see growth in our program

12 of 26

Topic Areas (current)

  • Lecture Sessions:
    • HART2 - Implications of Working with HARTS (Tues)
    • HART3 - HART Application (Wed)
    • HART4 - Trust (Wed)
    • HART6 - HART Design Implications (Fri)
  • Discussion Panels
    • HART1 - Transdisciplinary Team Science: Transcending Disciplines to Understand Artificial Social Intelligence in Human-Agent Teaming (Tues)
    • HART5 - Robotics at the Crossroads: A Discussion of Ethical Considerations and Moral Implications (TH)
    • GS6 - Lifecycle transparency (TH)
  • Posters cover a wide variety of key topics, including:
    • Trust, social robots, industrial robots, surgical robots, virtual reality

13 of 26

How are we doing this year on the four biggest HART challenges (Trends and new breakthroughs)

Challenges

2023 Science Advancement

1. Testbeds

DARPA ASIST, Minecraft NGCV, ARL INFORMS

2. Interdisciplinary collaborations

DARPA ASIST, ASU-ARL, Task Force Lima

3. Measurement and analytics

Dynamical measures of trust and workload, operational T&E

4. Research topics

Emerging topics: Life-cycle transparency, LLM

14 of 26

Topic Areas (future)

  • Continue to focus on exploring the current themes
  • Expand a wider net to include:
    • More AI and robotics elements
    • More interdisciplinary submissions and demonstrations
      • Human–AI teaming (including Explainable AI)
      • Human–Robot teaming
      • Human–Autonomy teaming
      • Human–Agent teaming
      • Human–Machine teaming
      • Lifecycle transparency approaches
  • Evolving HART models and methods
  • Ethics in HART
  • Lessons learned and best practices in HART for practitioners

15 of 26

HFES 2023 Program Thank you!!!

Reviewers: We had 82 volunteer reviewers!

  • We tried to communicate effectively & keep the review demand limited to individual preferences

Session Chairs: Areen Alsaid, Kelly Neville, Ericka Rovira

Session Co-Chairs: Kenneth Cassidy, Glenn Lematta, Aakash Yadav, Elizabeth Lazzara, Jiayuan Dong

16 of 26

HART TG Balance and Budget

Ericka Rovira, PhD., West Point

HART TG Secretary and Treasurer

17 of 26

Budget Overview

  • Current balance as of 8/31/2023: $8,987 (increase in $2.3k)
  • 2023 Expenses:
  • BYOR Reception at HFES: $2,067
  • 15 Complementary TG memberships: $75
  • 2024 Budget plans:
  • HFES2024 Reception: $2,067
  • 15 Complementary TG memberships: $75
  • Activities that advance HART research and engage TG members

18 of 26

Plans for 2024

  • Circle of Excellence evaluation from HFES
    • Best practice recommendations
  • Member engagement
    • Monthly member conversations
    • Registered Labs/Orgs of TG members for tours
    • Forum/website posting the grants
  • TG Outreach:
    • Inviting non-members to join our events
    • Bring HART to other societies
  • Encourage another year of submissions
    • Collaborating with other TGs when make sense

19 of 26

2024 Monthly HART TG Member Conversations�(last Tuesday each month at 12 pm ET)

Dates

Topics

Speaker

Jan 23, 2024

Feb 27, 2024

Mar 26, 2024

Apr 30, 2024

May 28, 2024

Jun 25, 2024

Jul 30, 2024

Aug 27, 2024

Sep 10, 2024

HART TG Annual Business Meeting at HFES2024 (In person)

20 of 26

Current HART TG Officers

TG Chair

Lixiao Huang

ASU

TG Program Chair

Joseph Lyons

AFRL

TG Program Chair-elect

Güliz Tokadli

Collins Aerospace

TG Secretary & Treasurer

Ericka Rovira

Westpoint

TG Webmaster &

Newsletter Editor

David Grimm

ASU

TG Chair-elect

Kelly Neville

MITRE

21 of 26

Current Contributing Committee

  • Eric Holder, PhD, ARL
  • Myounghoon Philart Jeon, PhD, Virginia Tech
  • Areen Alsaid, PhD, University of Michigan-Dearborn
  • Joonbum Lee, PhD, University of Wisconsin-Madison

22 of 26

Questions and Suggestions from TG Members

23 of 26

�Part 2:

HART TG Social Event�Bring Your Own Robot (BROR) Demo

October 24, 2023

5pm–6pm

24 of 26

Demo list

  1. Adam Fouse et al. (Aptima, ASU, UCF, IHMC, Gallup, etc.): DARPA ASIST Testbed: Artificial Social Intelligence for Successful Teams
  2. Beth Phillips (George Mason University): Robots
  3. Myounghoon Jeon et al. (Virginia Tech): Robots
  4. Hannah Baez (University of Michigan): shape changing steering wheel
  5. Melissa Cloutier (Rice University): NASA SUITS Poster demo

25 of 26

Instructions

  • One free ticket for each HART TG members;
  • Join HART TG with $5 a year in 3 steps:

http://hfes-hart.weebly.com/contents/how-do-i-join-hart-tg-with-3-steps

  • Dinner Option: 6:30pm at Johnny Pistolas

26 of 26