1 of 53

Human-Centered Robotics

Chien-Liang Fok�IEEE CEDA Austin Talk

Feb. 3, 2015

2 of 53

Assessment of Disruptive Technologies by 2025 (Global Trends)

3 of 53

More Recently: Global Trends 2030

4 of 53

Quoting Senator John Cornyn

5 of 53

Great Challenge: Assistive Technologies in 2007�(source: Fatronik)

Market analysis:

An unstructured market

Poor information and advice

Assessment problems

Non-human-centred design

A traditional ofer (mobility only). Need alzheimer, parkinson

6 of 53

60 Years History in Human-Centered Robotics

2000

1950

1960

1970

1980

1990

Mobile cooperation

Shakey

Ray Goertz

Atomic Energy Comsision

Manipulation radioactive materials

Sensor-based

Mobile manipulation

DARPA urban

challenge

Humanoids

Microsoft robotics studio

Bill Gates

Shimmer

health monitor

Intel Co.

Monkey

neural interface

Duke Univ.

Unmmaned Systems

Compliant manipulators

Military robots

Biped robots

Exoskeletons

Elderly guidance

Surgical robots

Artificial muscles

7 of 53

Events in Human-Centered Robotics

Mobile cooperation

Shakey

Ray Goertz

National Instruments

Manipulation radioactive materials

Sensor-based

Mobile manipulation

DARPA urban

challenge

Humanoids

Microsoft robotics studio

Bill Gates

Shimmer

health monitor

Intel Co.

Monkey

neural interface

Duke Univ.

Unmmaned Systems

Compliant manipulators

Military robots

Biped robots

Exoskeletons

Elderly guidance

Surgical robots

Artificial muscles

2000

1950

1960

1970

1980

1990

8 of 53

Events in Human-Centered Robotics

Mobile cooperation

Shakey

Ray Goertz

National Instruments

Manipulation radioactive materials

Sensor-based

Mobile manipulation

DARPA urban

challenge

Humanoids

Microsoft robotics studio

Bill Gates

Shimmer

health monitor

Intel Co.

Monkey

neural interface

Duke Univ.

Unmmaned Systems

Compliant manipulators

Military robots

Biped robots

Exoskeletons

Elderly guidance

Surgical robots

Artificial muscles

2000

1950

1960

1970

1980

1990

9 of 53

Events in Human-Centered Robotics

Mobile cooperation

Shakey

Ray Goertz

National Instruments

Manipulation radioactive materials

Sensor-based

Mobile manipulation

DARPA urban

challenge

Humanoids

Microsoft robotics studio

Bill Gates

Shimmer

health monitor

Intel Co.

Monkey

neural interface

Duke Univ.

Unmmaned Systems

Compliant manipulators

Military robots

Biped robots

Exoskeletons

Elderly guidance

Surgical robots

Artificial muscles

2000

1950

1960

1970

1980

1990

10 of 53

Events in Human-Centered Robotics

Mobile cooperation

Shakey

Ray Goertz

National Instruments

Manipulation radioactive materials

Sensor-based

Mobile manipulation

DARPA urban

challenge

Humanoids

Microsoft robotics studio

Bill Gates

Shimmer

health monitor

Intel Co.

Monkey

neural interface

Duke Univ.

Unmmaned Systems

Compliant manipulators

Military robots

Biped robots

Exoskeletons

Elderly guidance

Surgical robots

Artificial muscles

2000

1950

1960

1970

1980

1990

11 of 53

Events in Human-Centered Robotics

Mobile cooperation

Shakey

Ray Goertz

National Instruments

Manipulation radioactive materials

Sensor-based

Mobile manipulation

DARPA urban

challenge

Humanoids

Microsoft robotics studio

Bill Gates

Shimmer

health monitor

Intel Co.

Monkey

neural interface

Duke Univ.

Unmmaned Systems

Compliant manipulators

Military robots

Biped robots

Exoskeletons

Elderly guidance

Surgical robots

Artificial muscles

2000

1950

1960

1970

1980

1990

12 of 53

Prof. Luis Sentis’ Vision of Human Centered Robotics Back in 2009 (human in the loop)

Personal robotics

Unmanned surveillance

Guidance of gait

13 of 53

CARL: Cloud-Based Healthcare Automation

  • Connecting the Robot �to the User
  • Cloud-based

14 of 53

The HCRL People

15 of 53

Started Building Dreamer

16 of 53

Started Building Dreamer

17 of 53

Started Building Dreamer

18 of 53

Trikey Mobile

Base

19 of 53

National Robotics Initiative

20 of 53

Service / Industrial Mobile Worker

21 of 53

Funded Project: Planetary Exploration for NASA

22 of 53

A Few Key Problems

  1. Precision of mobile robots is inferior to industrial manipulators

  • Accidental collisions will injure humans and break robots

  • Human-Centered robots are not intelligent enough

23 of 53

We Started Focusing on Safety

24 of 53

On Human-Robot Cooperation

25 of 53

Safety Everywhere

26 of 53

Then DARPA’s Robotics Challenge Came In

27 of 53

28 of 53

29 of 53

30 of 53

Team up with NASA on Whole-Body Movement Coordination

31 of 53

We started thinking about the design

32 of 53

Locked in the Apollo Lander Room

33 of 53

We Developed Mechanics

34 of 53

Movie

35 of 53

( External Adoption )

X1/Mina Exoskeleton

36 of 53

(cont’d)

37 of 53

Feedback Control Systems

38 of 53

The Problem is the Big Math

39 of 53

Latencies and Noise

40 of 53

Stability

41 of 53

We Developed a Software Middleware

Dubbed “Control-It”

42 of 53

We Developed Human Machine Interfaces

43 of 53

We developed simulations

44 of 53

And we finished in just 9 months...

45 of 53

Other Teams of the DRC

46 of 53

Top team so far...

47 of 53

48 of 53

History of the Project

49 of 53

50 of 53

Prismatic Pendulum Trajectories

51 of 53

Phase Space Planner

52 of 53

Results

53 of 53

Robonomics