Co-Robotics for Safe, Economical Space Operations
Alain Chau
altrchau@gmail.com
ASTE 527
December 18, 2012
;
SARA: Surrogate Astronaut Robotic Avatar
2
DARPA Avatar Program
& Grand Challenge
(2012-2013)
TELESAR V Robot Avatar
(2012)
Technology Evolves
Avatars
Motivated by Human Safety
Working in
Hostile, Dangerous or Remote Environments
Applications:
Military
Industrial
Crisis
Social
Space
Alain Chau
altrchau@gmail.com
Interest In Humanoid Robotic Avatars
3
Source: MGM, WB
Source: NASA
Working In Space
Human Interaction Needed to Troubleshoot & Adapt to the:
Alternative Needed w/o Compromising Safety, Cost & Human Advantages
Manned Space Operations: Dangerous Costly Complex
4
Humanoid Robotics Offers the Ability to Tackle Poorly Defined Tasks and Accomplish Complex Operations
NASA-GM Robonaut 2
DLR (ESA) Justin Humanoid
RSA SAR-400
Humanoid Robotics in Space
Coupled with High Fidelity Telepresence, Widespread Use of Humanoid Robotic Avatars Can Change How We Operate in and Perceive Space
Source: NASA
Source: DLR
Source: RSA
5
SARA: An Astronaut’s Second Body
Creating a Medium Through Which Human Agencies Can Work in Space
Employ Avatar Technology for
Cheaper, Safer Access to Space for Government and Private Industry
;
SARA: Surrogate Astronaut Robotic Avatars
Multi-Camera Wide Angle High Definition Stereo Vision
Estimated Specifications:
Height: 1.5m (5’-6’)
Width: 0.6m (2’)
Mass: 150-250 kg
Degrees of Freedom: +60
Upper Body: 19 /hand
7 /arm
7 in Head
3 in Torso
Legs/Lower Body: 3 in Hips
4 /foot
4 /Leg
Grip Force: 5-6 lbs
Lifting Capacity: ~20lbs/arm
The Basics of SARA: Humanoid Robotics
Light-Weight Material Construction:
Modular Design for Easy Limb Replacement & Construction
Torso Houses ‘Brain’
Two Arms of Equal Length
Robust Dexterous Hands
Power Supply Backpack:
;
Utilizing Existing and Emerging Technologies
Private and Government Sector Developments
Heat Sinks for Internal Heat Dissipation
Antenna to Receive User Input Data Wirelessly
7
Adaptability
Over
Specialization
Taking the Human Form into Space Unhindered
Ergonomics: Relationship With System Tools, Workspace & Environment
Familiarity of Form
Convenient & Pleasant
;
Why Does SARA Need a Human Form?
Source: Boston Dynamics
8
Robot?
;
Intuitive & Immersive Telepresence
Natural Motion 🡪 Flexibility in Operations
Source: NASA
9
| Suited Astronaut (Apollo A7LB Spacesuit) | SARA |
Mass | Suit ~96 kg+ Human ~60kg = ~156 kg | 150-250 kg (depends on task) |
Protections to User | Temperature Extremes, Space Vacuum, Radiation, Micro-Meteoroids |
|
Dexterity |
Rigidity in Limbs and Fingers/Gloves |
|
EVA Duration | ~7 hours Life Support (+30 minute backup) |
|
Limitations |
|
|
Other Advantages & Notes |
|
|
;
SARA vs. Suited Astronaut
Source: NASA
Source: NASA
10
Dexterous Hands Advantage For Remote Ergonomic Tasks
🡨 The Shadow Robot Company’s Shadow Hand
Industrial Robot Hand Grasping Battery
Teleoperated Dexterous Humanoid Hand:
Grasping Battery in Different Ways
Teleoperated Dexterous Humanoid Hand: Tool Manipulation
Source: JPL
Dexterous Robotic Hands Can Be As Nimble As An Ungloved Human’s
Fingertip Sensors Can Relay Sensory Information from Environment
Astronaut’s Bulky Gloved Fingers
;
Utilizing Existing and Emerging Technologies
Private and Government Sector Developments
11
11
Robot Mobility Advantage: Bipedal
Bipedal Locomotion for Terrestrial Mobility
BD PETMAN
kneels
;
Utilizing Existing and Emerging Technologies
Private and Government Sector Developments
Pressurization Turns the Suits into “Stiff Balloons that Make Movement Difficult and Tiring”
-Prof. Dava Newman (MIT)
Source: NASA
Source: Boston Dynamics
12
Wheeled System
Quadruped
Swappable Lower Torso Systems for Adaptable Mission Requirements
Space EVA Mobility
SAFER
(APU)
SARA Utilizes Existing & Emerging Technologies:
Using Private and Government Program Developments
Alternative Mobility Options : Non-Bipedal
Station Arm Attachment
Source: NASA
Source: Boston Dynamics
13
Human Operator Control Devices: Exoskeleton Interface
Source: ESA
X1
Source: NASA
Source: DLR
Telepresence Exoskeleton Gear
With Sensory Feedback
Full-Body Strength Augmenting Exoskeleton
Full-Body Telepresence Exoskeleton Control Interface
X-Arm
;
Utilizing Existing and Emerging Technologies
Private and Government Sector Developments
14
Full-Body Force Feedback System
Transmits Forces Felt By Robot Limbs/Body to User Exoskeleton
Intuitive Interaction with Surroundings
Haptic Control Devices: Exoskeleton Interface
Body Grounded Exoskeleton Suit for Operator Control in μG Environments
Body Grounded Suit
Without Ground Interference
Zero Floor Contact
;
Utilizing Existing and Emerging Technologies
Private and Government Sector Developments
15
Head Mounted Display and Sensory Feedback
TELESAR V (Tachi Laboratory, Keio University)
You’ve Got the Touch:
Force Sensor: Gel Layer Thermochromic Ink with Interpretive Camera
Vibration & Tactile Sensor: Microphones Beneath Fingertips
Temperature Sensor: Peltier Devices Reproduce Warm/Cold
Force Vector Sensors: Shape of Objects & Surface Evenness
Robot-to-Human Data Would Require Substantially High Data Rates and High Bandwidth
To Maintain Real-Time Sensory Link:
User Feels What the Avatar Feels, Sees What It Sees, Hears What It Hears
;
Utilizing Existing and Emerging Technologies
Private and Government Sector Developments
16
ESA’s METERON ‘Space Internet’ Communications
Experiment for Space Robotics Architectures
Multi-Purpose End-To-End Robotic Operation Network
Image Sources: ESA
Possible Data Rates
Uplink: 256kbps
Downlink: 4Mbps
High Data Rate,
High Bandwidth,
Real-Time Telecommunications
Currently Being Developed and Tested by the METERON Project
Latency Issues Will Be A Limiting Factor in Operations
Minimal Round Trip Delay: 100ms Max
Real-Time Link
;
Utilizing Existing and Emerging Technologies
End-to-End Communications Network for Real-Time Teleoperations
Short-Range/Local Operations: Microwave Transmission Link
17
;
Utilizing Existing and Emerging Technologies
End-to-End Communications Network for Real-Time Teleoperations
Long-Range: Free-Space Optical (Laser) Communications
Methods of Communicating Data Between Operator and SARA Will Vary Based on Proximity and Tasks, and Will Require Further Development as Communications Technology Improves
Source: NASA
Ni-MH Battery
Boston-Power Li-Ion Cells
Potential Independent
Power Systems:
High Energy Density Batteries
Robonaut 2:
Lithium Ion Battery-Pack
(Boston-Power Swing Battery)
2.5kWh Energy Storage System
Extended Cycle and Calendar Life
Wide Operating Temperature Range
Lithium-Air Batteries
Light-Weight, High Energy
High Power Rechargeable Batteries
HRP-family, ASIMO, Hybrid-Electric Vehicles:
Nickel-Metal Hydride (Ni-MH) Battery
Fuel Cells
Shared Power From
External Source
Battery Energy Density Trends
Lithium-Ion vs. Ni-MH vs. Ni-Cd
Source: Panasonic (2006)
Energy Density Nearly Doubled in a Decade
;
Utilizing Existing and Emerging Technologies
Private and Government Sector Developments
Goal: Provide Power for 5-10 Continuous Hours of Independent Operation
Comparatively Low Financial Cost Per Unit
19
Cost of One Space Suit (EMU): ~$12M | Cost of Robonaut 2: ~$2.5M | Honda ASIMO: < $1.0M | HRP-4: ~$320K | HRP-4C $200K | SARA Cost <$1.0M? |
~10-15 SARAs
~30+
SARAs
Manufacture and Evolution by Private Enterprise Following a Proof of Concept by the Government Could Decrease Costs While Improving Performance Over Time
Orbital Teleoperation Advantage
;
The Cost of SARAs
Launch More Workers Into Space For Less Money
Consider a Mission to Repair a Satellite in LEO:
6 Human Crew Members vs. 2 Human Crew Members and +4 SARAs vs. 6 SARAs
Assuming $200M in Mission Related Items and Development Costs
Utilizing Government and Private Launch Systems
Project M (2010, NASA)
Assuming a Value Per Astronaut of $50M, which Includes Their Intrinsic Worth and Training for Space Ops.
(Robert Zubrin, president of Pioneer Astronautics and of the Mars Society, author Case for Mars: The Plan to Settle the Red Planet and Why We Must )
2 Soyuz Launches
Crewed Dragon
Space Shuttle
Soyuz + Soyuz Cargo
Crewed Dragon
Soyuz + Falcon 9
Soyuz Cargo
Dragon Cargo
Falcon 9 + Adapter
;
Potential Mission Cost Comparisons
The Multi-Purpose Robot
21
SARAs Retain Human Adaptability, and Can Be Used for:
Robonaut 2 on the ISS
;
SARAs: Multi-Purpose Avatar
Source: NASA
22
Validation Aboard ISS
Utilizing ISS as Testing Grounds for Avatar Operations
Teleoperated Co-Robotic Interaction
EVA Deployment
;
Applying SARA Near-Term: International Space Station
23
SARA Airlock for Astronaut EVA Co-Robotics
SARA Spare Part Storage
SARA Teleoperations Module
External SARA Pods
SARA Exposed Task-boards & Experiments
SARA Repair/Workshop
;
Applying SARA Near-Term: ISS SARA Module
24
As SARA EVAs Becomes More Reliable, The Module Can be Expanded Further to Test Large Scale Orbital Construction Projects Capabilities
Use SARAs to Build And Test Space Stations & Habitats
Humanoid Form = Human Ergonomic Equivalent
;
Prospects of ISS Validation
25
After the ISS, Send SARA Equipped People to the Moon
;
Next Phase: Lunar Lander
26
Testing SARA Capabilities for Interplanetary Exploration
;
SARA Lunar Mission
27
Lunar and Extra-Planetary Surface Operations
Vehicle Cockpit
Teleoperations Suite C-TOPS
Crew Quarters
Laboratory, Storage
Cleaning Room, Workbench,
Storage
Elevator Airlock
Communications Array
“SARA Cleaning Room”
EVA Elevator & Airlock
Engine (x4)
;
SARA Lunar Mission
Height: 23 m
Diameter: 10 m
28
EVA Co-Robotics
Humans Servicing SARAs
;
Testing the Limits: SARA-Human Co-Dependence
29
What Could SARA Do for the Future of Humans in Space?
Should SARAs Pass the Proof of Concept Projects:
Massive Orbital Infrastructure Development & Maintenance
;
Prospects of SARAs
Source: NASA
30
Lunar Infrastructure Construction and Development
Space Station Construction, Validation and Virtual Population
;
Prospects of SARAs
The Technology Exists to Make SARAs Reliable Surrogates for Humans in Space
SARAs Can Be the Tool By Which Humans Expand Beyond Earth, By Sending Our Minds To Build & Explore Before Our Bodies Inhabit
Source: NASA
Source: NASA
Thank You
Comments or Questions?
31
References
http://www.thespacereview.com/article/2150/1
http://www.gizmag.com/telesar-v-telexistence-robot-avatar/20423/
http://www.newscientist.com/article/mg21528725.900-robot-avatar-body-controlled-by-thought-alone.html?full=true
32
References
http://the-scientist.com/2012/09/01/missing-touch/
33
34
29 June 2011�
References
35
References
Back-up Slides
36
CONTEXT: �Overcoming Hazards, Costs and Complexity
Source: NASA
38
Dependency on Human EVA
Why We Need ‘The Human Factor’
From Section 14.1.2.1.2 of NASA Man-Systems Integration Standards, Volume 1:
“The advantages of EVA include:
Source: NASA
Astronaut Scott Parazynski Repairing Damaged ISS Solar Panel
39
Dealing with Unknown Circumstances:
Human Astronauts Needed to Troubleshoot the Issues, Adapt
Safety/Mortality Factor Comes Up Again
An Alternative is Needed Without Compromising Safety, Cost & Human Advantages
Manned Space Operations: Dangerous Costly Complex
STS-125
40
SPACE TELEROBOTICS
Telerobotics:
Remote Operation of Robots
Source: NASA JSC
Our Ambassadors in a Dangerous Space
41
Telerobotics & Co-Robotics
CONTEXT: Limited Human Access into Space:�The Contribution of Robotics
CO-ROBOTICS IN SPACE:�HUMAN-ROBOT COOPERATION
42
Capabilities of ‘Robotic Helpers’
Co-Robots Help Us Compensate for Our Physical Limitations Within the Space Environment
Source: NASA
Robonaut 2 and Astronaut: Evolving Co-Robotic Relations
Our Partners,
A Helping Hand
43
Benefits to Astronauts
(1 Astronaut, 1+ SARA vs. 2 Astronauts)
Reduces Required Manpower in EVA
Cheaper, Safer Access to Space:
SURROGATE ASTRONAUT ROBOTIC AVATARS (SARAs)
Robot?
Human
44
Applying Current Technology and Innovations
Emulating Human Dexterity, Motion, and Balance
ECCE Robot
Anthropomimetic
Robot:
Source: University of Sussex (UK)
HRP-4C Humanoid Robot
Source: AIST (Japan)
Source: Boston Dynamics (USA)
Boston Dynamics: PETMAN
Natural, Agile Movement
Source: Shadow Robot Company (UK)
Pneumatic Artificial (Air) Muscles:
Shadow Dexterous Hand
Maintaining Human Adaptability and Control Though a Surrogate Body
Complete Hand Dexterity
Bipedal Locomotion offers ‘the highest fidelity virtual presence’ (Landis)
SARCOS Robot:
With Push Recovery
Source: Robotics Institute at
Carnegie Mellon University
Robonaut 1 Tying a Knot
Source: NASA DARPA
45
Applying Current Technology and Innovations
Source: JST KeioUni.GSMD
Sensory Feedback Systems Built into User’s Gloves
Innovative Immersive Controls and Sensation Feedback
Tactile Discrimination
Relays Sensations Measured by the Robot to the User
TELESAR V:
Telexistence Robot
Source: JST KeioUni.GSMD
Source: DLR
DLR’s Space Justin:
Satellite Servicing Robot
Source: JST KeioUni.GSMD
TELESAR V:
User-Robot Interface
46
Experiencing Beyond Human Senses:
Full Control of Sight, Sound and Touch
Night Vision
Telescopic Vision
Infrared Thermography
;
Utilizing Existing and Emerging Technologies
Private and Government Sector Developments
Support Systems for SARA
47
EVA Deployment
Orbital
Terrestrial
48
System Architecture For Orbital Operations:
Use of Existing Resources
Direct Station to Task Site Control
For Crewmember Avatar Deployment
Data Relay Satellite
LEO Task Site
HO & Input Control Interface at Operating Site
SARA at Task Site
LEO Task Site
NASA
White Sands Complex
Control Input
Sensory Feedback
49
Surface Colony: Crew Could Operate Avatars from Inside Established Habitats, Useful for Operations in Hazardous Environments or Dangerous Activities
Latency Issues Between Earth and Moon Transmissions Could Make Avatar Control Less Intuitive at These Distances
Effectors Controlled from Earth Would Require Less Complexity, Sacrificing Dexterity, Cognitive Input and Sensory Feedback
Crewmembers in Orbiting Stations Could Control Ground-Based Avatars in Real-Time from Space with Less Risks
System Architecture For
Lunar/Planetary Operations
Source: NASA
Solar Arrays Used to Provide Colony Power Could Collect and Store Energy in Batteries to Recharge Avatars After Operating Periods
High Fidelity,
High Bandwidth Connection
50
;
SARAs: Multi-Purpose Robots
51
Multi-Module ISS Add-On
Beginnings of an Independent SARA Spacecraft or Station
Significant Volume Necessary to Gauge Capacity of SARA Space Independence
What Could SARA Do for the ISS?
Source: NASA
;
Applying SARA Near-Term: International Space Station
52
Applying SARA in Space Operations
Perform Activities in Space
Simplifying Control Input Interface Systems Could Allow Anyone to Operate a SARA
Ground and Space Collaboration Becomes More Personal
Visitation and Collaboration Via Telepresence
Source: NASA
53
Latency Issues | Lifting and Load Capacity
|
Operating Period Limits
| Material Limitations in Space Environment
|
Problems and Limitations to Be Solved
Source: NASA
Ni-MH Battery Pack
Source: NASA
Interesting Developments
54
Fully Thought Controlled Avatars
Source: Béziers Technology Institute, France
Miniaturized Co-Robotic Avatars
Varying the Size of the Avatar
Source: Yamagata University, Japan
Human Facial Projection
Human Operator’s Face is Displayed on the Avatar’s Head
Source: KeioUni, Tachni Labs