Drone Photo
Flying Hand
Aerial Manipulator for
Non Destructive Testing
TEAM C
Sponsors
Advisors
Dimitrios Apostolopoulos
John Dolan
Sebastian Scherer Guanya Shi
Team Members
Shubham Saboo
Shunxuan Wang
Chenyang Mao
Shubha Tanaya
Weerachai Sangiumpaisankij
2
01
System Overview
Workflow
4
Workflow Diagram
Overall System
5
02
Requirements
Requirements
10
ID | Functional Requirement | ID | Performance Metric |
MF1 | The system shall sense the surrounding environment | MP1 | Sense the environment within the range of 0.5-4 m from the Flying Hand |
MF2 | The system shall localize its own pose relative to the environment | MP2 | Localize position with an error of at most 10 cm under nominal conditions |
MF3 | The system shall allow operator to manually pilot Flying Hand to an Area of Interest | MP3 | Navigate at speeds up to 1 m/s during manual flight |
MF5 | The system shall manipulate end-effector to establish contact with the POI | MP4 | Detect a POI from a distance of at least 2.5 m |
MF6 | The system shall maintain stable end-effector contact during NDT | MP5 | Maintain end-effector positioning accuracy within ±0.15 m during contact-based NDT |
MF10 | The system shall provide real-time visual feedback to the operator | | |
03
Demonstration
Localization
Subsystem Core Components
14
Voltage Regulator
Jetson Orin Nano
D456 RealSense Camera
Flight Controller Unit
USB-TTL-232-Serial
HDMI EDID Emulator
D456 RealSense Camera
Jetson Orin Nano
Flight Controller Unit
Voltage Regulator
USB-TTL-232-Serial
HDMI EDID Emulator
Subsystem Workflow
15
Mavros�/mavros/odometry/out
Subsystem Capabilities
16
Open-Area
Do waypoints navigation and
land automatically within 0.5 m of target point
Near-Wall
~0.3 m Away from the Wall
~1.5 m Flight Height
Hover for 30 s
Arm-End Keyframes During Near-Wall Hovering
Achieved Requirements
17
ID | Functional Requirement | ID | Performance Metric |
MF1 | The system shall sense the surrounding environment | MP1 | Sense the environment within the range of 0.5-4 m from the Flying Hand |
MF2 | The system shall localize its own pose relative to the environment | MP2 | Localize position with an error of at most 10 cm under nominal conditions |
MF3 | The system shall allow operator to manually pilot Flying Hand to an Area of Interest | MP3 | Navigate at speeds up to 1 m/s during manual flight |
MF5 | The system shall manipulate end-effector to establish contact with the POI | MP4 | Detect a POI from a distance of at least 2.5 m |
MF6 | The system shall maintain stable end-effector contact during NDT | MP5 | Maintain end-effector positioning accuracy within ±0.15 m during contact-based NDT |
MF10 | The system shall provide real-time visual feedback to the operator | | |
Open-Area Video Demo
18
18
Near-Wall Video Demo
18
18
Force Application
Subsystem Core Components
20
Subsystem Workflow
21
Subsystem Capabilities
22
The force sensor can measure contact force and calculated desired thrust output from the Wrench Controller
Achieved Requirements
23
ID | Functional Requirement | ID | Performance Metric |
MF1 | The system shall sense the surrounding environment | MP1 | Sense the environment within the range of 0.5-4 m from the Flying Hand |
MF2 | The system shall localize its own pose relative to the environment | MP2 | Localize position with an error of at most 10 cm under nominal conditions |
MF3 | The system shall allow operator to manually pilot Flying Hand to an Area of Interest | MP3 | Navigate at speeds up to 1 m/s during manual flight |
MF5 | The system shall manipulate end-effector to establish contact with the POI | MP4 | Detect a POI from a distance of at least 2.5 m |
MF6 | The system shall maintain stable end-effector contact during NDT | MP5 | Maintain end-effector positioning accuracy within ±0.15 m during contact-based NDT |
MF10 | The system shall provide real-time visual feedback to the operator | | |
Contact Video Demo
24
24
Flying Hand
Simulation
Subsystem Core Components
26
Fully-actuated
F/T sensor
Camera
Target Localization
Subsystem Workflow
27
Mission Script:
The Axis Control:
What Affects X, Y, Z Motion
The Blending: How the Three Loops Combine
Subsystem Capabilities
28
Effective Distance of Visual Servo Controller > 2.5 m
Arm-end Contact Error < 0.15 m
Force-convergence Time after Contact < 3 s
Maintain a Constant Force 5±1 N
Duration of Force Application ≥ 15 s
Achieved Requirements
29
ID | Functional Requirement | ID | Performance Metric |
MF1 | The system shall sense the surrounding environment | MP1 | Sense the environment within the range of 0.5-4 m from the Flying Hand |
MF2 | The system shall localize its own pose relative to the environment | MP2 | Localize position with an error of at most 10 cm under nominal conditions |
MF3 | The system shall allow operator to manually pilot Flying Hand to an Area of Interest | MP3 | Navigate at speeds up to 1 m/s during manual flight |
MF5 | The system shall manipulate end-effector to establish contact with the POI | MP4 | Detect a POI from a distance of at least 2.5 m |
MF6 | The system shall maintain stable end-effector contact during NDT | MP5 | Maintain end-effector positioning accuracy within ±0.15 m during contact-based NDT |
MF10 | The system shall provide real-time visual feedback to the operator | | |
Video Demo
30
Thank You!
TEAM C