Human behaviour analysis
Context analysis
Human-robot collaboration paradigms
Computational & cognitive neuroscience
Devices interoperability
Working memory features for robots
Hybrid interfaces (multiple paradigms)
SMART LIVING ENVIRONMENTS
FROM MONKEY BRAIN TO SMART HOUSE CONTROL
Predictive
Neural Information
for Proactive Actions
4
In the context of Plan4Act, the goal was to use that planning mechanism for PROACTIVE CONTROL of a smart home, a robotic arm, driving a car, among many other things.
Is it posible to idendity the moment when the mechanism in the brain is activated that causes you, for example, to extend your arm to grab the doorknob even before you initiate the movement?
Research question
5
What PROACTIVE CONTROL means?
6
WHAT?�Spatial
Reference
frames
MOVEMENT PLANNING
BACKGROUND
WHEN?�Motor
target selection
WHERE?� Dorsal Premotor Cortex (PMD) & Parietal Reach Region (PRR)
Tanji, J. (2001). Sequential organization of multiple movements: involvement of cortical motor areas. Annual review of neuroscience, 24(1), 631-651.
Andersen, R.A., Cui, H., 2009. Intention, Action Planning, and Decision Making in Parietal-Frontal Circuits. Neuron 63, 568–583.
7
2
1
DEMOSTRADOR
...
...
3
5
6
7
ACQUISITION AND TRANSMISSION
DATA ADAPTATION
HARDWARE IMPLEMENTATION
LIVING LAB CONTROL
INTERFACE
4
MODEL TRAINING
Fuente: Berger et al.[1]
Berger, M., & Gail, A. (2018). The Reach Cage environment for wireless neural recordings during structured goal-directed behavior of unrestrained monkeys. bioRxiv, 305334.
TRAYECTORY PREDICTOR
Bathroom
Windows
POSE ESTIMATION
WEB OF THINGS
LIVING LAB GATEWAY
IMAGE
DESIGNING NEW
SMART INTERACTIONS
WITH THE ENVIRONMENT
Reinforcement of CONTEXT & TRAJECTORY in
CLASSIFIER
ADAPTATION
OPEN DOOR
TURN ON LIGHTS
OPEN WINDOW
RAISE BLINDS
FROM MONKEY BRAIN TO HUMAN BRAIN
LST
Original Derived
Research Activities
EEG SIGNALS
ASYNCHRONOUS PARADIGM FEATURES
DIMENSIONAL REDUCTION
SELF
CALIBRATION
CLASSIFIER
ADAPTATION
A BREAKTHROUGH TOWARDS MERGING OUR BRAINS WITH AMBIENT INTELLIGENCE SYSTEMS
BRAIN-COMPUTER
INTERFACES CHALLENGES
MEASUREMENT STABILITY
NEED OF EXTERNAL STIMULI
OFFLINE TIME PARADIGMS
CALIBRATION TIME
CLASSIFIER STABILITY
DATA AVAILABILITY & USE
EEG SIGNALS
ASYNCHRONOUS PARADIGM FEATURES
DIMENSIONAL REDUCTION
SELF
CALIBRATION
CLASSIFIER
ADAPTATION
BRAIN-COMPUTER
INTERFACES CHALLENGES
MEASUREMENT STABILITY
NEED OF EXTERNAL STIMULI
OFFLINE TIME PARADIGMS
CALIBRATION TIME
CLASSIFIER STABILITY
DATA AVAILABILITY & USE
A BREAKTHROUGH TOWARDS MERGING OUR BRAINS WITH AMBIENT INTELLIGENCE SYSTEMS
EEG SIGNALS
ASYNCHRONOUS PARADIGM FEATURES
DIMENSIONAL REDUCTION
SELF
CALIBRATION
CLASSIFIER
ADAPTATION
BRAIN-COMPUTER
INTERFACES CHALLENGES
MEASUREMENT STABILITY
NEED OF EXTERNAL STIMULI
OFFLINE TIME PARADIGMS
CALIBRATION TIME
CLASSIFIER STABILITY
DATA AVAILABILITY & USE
A BREAKTHROUGH TOWARDS MERGING OUR BRAINS WITH AMBIENT INTELLIGENCE SYSTEMS
EEG SIGNALS
ASYNCHRONOUS PARADIGM FEATURES
DIMENSIONAL REDUCTION
SELF
CALIBRATION
CLASSIFIER
ADAPTATION
BRAIN-COMPUTER
INTERFACES CHALLENGES
MEASUREMENT STABILITY
NEED OF EXTERNAL STIMULI
OFFLINE TIME PARADIGMS
CALIBRATION TIME
CLASSIFIER STABILITY
DATA AVAILABILITY & USE
A BREAKTHROUGH TOWARDS MERGING OUR BRAINS WITH AMBIENT INTELLIGENCE SYSTEMS
EEG SIGNALS
ASYNCHRONOUS PARADIGM FEATURES
DIMENSIONAL REDUCTION
SELF
CALIBRATION
CLASSIFIER
ADAPTATION
A BREAKTHROUGH TOWARDS MERGING OUR BRAINS WITH AMBIENT INTELLIGENCE SYSTEMS
BRAIN-COMPUTER
INTERFACES CHALLENGES
MEASUREMENT STABILITY
NEED OF EXTERNAL STIMULI
OFFLINE TIME PARADIGMS
CALIBRATION TIME
CLASSIFIER STABILITY
DATA AVAILABILITY & USE