Menu

 

Back to Search Results    

Project Title:  HCAAM VNSCOR: Responsive Multimodal Human-Automation Communication for Augmenting Human Situation Awareness in Nominal and Off-Nominal Scenarios (80NSSC20K0409) Reduce
Images: icon  Fiscal Year: FY 2020 
Division: Human Research 
Research Discipline/Element:
HRP HFBP:Human Factors & Behavioral Performance (IRP Rev H)
 Start Date: 12/04/2019  
End Date: 12/03/2023  
Task Last Updated: 04/15/2020 		 Download report in PDF pdf
Principal Investigator/Affiliation:   Stirling, Leia  Ph.D. / University of Michigan 
Address:  Industrial and Operations Engineering 
1205 Beal Avenue, G634 IOE Building 
Ann Arbor , MI 48109 		 Email: leias@umich.edu 
Phone: 617-324-7410  
Congressional District: 12 
Web:  
 Organization Type: UNIVERSITY 
Organization Name: University of Michigan 
Joint Agency:  
Comments: NOTE: PI moved to University of Michigan in fall 2019; previous affiliation was Massachusetts Institute of Technology 
Co-Investigator(s)
Affiliation: 
Blossom, Jonathon  NASA Jet Propulsion Laboratory  
Atkins, Ella  Ph.D. University of Michigan 
Project Information: Grant/Contract No. 80NSSC20K0409 
Responsible Center: NASA JSC 
Grant Monitor: Williams, Thomas  
Center Contact: 281-483-8773 
thomas.j.williams-1@nasa.gov  		Solicitation: 2017 HERO 80JSC017N0001-BPBA Topics in Biological, Physiological, and Behavioral Adaptations to Spaceflight. Appendix C 
Grant/Contract No.: 80NSSC20K0409 
Project Type: GROUND 
Flight Program:  
TechPort: No  		No. of Post Docs:  
No. of PhD Candidates:  
No. of Master's Candidates:  
No. of Bachelor's Candidates:   		No. of PhD Degrees:  
No. of Master's Degrees:  
No. of Bachelor's Degrees:  
Human Research Program Elements: (1) HFBP:Human Factors & Behavioral Performance (IRP Rev H)
Human Research Program Risks: (1) HFBP HARI:Risk of Inadequate Design of Human and Automation/Robotic Integration (IRP Rev J)
(2) HFBP HCI:Risk of Inadequate Human-Computer Interaction (IRP Rev J)
Human Research Program Gaps: (1) HFBP-HARI-02:We need to develop design guidelines for effective human-automation-robotic systems in operational environments that may include distributed, non-colocated adaptive mixed-agent teams with variable transmission latencies. (Previously: How can performance, efficiency, and safety guidelines be developed for effective information sharing between humans and automation, such that appropriate trust and situation awareness is maintained?; IRP Rev G name change to HARI-02 from previous designation SHFE-HARI-02, which was IRP Rev F)
(2) HFBP-HARI-03:We do not know how to quantify overall human-automation-robotic system performance to inform and evaluate system designs to ensure safe and efficient space mission operations (IRP Rev G name change to HARI-03 from previous designation SHFE-HARI-03 (which was IRP Rev F) (Previously: How can performance, efficiency and safety guidelines be developed for appropriate task automation and the effective allocation of tasks between humans and automation?)
(3) HFBP-HCI-03:We need HCI guidelines (e.g., display configuration, screen-navigation) to mitigate the performance decrements and operational conditions of long duration spaceflight. (Previous title: SHFE-HCI-03) (IRP Rev H)
(4) HFBP-HCI-04:We need to understand how emerging multi-modal and adaptive display and control technologies are best applied to the design of HCI for proposed long-duration DRM (Design Reference Missions) operations. (Previous title: SHFE-HCI-04) (IRP Rev J)
(5) HFBP-HCI-06:We need guidelines to ensure crewmembers receive all of the information required to accomplish necessary tasks in a timely fashion, even when operating autonomously. (Previous title: SHFE-HCI-06) (IRP Rev H)
(6) HFBP-HCI-07:We need to define the acceptable level of risk for HCI performance relative to terrestrial baselines. (Previous title: SHFE-HCI-08) (IRP Rev H)
Task Description: [Ed. note April 2020: Continuation of "HCAAM VNSCOR: Responsive Multimodal Human-Automation Communication for Augmenting Human Situation Awareness in Nominal and Off-Nominal Scenarios," grant 80NSSC19K0703, with the same Principal Investigator (PI) Leia Stirling, Ph.D., due to PI move to University of Michigan from Massachusetts Institute of Technology in fall 2019]

his task is part of the Human Capabilities Assessments for Autonomous Missions (HCAAM) Virtual NASA Specialized Center of Research (VNSCOR).

Crew extravehicular activity (EVA) is limited on spaceflight missions. Multiple, small robotic spacecraft with varying levels of autonomy are needed to perform tasks that might have been completed by an astronaut (e.g., an exterior surface inspection or repair). Crews on long duration exploration missions (LDEM) will have less access to ground support during task operations. As a result, they will need to process more information and communicate with autonomous robots effectively to ensure tasks are progressing safely and on schedule.

The objective of these studies is to investigate the use of augmented reality (AR) multimodal interface displays and communication pathways for improving human-robot communication, situation awareness (SA), trust, and task performance. This will lead to developing guidelines for designing human-robot system interactions that enable operational performance for crews on spaceflight missions.

The specific aims are to:

1) Develop a simulation testbed for examining communication between human-robot teams.

2) Develop a hardware testbed for examining communication between human-robot teams.

3) Evaluate human SA, trust, and task performance within a short duration and long-duration ground-based study (simulation and/or hardware) through testing various interface communication modalities and information displays.

4) (Option) Perform additional studies for alternate parameters of interest that could be tested using the study testbeds. Additional parameters include timing and persistence of information, gesture command mapping, varying the levels of robot automation, evaluating precision enabled by each command mode.

Research Impact/Earth Benefits: Augmented Reality (AR) has opportunity to support decision making across a variety of use-case scenarios, including but not limited to manufacturing, automated vehicles, military training, and entertainment. This research compares AR to other visual modalities for telerobotics applications, specifically considering robotic control and anomaly inspection. Results from this study can inform how AR is integrated for task-specific applications, as there may be tasks that have increased benefit from AR, whereas others may have additional considerations that emerge.

Task Progress & Bibliography Information FY2020 
Task Progress: New project for FY2020.

NOTE (Ed., 4/15/2020) this is a continuation of "HCAAM VNSCOR: Responsive Multimodal Human-Automation Communication for Augmenting Human Situation Awareness in Nominal and Off-Nominal Scenarios," grant 80NSSC19K0703, due to PI Dr. Leia Stirling's move to University of Michigan from Massachusetts Institute of Technology in fall 2019. See that project for previous reporting.

Bibliography Type: Description: (Last Updated: 01/16/2020)  Show Cumulative Bibliography Listing
 
 None in FY 2020
Back to Search Results