Task Book

Project Title: HCAAM VNSCOR: Responsive Multimodal Human-Automation Communication for Augmenting Human Situation Awareness in Nominal and Off-Nominal Scenarios (80NSSC20K0409)

Reduce

Images:

Fiscal Year: FY 2020
Division: Human Research
Research Discipline/Element:
HRP HFBP:Human Factors & Behavioral Performance (IRP Rev H)

Start Date: 12/04/2019
End Date: 12/03/2023
Task Last Updated: 04/15/2020

Download report in PDF pdf

Principal Investigator/Affiliation: Stirling, Leia Ph.D. / University of Michigan

Address:

Industrial and Operations Engineering
1205 Beal Avenue, G634 IOE Building
Ann Arbor , MI 48109

Email: leias@umich.edu
Phone: 617-324-7410
Congressional District: 12
Web:

Organization Type: UNIVERSITY
Organization Name: University of Michigan
Joint Agency:
Comments: NOTE: PI moved to University of Michigan in fall 2019; previous affiliation was Massachusetts Institute of Technology

Co-Investigator(s)
Affiliation:

Blossom, Jonathon	NASA Jet Propulsion Laboratory
Atkins, Ella Ph.D.	University of Michigan

Project Information: Grant/Contract No. 80NSSC20K0409

Responsible Center: NASA JSC Grant Monitor: Williams, Thomas Center Contact: 281-483-8773 thomas.j.williams-1@nasa.gov	Solicitation: 2017 HERO 80JSC017N0001-BPBA Topics in Biological, Physiological, and Behavioral Adaptations to Spaceflight. Appendix C Grant/Contract No.: 80NSSC20K0409 Project Type: GROUND Flight Program: TechPort: No	No. of Post Docs: No. of PhD Candidates: No. of Master's Candidates: No. of Bachelor's Candidates:	No. of PhD Degrees: No. of Master's Degrees: No. of Bachelor's Degrees:

Human Research Program Elements:	(1) HFBP:Human Factors & Behavioral Performance (IRP Rev H)
Human Research Program Risks:	(1) HFBP HARI:Risk of Inadequate Design of Human and Automation/Robotic Integration (IRP Rev J) (2) HFBP HCI:Risk of Inadequate Human-Computer Interaction (IRP Rev J)
Human Research Program Gaps:	(1) HFBP-HARI-02:We need to develop design guidelines for effective human-automation-robotic systems in operational environments that may include distributed, non-colocated adaptive mixed-agent teams with variable transmission latencies. (Previously: How can performance, efficiency, and safety guidelines be developed for effective information sharing between humans and automation, such that appropriate trust and situation awareness is maintained?; IRP Rev G name change to HARI-02 from previous designation SHFE-HARI-02, which was IRP Rev F) (2) HFBP-HARI-03:We do not know how to quantify overall human-automation-robotic system performance to inform and evaluate system designs to ensure safe and efficient space mission operations (IRP Rev G name change to HARI-03 from previous designation SHFE-HARI-03 (which was IRP Rev F) (Previously: How can performance, efficiency and safety guidelines be developed for appropriate task automation and the effective allocation of tasks between humans and automation?) (3) HFBP-HCI-03:We need HCI guidelines (e.g., display configuration, screen-navigation) to mitigate the performance decrements and operational conditions of long duration spaceflight. (Previous title: SHFE-HCI-03) (IRP Rev H) (4) HFBP-HCI-04:We need to understand how emerging multi-modal and adaptive display and control technologies are best applied to the design of HCI for proposed long-duration DRM (Design Reference Missions) operations. (Previous title: SHFE-HCI-04) (IRP Rev J) (5) HFBP-HCI-06:We need guidelines to ensure crewmembers receive all of the information required to accomplish necessary tasks in a timely fashion, even when operating autonomously. (Previous title: SHFE-HCI-06) (IRP Rev H) (6) HFBP-HCI-07:We need to define the acceptable level of risk for HCI performance relative to terrestrial baselines. (Previous title: SHFE-HCI-08) (IRP Rev H)

Task Description:	[Ed. note April 2020: Continuation of "HCAAM VNSCOR: Responsive Multimodal Human-Automation Communication for Augmenting Human Situation Awareness in Nominal and Off-Nominal Scenarios," grant 80NSSC19K0703, with the same Principal Investigator (PI) Leia Stirling, Ph.D., due to PI move to University of Michigan from Massachusetts Institute of Technology in fall 2019] his task is part of the Human Capabilities Assessments for Autonomous Missions (HCAAM) Virtual NASA Specialized Center of Research (VNSCOR). Crew extravehicular activity (EVA) is limited on spaceflight missions. Multiple, small robotic spacecraft with varying levels of autonomy are needed to perform tasks that might have been completed by an astronaut (e.g., an exterior surface inspection or repair). Crews on long duration exploration missions (LDEM) will have less access to ground support during task operations. As a result, they will need to process more information and communicate with autonomous robots effectively to ensure tasks are progressing safely and on schedule. The objective of these studies is to investigate the use of augmented reality (AR) multimodal interface displays and communication pathways for improving human-robot communication, situation awareness (SA), trust, and task performance. This will lead to developing guidelines for designing human-robot system interactions that enable operational performance for crews on spaceflight missions. The specific aims are to: 1) Develop a simulation testbed for examining communication between human-robot teams. 2) Develop a hardware testbed for examining communication between human-robot teams. 3) Evaluate human SA, trust, and task performance within a short duration and long-duration ground-based study (simulation and/or hardware) through testing various interface communication modalities and information displays. 4) (Option) Perform additional studies for alternate parameters of interest that could be tested using the study testbeds. Additional parameters include timing and persistence of information, gesture command mapping, varying the levels of robot automation, evaluating precision enabled by each command mode.

Research Impact/Earth Benefits:	Augmented Reality (AR) has opportunity to support decision making across a variety of use-case scenarios, including but not limited to manufacturing, automated vehicles, military training, and entertainment. This research compares AR to other visual modalities for telerobotics applications, specifically considering robotic control and anomaly inspection. Results from this study can inform how AR is integrated for task-specific applications, as there may be tasks that have increased benefit from AR, whereas others may have additional considerations that emerge.

Task Progress & Bibliography Information FY2020

Task Progress:	New project for FY2020. NOTE (Ed., 4/15/2020) this is a continuation of "HCAAM VNSCOR: Responsive Multimodal Human-Automation Communication for Augmenting Human Situation Awareness in Nominal and Off-Nominal Scenarios," grant 80NSSC19K0703, due to PI Dr. Leia Stirling's move to University of Michigan from Massachusetts Institute of Technology in fall 2019. See that project for previous reporting.

Bibliography Type:	Description: (Last Updated: 01/16/2020) Show Cumulative Bibliography Listing
	None in FY 2020

Menu