Project Title:  HCAAM VNSCOR: Enabling Autonomous Crew Task Performance with Multimodal Electronic Procedure Countermeasure Reduce
Images: icon  Fiscal Year: FY 2019 
Division: Human Research 
Research Discipline/Element:
HFBP:Human Factors & Behavioral Performance (IRP Rev H) 
Start Date: 04/15/2019  
End Date: 01/14/2020  
Task Last Updated: 03/29/2019 
Download report in PDF pdf
Principal Investigator/Affiliation:   Robinson, Stephen K Ph.D. / University of California, Davis 
Address:  Department of Mechanical & Aerospace Engineering 
1 Shields Avenue, 2132 Bainer Hall 
Davis , CA 95616-5270 
Phone: 530-752-9541  
Congressional District:
Organization Type: UNIVERSITY 
Organization Name: University of California, Davis 
Joint Agency:  
Hillenius, Steven  M.S. NASA Ames Research Center 
Joyce, Richard  Ph.D. San Jose State University Research Foundation 
Karasinski, John  M.S. NASA Ames Research Center 
Project Information: Grant/Contract No. 80NSSC19K0657 
Responsible Center: NASA JSC 
Grant Monitor: Williams, Thomas  
Center Contact: 281-483-8773 
Solicitation: 2017 HERO 80JSC017N0001-BPBA Topics in Biological, Physiological, and Behavioral Adaptations to Spaceflight. Appendix C 
Grant/Contract No.: 80NSSC19K0657 
Project Type: GROUND 
Flight Program:  
TechPort: No 
No. of Post Docs:  
No. of PhD Candidates:  
No. of Master's Candidates:  
No. of Bachelor's Candidates:  
No. of PhD Degrees:  
No. of Master's Degrees:  
No. of Bachelor's Degrees:  
Human Research Program Elements: (1) HFBP:Human Factors & Behavioral Performance (IRP Rev H)
Human Research Program Risks: (1) HCI:Risk of Inadequate Human-Computer Interaction
 (2) MPTASK:Risk of Inadequate Mission, Process and Task Design (IRP Rev H)
 (3) Team:Risk of Performance and Behavioral Health Decrements Due to Inadequate Cooperation, Coordination, Communication, and Psychosocial Adaptation within a Team (IRP Rev F)
Human Research Program Gaps: (1) HFBP-HCI-03:We need HCI guidelines (e.g., display configuration, screen-navigation) to mitigate the performance decrements and operational conditions of long duration spaceflight. (Previous title: SHFE-HCI-03) (IRP Rev H)
 (2) HFBP-HCI-04:We need to understand how emerging multi-modal and adaptive display and control technologies are best applied to the design of HCI for proposed long-duration DRM (Design Reference Missions) operations. (Previous title: SHFE-HCI-04) (IRP Rev J)
 (3) HFBP-HCI-06:We need guidelines to ensure crewmembers receive all of the information required to accomplish necessary tasks in a timely fashion, even when operating autonomously. (Previous title: SHFE-HCI-06) (IRP Rev H)
 (4) MPTASK-02:We need methods and tools to support mission, process, and task design. (Previous title: SHFE-TASK-02) (IRP Rev H)
 (5) Team Gap 06:We need to identify methods to support and enable multiple distributed teams to manage shifting levels of autonomy during long duration and/or distance exploration missions (IRP Rev E)
Task Description: This task is part of the Human Capabilities Assessments for Autonomous Missions (HCAAM) Virtual NASA Specialized Center of Research (VNSCOR).

Future long duration exploration missions (LDEM) conducted by NASA will have an increased need for crew autonomy during routine and emergency procedures, due to the increased distance from Earth causing time delays in communications. Presently, many procedures are completed with constant communication between the crewmembers and mission control personnel. This need for increased autonomy will lead to a need for more information being stored on board and accessed by crewmembers in a timely and context appropriate manner during procedural execution. Emergent technologies in multimodal interaction such as augmented reality (AR) visual displays, spatial audio, and tactile feedback are likely to play a role in mitigating this need, leading to what we define as "enhanced electronic procedures." In this proposal we outline a research study which will use a multimodal enhanced electronic procedure to determine the best tasks and cues to pair with sensory channels for procedural execution tasks. Past efforts by our group have investigated procedural tasks using new technologies such as augmented reality and haptic cues. A ground-based research study will determine the effects of crew performance, situational awareness, and trust with the use of multimodal enhanced electronic procedures compared to traditional unimodal electronic procedures. The results of the ground-based study will lead to deployment in an analog mission for validation in a flight-like environment. From the lab and analog results, we will formulate recommendations for updated standards and guidelines for multimodal interaction and electronic procedures.

Research Impact/Earth Benefits:

Task Progress & Bibliography Information FY2019 
Task Progress: New project for FY2019.

Bibliography Type: Description: (Last Updated: )  Show Cumulative Bibliography Listing
 None in FY 2019