Menu

 

The NASA Task Book
Advanced Search     

Project Title:  Manual Crew Override of Vehicle Landings Following G-Transitions Reduce
Images: icon  Fiscal Year: FY 2025 
Division: Human Research 
Research Discipline/Element:
HRP HHC:Human Health Countermeasures
Start Date: 04/04/2022  
End Date: 09/30/2032  
Task Last Updated: 02/05/2025 
Download Task Book report in PDF pdf
Principal Investigator/Affiliation:   Wood, Scott J. Ph.D. / NASA Johnson Space Center 
Address:  2101 NASA Parkway 
Mail code SD2 
Houston , TX 77058 
Email: scott.j.wood@nasa.gov 
Phone: (281) 483-6329  
Congressional District: 36 
Web:  
Organization Type: NASA CENTER 
Organization Name: NASA Johnson Space Center 
Joint Agency:  
Comments: NOTE: PI returned to NASA JSC in January 2017. PI was at Azusa Pacific University from August 2013 – January 2017; prior to August 2013, PI was at NASA JSC. 
Co-Investigator(s)
Affiliation: 
Duda, Kevin  Ph.D. Draper Laboratory 
Wheelock, Douglas  M.S. NASA Johnson Space Center 
Young, Millennia  Ph.D. NASA Johnson Space Center 
Weiss, Hannah  NASA Johnson Space Center 
Key Personnel Changes / Previous PI: Hannah Weiss has been added as a Co-Investigator.
Project Information: Grant/Contract No. Directed Research 
Responsible Center: NASA JSC 
Grant Monitor: Brocato, Becky  
Center Contact:  
becky.brocato@nasa.gov 
Unique ID: 15190 
Solicitation / Funding Source: Directed Research 
Grant/Contract No.: Directed Research 
Project Type: Flight,Ground 
Flight Program: ISS 
TechPort: No 
No. of Post Docs:
No. of PhD Candidates:
No. of Master's Candidates:
No. of Bachelor's Candidates:
No. of PhD Degrees:
No. of Master's Degrees:
No. of Bachelor's Degrees:
Human Research Program Elements: (1) HHC:Human Health Countermeasures
Human Research Program Risks: None
Human Research Program Gaps: None
Task Description: Manual control during exploration spaceflight consists of both planned automated supervisory control and unplanned crew override. This crew override capability is critical to enable overall mission success during landing contingencies. However, the introduction of manual override capabilities must be implemented to enable crews to mitigate risks introduced by human error. Adaptive changes in the sensorimotor system can manifest during G-transitions as spatial disorientation. While training and landing aids enable successful landing through disorientation, these adaptive changes may increase cognitive demand that need to be accounted for in the manual control strategy. It is important to characterize these effects as soon as possible following the G-transition. The primary goals of this study are (1) to understand the impact of spaceflight on crew ability to perform manual crew override tasks including the effect of flight duration, (2) to examine how adaptive changes in vestibular and cognitive function relate to changes in manual crew override proficiency, and (3) compare performance during late in-flight “just-in-time” on-board training with early post-flight crew performance. This study will recruit astronauts assigned to either short duration Private Astronaut Missions (PAM, < 30 day) or long duration (6-month) missions to the International Space Station (ISS). Ground matched-control subjects tested with the same schedule will enable us to assess the effects of learning and/or recency independent of spaceflight.

Our first aim is to characterize the impact of spaceflight on crew capability to perform automated supervisory control and manual landing tasks involving crew override following both short (PAM) and longer duration ISS missions. The impact of spaceflight on piloting capability will be assessed from pre- versus post-flight changes in a simulated lunar landing during which crewmembers will manually takeover attitude and rate-of-descent to the nominal or re-designated landing aimpoint during the approach phase. This simulation will be performed on portable fixed base soon after return from ISS at the rally airport and then on R+1 using a 6DOF motion base at JSC. Subjects will also perform an automated supervisory control on a portable tablet. During this task, subjects will monitor simulation of an out-the-window display during lunar approach to determine if they need to execute a divert to an alternate landing site and use a touch screen to select the site that is within the desired landing zone and free of obstacles. The outcome measures include the percent time maintaining actual vehicle states, e.g., attitude and rate-of-descent, within recommended guidance during the landing approach, number and maximum deviation outside limits, time to execute divert to alternate landing site (if needed), error rates. The cognitive performance measures during the simulation will focus on multi-tasking in which crewmembers will respond to display prompts as a secondary task, as well as eye-head tracking to characterize visual reaction times and areas of visual attention during the simulation. We hypothesize that there will be post-flight increases in error rates and time to execute corrective actions.

Our second aim is to examine how adaptive changes in vestibular and cognitive function relate to proficiency during supervisory manual control and crew override. The sensorimotor and cognitive test battery is based on a previous manual control study by Moore et al (2019) in which astronauts exhibited significant changes in motion perception, dual-tasking and sleepiness. The dual-tasking has been embedded in both tablet and piloting tasks. Motion perception accuracy and precision has been integrated with motion-base sim at JSC. Motion sickness & sleepiness will be obtained at all timepoints. We hypothesize that that a higher severity of vestibular alterations will be associated with increased flight increases in error rates and time to execute corrective actions.

Given that ‘just-in-time” on-board training is an operational expectation for the extended exploration missions, all participants will perform late inflight JIT training. Crew proficiency will be captured inflight during on-board training that will be implemented on a laptop with hand controllers to allow the crewmember to practice the landing task procedures, like the approach implemented for on-board training with Shuttle landing and ISS telerobotic tasks. The metrics captured during the on-board lunar landing simulations will match those of the pre- and postflight simulations. We hypothesize that that proficiency on the “just-in-time” laptop trainer late in mission will be positively correlated with early post-flight proficiency on the same task.

This project will deliver an operational demonstration of automated supervisory control and crew override capability following spaceflight and identify potential deficits that may require remediation. Comparison of individual vestibular and cognitive changes with crew override performance will help better characterize the manual control risks associated with sensorimotor alterations. Comparing performance parameters from the on-board training to post-flight performance will help demonstrate transfer of inflight on-board training to post-flight manual crew override performance. The inclusion of “just-in-time” on-board training will ensure we are characterizing changes in override proficiency with this expected countermeasure in place.

Rationale for HRP Directed Research: This research is directed because it contains highly constrained research. This flight study addresses the sensorimotor research emphasis stated in the Human Research Program (HRP) Integrated Research Plan titled “Risk of Altered Sensorimotor/Vestibular Function Impacting Critical Mission Tasks”. One gap associated with this risk (SM-102) is to “characterize the effects of short and long-duration weightlessness on manual control after G-transitions.” This research gap led to the solicitation of a manual control study conducted before and after long duration flights on the ISS to map changes in sensorimotor function to manual control decrements. Unfortunately, these results (Moore et al., 2019) were limited due to testing delays related to time required for direct returns from Kazakhstan, with the initial measurements conducted more than 20 hr following landing. The approach of this investigation is to leverage the commercial crew landings in the US to obtain measurements as early as possible. While the Moore study used a T-38 X-plane simulation, we will obtain measures during actual T-38 flights. We will also add a lunar landing simulation based on the current concept of operations for the HLS. Further refinements are also proposed in the sensorimotor and cognitive test battery based on the previous study.

Research Impact/Earth Benefits: Sensorimotor function is critical for spatial orientation, gaze stabilization, and postural stability. This project examines how adaptive changes in sensorimotor and cognitive function may increase the risk of impaired ability to maintain control of vehicles and other complex systems. The goal is to map changes in physiological function with functional measures of manual control. Establishing these relationships will be relevant to how pathophysiological impairments in sensorimotor processing may affect other vehicular control tasks, such as driving with vestibular patients. This study will also be relevant to the development of strategies of how best to allow individuals with impairments perform a manual control override of autonomous driving vehicles. As Shuttle missions were extended, the on-orbit training countermeasure tool became extremely useful for commanders and pilots to practice the landing task sequence to maintain task proficiency. The ability to retain and/or assess manual control efficiency via a simple laptop-based simulation will impact our crew override approach for extended exploration missions. This approach can be easily adapted to a wide variety of simulated vehicle designs to provide similar assessments in other operational and civilian populations.

Task Progress & Bibliography Information FY2025 
Task Progress: During this past year, progress was made in three key areas: (a) hardware and software integration, (b) flight study integration, and (c) supporting ground studies.

Hardware and Software Integration: Substantial progress was achieved in the software development of the Lunar Landing Simulation (LLSim) provided by The Charles Stark Draper Laboratory (Draper). The LLSim is the key component utilized across all sessions of testing in both the ground and flight studies. The LLSim is directly integrated with the 6DOF motion base, the portable simulator, and the Robotic On-Board Trainer (ROBoT) hand controllers and ROBoT computers for in-flight integration. An overview of this simulation was presented at the recent NASA Human Research Program (HRP) Investigators' Workshop (Weiss et al. 2025).

The Draper, Dynamics Skills Training (DST), and Neuroscience teams made a focused effort to develop, test, and release an integrated LLSim module within the ROBoT architecture, designed to operate with the ROBoT-specific hand controllers and 6DoF motion base across two distinct platforms: a ground simulator and inflight simulator. While both the ground and flight platforms share similar hardware, unique solutions are required to successfully provide the LLSim software across these platforms. For example, the team pursued two distinct licensing solutions for the embedded image generation software providing the lunar surface visualization. The team collaborated through two sequential ROBoT updates and nine LLSim releases to provide a functional simulator environment on a two-laptop configuration to enable the ground and flight studies. Efforts continue towards providing a DST-like workstation computer to enable testing at the postflight testing sites; example, fixed-base operator (FBO) airports.

The team is approaching certification of the LLSim for uplink to the International Space Station (ISS). A detailed certification protocol has been provided by Draper to evaluate each aspect of the LLSim software to ensure all intended actions and outcomes are supported. Preparation for testing in the Joint Station LAN (JSL) is complete, including approval for use of the ROBoT hand controllers. A target date for testing will be established when the final version of the LLSim is released from Draper. JSL testing will serve as a ground verification before uplink to Station. Once inflight, the LLSim will also be evaluated through a functional checkout. The functional checkout procedures have been generated and will be performed as non-human research by one of the crewmembers on Station. Submission of the required materials related to this non-human research have been approved by the Institutional Review Board (IRB) for implementation. The research team carefully developed a specified set of trial matrices with varying difficulty to administer across all testing sessions, encompassing preflight, inflight, and postflight sessions. Draper and DST are in the process of integrating these trial matrices into the LLSim via a patch. The integration will be completed and fully tested before the first consent crewmember begins the study. The NASA Research Operations and Integration (ROI) team facilitated communications between the research team and the NASA Marshall Space Flight Center (Marshall) Payload Operations Integration Center (POIC) to evaluate the LLSim display and user interface for adherence to the human factors standards and NASA Johnson Space Center (JSC) operations nomenclature database. Final approval from the POIC team is pending.

We collaborated with the Simulation and Graphics Branch of the NASA Engineering Directorate to develop an iOS-based multi-attribute supervisory control lunar tablet task (McDonnell et al. 2025). The Simulations and Graphics Branch (ER7) provided videos of thirty lunar landing scenarios modulating various landings sites, sun angles, camera modes, landing hazards, and navigation bias. An engineering Pathways intern integrated these videos into an iOS-based application, wrote algorithms for scenario selection, generated dual-tasking user interface elements, and developed data offload procedures for dependent measures of interest. The application is currently on the eighteenth iteration and is in a functional state to support testing. The code base has been transferred to the NASA Johnson Space Center Neuroscience Laboratory for maintenance. Future planned updates to the code base and application include a post-task summary of user performance and modifications to the user interface to promote easier scenario and trial selections. Note that the iOS platform was chosen to be compatible with tablets available in the SpaceX Dragon to leverage earlier postflight landing data collections on either ISS or free-flyer missions. A similar supervisory task will be developed for the Orion capsule during early NASA Artemis missions as part of a separate study.

We are finalizing a vestibular nulling task on the 6DoF motion base with visual vection to incorporate into the sensorimotor test battery administered during the preflight and postflight testing sessions of the flight study. The development of this capability is an extension of the initial work provided by a Master’s Degree student within the Neuroscience Lab (Bollinger 2024). This will include nulling motion with visual vection to better duplicate conditions on Apollo, where blowing dust obscured visibility during descent and appeared to contribute to variability in nulling horizontal rates, similar to brown-out disorientation during helicopter hover (Wagner 2006).

Flight Study Integration: During this past year, the Select for Flight change request (CR) was approved by the HRP Control Board. ROI facilitated the creation of the experiment document (ED) for review and approval by the Configuration Control Board (CCB). Approval was obtained in January 2025. Informed crew briefings (ICB) were provided to Crew 11 and Starliner-1. The first consent was obtained from a Crew-11 crewmember. Preflight testing sessions for the first crewmember and ICBs for Crew 12 are scheduled in February 2025. The research and ROI team completed a test readiness review (TRR) for the flight study. The final TRR approval will be obtained before the first crew test.

Supporting Ground Studies: We designed a well-defined testing protocol for the ground study to evaluate the simulated lunar landing performance of thirty healthy non-astronaut volunteers across five distinct testing sessions to inform learning progression and establish a baseline of performance. A set of LLSim trial matrices were designed to enhance participant learning and task proficiency, while maintaining a balance in task difficulty. These trial matrices were provided to Draper and DST for integration into the LLSim in the form of a patch. The results from this study seek to inform and improve efficiency of the familiarization and training sessions for the flight study.

The team managed IRB modifications and obtained approval for the ground study in October 2024. The research team also performed a test readiness review (TRR) with the NASA JSC Building 21 TRR Board, test safety officer (TSO), and medical monitor. TRR approval for the ground study was obtained in January 2025 and human testing began shortly after. Forty testing sessions are targeted to be completed before the first session of the first consented crewmember. Specialized code development is ongoing to analyze the various datasets. The ground study has been an excellent testing platform for both the hardware and software, helping identify any updates that need to be made before crew testing.

Bibliography: Description: (Last Updated: 06/03/2025) 

Show Cumulative Bibliography
 
Abstracts for Journals and Proceedings Weiss HM, Bollinger AM, Duda KR, Wheelock DH, Wood SJ. "Manual crew override of vehicle landings following g-transitions." 2025 NASA Human Research Program Investigators’ Workshop, Galveston, TX, January 28-31, 2025.

Abstracts. 2025 NASA Human Research Program Investigators' Workshop, Galveston, Texas, January 28-31, 2025. , Jan-2025

Abstracts for Journals and Proceedings McDonnell MD, Weiss HM, Gentile J, Tooher K, Hunt T, Herring M, Weno B, Wood SJ. "Supervisory control with dual tasking in post g-transition vehicle landings." 2025 NASA Human Research Program Investigators’ Workshop, Galveston, TX, January 28-31, 2025.

Abstracts. 2025 NASA Human Research Program Investigators' Workshop, Galveston, Texas, January 28-31, 2025. , Jan-2025

Dissertations and Theses Bollinger AM. "Optimizing noisy galvanic vestibular stimulation for enhancing vestibular perception and manual control performance." Dissertation, University of Houston, May 2024. , May-2024
Project Title:  Manual Crew Override of Vehicle Landings Following G-Transitions Reduce
Images: icon  Fiscal Year: FY 2024 
Division: Human Research 
Research Discipline/Element:
HRP HHC:Human Health Countermeasures
Start Date: 04/04/2022  
End Date: 09/30/2032  
Task Last Updated: 04/29/2024 
Download Task Book report in PDF pdf
Principal Investigator/Affiliation:   Wood, Scott J. Ph.D. / NASA Johnson Space Center 
Address:  2101 NASA Parkway 
Mail code SD2 
Houston , TX 77058 
Email: scott.j.wood@nasa.gov 
Phone: (281) 483-6329  
Congressional District: 36 
Web:  
Organization Type: NASA CENTER 
Organization Name: NASA Johnson Space Center 
Joint Agency:  
Comments: NOTE: PI returned to NASA JSC in January 2017. PI was at Azusa Pacific University from August 2013 – January 2017; prior to August 2013, PI was at NASA JSC. 
Co-Investigator(s)
Affiliation: 
Duda, Kevin  Ph.D. Draper Laboratory 
Wheelock, Douglas  M.S. NASA Johnson Space Center 
Young, Millennia  Ph.D. NASA Johnson Space Center 
Key Personnel Changes / Previous PI: Steven Moore and Raymond Heineman have been removed due to changes in the experiment protocol, including removal of the inflight piloting task (T-38 and Pilatus PC-12) and changes to the test battery. Michael Bishop resigned from his KBR position.
Project Information: Grant/Contract No. Directed Research 
Responsible Center: NASA JSC 
Grant Monitor: Brocato, Becky  
Center Contact:  
becky.brocato@nasa.gov 
Unique ID: 15190 
Solicitation / Funding Source: Directed Research 
Grant/Contract No.: Directed Research 
Project Type: Flight 
Flight Program: ISS 
TechPort: No 
No. of Post Docs:
No. of PhD Candidates:
No. of Master's Candidates:
No. of Bachelor's Candidates:
No. of PhD Degrees:
No. of Master's Degrees:
No. of Bachelor's Degrees:
Human Research Program Elements: (1) HHC:Human Health Countermeasures
Human Research Program Risks: None
Human Research Program Gaps: None
Task Description: Manual control during exploration spaceflight consists of both planned automated supervisory control and unplanned crew override. This crew override capability is critical to enable overall mission success during landing contingencies. However, the introduction of manual override capabilities must be implemented to enable crews to mitigate risks introduced by human error. Adaptive changes in the sensorimotor system can manifest during G-transitions as spatial disorientation. While training and landing aids enable successful landing through disorientation, these adaptive changes may increase cognitive demand that need to be accounted for in the manual control strategy. It is important to characterize these effects as soon as possible following the G-transition. The primary goals of this study are (1) to understand the impact of spaceflight on crew ability to perform manual crew override tasks including the effect of flight duration, (2) to examine how adaptive changes in vestibular and cognitive function relate to changes in manual crew override proficiency, and (3) compare performance during late in-flight “just-in-time” on-board training with early post-flight crew performance. This study will recruit astronauts assigned to either short duration Private Astronaut Missions (PAM, < 30 day) or long duration (6-month) missions to the International Space Station (ISS). Ground matched-control subjects tested with the same schedule will enable us to assess the effects of learning and/or recency independent of spaceflight.

Our first aim is to characterize the impact of spaceflight on crew capability to perform automated supervisory control and manual landing tasks involving crew override following both short (PAM) and longer duration ISS missions. The impact of spaceflight on piloting capability will be assessed from pre- versus post-flight changes in a simulated lunar landing during which crewmembers will manually takeover attitude and rate-of-descent to the nominal or re-designated landing aimpoint during the approach phase. This simulation will be performed on portable fixed base soon after return from ISS at the rally airport and then on R+1 using a 6DOF motion base at JSC. Subjects will also perform an automated supervisory control on a portable tablet. During this task, subjects will monitor simulation of an out-the-window display during lunar approach to determine if they need to execute a divert to an alternate landing site and use a touch screen to select the site that is within the desired landing zone and free of obstacles. The outcome measures include the percent time maintaining actual vehicle states, e.g., attitude and rate-of-descent, within recommended guidance during the landing approach, number and maximum deviation outside limits, time to execute divert to alternate landing site (if needed), error rates. The cognitive performance measures during the simulation will focus on multi-tasking in which crewmembers will respond to display prompts as a secondary task, as well as eye-head tracking to characterize visual reaction times and areas of visual attention during the simulation. We hypothesize that there will be post-flight increases in error rates and time to execute corrective actions.

Our second aim is to examine how adaptive changes in vestibular and cognitive function relate to proficiency during supervisory manual control and crew override. The sensorimotor and cognitive test battery is based on a previous manual control study by Moore et al (2019) in which astronauts exhibited significant changes in motion perception, dual-tasking and sleepiness. The dual-tasking has been embedded in both tablet and piloting tasks. Motion perception accuracy and precision has been integrated with motion-base sim at JSC. Motion sickness & sleepiness will be obtained at all timepoints. We hypothesize that that a higher severity of vestibular alterations will be associated with increased flight increases in error rates and time to execute corrective actions.

Given that ‘just-in-time” on-board training is an operational expectation for the extended exploration missions, all participants will perform late inflight JIT training. Crew proficiency will be captured inflight during on-board training that will be implemented on a laptop with hand controllers to allow the crewmember to practice the landing task procedures, like the approach implemented for on-board training with Shuttle landing and ISS telerobotic tasks. The metrics captured during the on-board lunar landing simulations will match those of the pre- and postflight simulations. We hypothesize that that proficiency on the “just-in-time” laptop trainer late in mission will be positively correlated with early post-flight proficiency on the same task.

This project will deliver an operational demonstration of automated supervisory control and crew override capability following spaceflight and identify potential deficits that may require remediation. Comparison of individual vestibular and cognitive changes with crew override performance will help better characterize the manual control risks associated with sensorimotor alterations. Comparing performance parameters from the on-board training to post-flight performance will help demonstrate transfer of inflight on-board training to post-flight manual crew override performance. The inclusion of “just-in-time” on-board training will ensure we are characterizing changes in override proficiency with this expected countermeasure in place.

Rationale for HRP Directed Research: This research is directed because it contains highly constrained research. This flight study addresses the sensorimotor research emphasis stated in the Human Research Program (HRP) Integrated Research Plan titled “Risk of Altered Sensorimotor/Vestibular Function Impacting Critical Mission Tasks”. One gap associated with this risk (SM-102) is to “characterize the effects of short and long-duration weightlessness on manual control after G-transitions.” This research gap led to the solicitation of a manual control study conducted before and after long duration flights on the ISS to map changes in sensorimotor function to manual control decrements. Unfortunately, these results (Moore et al., 2019) were limited due to testing delays related to time required for direct returns from Kazakhstan, with the initial measurements conducted more than 20 hr following landing. The approach of this investigation is to leverage the commercial crew landings in the US to obtain measurements as early as possible. While the Moore study used a T-38 X-plane simulation, we will obtain measures during actual T-38 flights. We will also add a lunar landing simulation based on the current concept of operations for the HLS. Further refinements are also proposed in the sensorimotor and cognitive test battery based on the previous study.

Research Impact/Earth Benefits: Sensorimotor function is critical for spatial orientation, gaze stabilization, and postural stability. This project examines how adaptive changes in sensorimotor and cognitive function may increase the risk of impaired ability to maintain control of vehicles and other complex systems. The goal is to map changes in physiological function with functional measures of manual control. Establishing these relationships will be relevant to how pathophysiological impairments in sensorimotor processing may affect other vehicular control tasks, such as driving with vestibular patients. This study will also be relevant to the development of strategies of how best to allow individuals with impairments perform a manual control override of autonomous driving vehicles. As Shuttle missions were extended, the on-orbit training countermeasure tool became extremely useful for commanders and pilots to practice the landing task sequence to maintain task proficiency. The ability to retain and/or assess manual control efficiency via a simple laptop-based simulation will impact our crew override approach for extended exploration missions. This approach can be easily adapted to a wide variety of simulated vehicle designs to provide similar assessments in other operational and civilian populations.

Task Progress & Bibliography Information FY2024 
Task Progress: Flight study integration: During this past year the feasibility assessment by the Research Operations and Integration Element was completed and the Select for Flight CR (change request) was reviewed by the NASA Human Research Program (HRP) Control Board on 25 April 2024. Pending approval and completion of hardware integration, operations can begin as soon as USCV-11 (launching September 2025) for the International Space Station (ISS) crew and PAM-6 (launch late 2025/early 2026). As part of the Feasibility Assessment, there was a change in the scope of the ground measurements to accommodate early postflight testing constraints. A portable fixed base simulation will now be used to perform early testing at the rally airports before the crews return to NASA Johnson Space Center (JSC) for the motion base simulation and sensorimotor test battery on R+1. A new tablet-based simulation will be implemented at multiple time points (R+0, 1 and 4 days) to track the recovery of operational multi-tasking during supervisory control of an automated landing.

Piloting simulation development: The lunar landing simulation involving piloting using hand controllers has been integrated into the Robotic On-Board Trainer (ROBoT, Ivkovic et al. 2019) and the CKAS motion base similar to that used in the prior study (Moore et al. 2019). There has been ongoing communication to align the simulation, developed by Draper, to be closely aligned with Artemis Human Landing System (HLS) and Flight Operations Directorate (FOD) training simulations that will be utilized for basic skills training using the HLS design reference vehicle. During this simulation, crewmembers will have the responsibility of monitoring the automatic flight trajectory before being tasked to manually take over and control the attitude and rate-of-descent to the nominal or re-designated landing aimpoint during the approach phase. The primary task of the pilot is to control the flight path and attitude of the lunar lander, with workload measured by secondary tasks requiring subject input (Duda et al. 2015), point of regard using eye tracking (Cheung and Hofer 2003) and a modified Bedford Workload scale following each trial (Hainley et al. 2013). In addition to the motion base simulation, a fixed-based simulation has been developed for early testing at the rally airport and has been designed to facilitate early postflight testing.

Multi-Attribute Lunar Tablet Battery Task Software: This portable tablet task provides a set of tasks representative of supervisory control of automated lunar landings, including monitoring enhanced camera display to determine when/if a redesignation of the landing aimpoint is required while monitoring other system displays and warnings that require user inputs. Subjects will monitor the simulation of an out-the-window display during lunar approach to determine if they need to execute a divert to an alternate landing site and use a touch screen to select the site that is within the desired landing zone and free of obstacles.

Sensorimotor test battery: The dual-tasking has now been embedded in both tablet and piloting tasks. Motion perception accuracy and precision have been integrated with motion-base sim at JSC. Motion sickness and sleepiness will be obtained at all time points. During this past year, the motion perception measures were implemented on the new CKAS motion base and a pilot study was conducted on eighteen healthy subjects who performed direction-recognition vestibular thresholds in roll-tilt and inter-aural translation, perceptual roll-tilt motion tracking, and a manual control nulling task. This study also supported a master’s student in Bioengineering (A. Bollinger) who investigated the optimization of noisy galvanic vestibular stimulation for enhancing vestibular perception and manual control performance. Using a time-optimized approach with a three-down, one-up staircase over 60 trials, the thresholds of the motion perception paradigm yielded results for the baseline none condition in the ranges of previously published literature for inter-aural translation and roll-tilt (Galvan-Garza et al. 2018; Keywan et al. 2019). For the perceptual motion tracking, we implemented a roll-tile motion tracking sum-of-sines over a frequency range of 0.18 – 0.664 Hz (Rosenberg et al. 2018). Both types of perceptual tracking tasks are proposed to help examine how changes in vestibular function relate to proficiency during supervisory and manual control landings (Aim 2).

Bibliography: Description: (Last Updated: 06/03/2025) 

Show Cumulative Bibliography
 
Abstracts for Journals and Proceedings Bollinger AM, Duda KR, Wheelock DH, Moore ST, Wood SJ. "Manual crew override of vehicle landings following G-transitions." 2024 NASA Human Research Program Investigators’ Workshop, Galveston, Texas, February 13-16, 2024.

Abstracts. 2024 NASA Human Research Program Investigators’ Workshop, Galveston, Texas, February 13-16, 2024. , Feb-2024

Project Title:  Manual Crew Override of Vehicle Landings Following G-Transitions Reduce
Images: icon  Fiscal Year: FY 2023 
Division: Human Research 
Research Discipline/Element:
HRP HHC:Human Health Countermeasures
Start Date: 04/04/2022  
End Date: 09/30/2032  
Task Last Updated: 02/06/2023 
Download Task Book report in PDF pdf
Principal Investigator/Affiliation:   Wood, Scott J. Ph.D. / NASA Johnson Space Center 
Address:  2101 NASA Parkway 
Mail code SD2 
Houston , TX 77058 
Email: scott.j.wood@nasa.gov 
Phone: (281) 483-6329  
Congressional District: 36 
Web:  
Organization Type: NASA CENTER 
Organization Name: NASA Johnson Space Center 
Joint Agency:  
Comments: NOTE: PI returned to NASA JSC in January 2017. PI was at Azusa Pacific University from August 2013 – January 2017; prior to August 2013, PI was at NASA JSC. 
Co-Investigator(s)
Affiliation: 
Duda, Kevin  Ph.D. Draper Laboratory 
Heineman, Raymond  M.S. NASA Johnson Space Center 
Moore, Steven  Ph.D. Central Queensland University, Rockhampton, Australia 
Wheelock, Douglas  M.S. NASA Johnson Space Center 
Young, Millennia  Ph.D. NASA Johnson Space Center 
Bishop, Michael  M.S. NASA Johnson Space Center 
Key Personnel Changes / Previous PI: Michael Barratt, MD was assigned to a future ISS mission and was removed due to conflicts with crew training. Millard Reschke, PhD retired.
Project Information: Grant/Contract No. Directed Research 
Responsible Center: NASA JSC 
Grant Monitor: Brocato, Becky  
Center Contact:  
becky.brocato@nasa.gov 
Unique ID: 15190 
Solicitation / Funding Source: Directed Research 
Grant/Contract No.: Directed Research 
Project Type: Flight 
Flight Program: ISS 
TechPort: No 
No. of Post Docs:
No. of PhD Candidates:
No. of Master's Candidates:
No. of Bachelor's Candidates:
No. of PhD Degrees:
No. of Master's Degrees:
No. of Bachelor's Degrees:
Human Research Program Elements: (1) HHC:Human Health Countermeasures
Human Research Program Risks: None
Human Research Program Gaps: None
Task Description: Manual control during exploration spaceflight consists of both planned automated supervisory control and unplanned crew override. This crew override capability is critical to enable overall mission success during landing contingencies. However, the introduction of manual override capabilities must be implemented to enable crews to mitigate risks introduced by human error. Adaptive changes in the sensorimotor system can manifest during G-transitions as spatial disorientation. While training and landing aids enable successful landing through disorientation, these adaptive changes may increase cognitive demand that need to be accounted for in the manual control strategy. It is important to characterize these effects as soon as possible following the G-transition. The primary goals of this study are (1) to understand the impact of spaceflight on crew ability to perform manual crew override tasks, (2) to examine how adaptive changes in vestibular and cognitive function relate to changes in manual crew override proficiency, and (3) compare performance during late in-flight “just-in-time” on-board training with early post-flight crew performance. This study will recruit astronauts assigned to either short duration Private Astronaut Missions (PAM, < 30 day) or long duration (6-month) missions to the International Space Station (ISS). Ground matched-control subjects tested with the same schedule will enable us to assess the effects of learning and/or recency independent of spaceflight.

Our first aim is to examine the impact of spaceflight on piloting capability will be assessed from pre- versus post-flight changes in a simulated lunar landing during which crewmembers will manually takeover attitude and rate-of-descent to the nominal or re-designated landing aimpoint during the approach phase. This simulation will be conducted on a six degree-of-freedom (6DOF) platform that can provide concurrent vestibular motion cues during the simulation. An alternative inflight simulator using a Pilatus PC-12 aircraft is under evaluation to enable earlier post-flight testing. The outcome measures the crew override tasks include the percent time maintaining actual vehicle states, e.g., attitude and rate-of-descent, within recommended guidance during the landing approach, number and maximum deviation outside limits and root mean square error (RMSE). The cognitive performance measures during the simulation will focus on multi-tasking in which crewmembers will respond to display prompts as a secondary task, as well as eye-head tracking to characterize visual reaction times and areas of visual attention during the simulation. We hypothesize that there will be post-flight increases in the percent time that pilots are outside of the acceptable range for recommended vehicle state parameters.

Our second aim is to examine how adaptive changes in vestibular and cognitive function relate to proficiency during supervisory manual control and crew override. The sensorimotor and cognitive test battery will leverage the most sensitive test conditions utilized in our previous manual control study by Moore et al (2019) in which astronauts exhibited significant changes in motion perception, manual dexterity, dual-tasking and sleepiness. We are also including three new measures including quantitative measures of motion sickness symptoms, tilt perceptual precision and eye-hand coordination. We hypothesize that that a higher severity of vestibular alterations will be associated with increased percent time outside of guidance limits during both types of piloting tasks.

Given that ‘just-in-time” (JIT) on-board training is an operational expectation for the extended exploration missions, all participants will perform late inflight JIT training. Crew proficiency will be captured inflight during JIT training that will be implemented on a laptop with hand controllers to allow the crewmember to practice the landing task procedures, like the approach implemented for JIT training with Shuttle landing and ISS telerobotic tasks. The metrics captured during the JIT lunar landing simulations will match those of the pre- and postflight simulations. We hypothesize that that proficiency on the “just-in-time” laptop trainer late in mission will be positively correlated with early post-flight proficiency on the same task.

This project will deliver an operational demonstration of crew override capability following spaceflight and identify potential deficits that may require remediation. Comparison of individual vestibular and cognitive changes with crew override performance will help better characterize the manual control risks associated with sensorimotor alterations. Comparing performance parameters from the JIT training to post-flight performance will help demonstrate transfer of inflight JIT training to post-flight manual crew override performance. The inclusion of “just-in-time” training will ensure we are characterizing changes in override proficiency with this expected countermeasure in place.

Rationale for HRP Directed Research: This research is directed because it contains highly constrained research. This flight study addresses the sensorimotor research emphasis stated in the Human Research Program (HRP) Integrated Research Plan titled “Risk of Altered Sensorimotor/Vestibular Function Impacting Critical Mission Tasks”. One gap associated with this risk (SM-102) is to “characterize the effects of short and long-duration weightlessness on manual control after G-transitions.” This research gap led to the solicitation of a manual control study conducted before and after long duration flights on the ISS to map changes in sensorimotor function to manual control decrements. Unfortunately, these results (Moore et al., 2019) were limited due to testing delays related to time required for direct returns from Kazakhstan, with the initial measurements conducted more than 20 hr following landing. The approach of this investigation is to leverage the commercial crew landings in the US to obtain measurements as early as possible. While the Moore study used a T-38 X-plane simulation, we will obtain measures during actual T-38 flights. We will also add a lunar landing simulation based on the current concept of operations for the HLS. Further refinements are also proposed in the sensorimotor and cognitive test battery based on the previous study.

Research Impact/Earth Benefits: Sensorimotor function is critical for spatial orientation, gaze stabilization, and postural stability. This project examines how adaptive changes in sensorimotor and cognitive function may increase the risk of impaired ability to maintain control of vehicles and other complex systems. The goal is to map changes in physiological function with functional measures of manual control. Establishing these relationships will be relevant to how pathophysiological impairments in sensorimotor processing may affect other vehicular control tasks, such as driving with vestibular patients. This study will also be relevant to the development of strategies of how best to allow individuals with impairments perform a manual control override of autonomous driving vehicles. As Shuttle missions were extended, the on-orbit training countermeasure tool became extremely useful for commanders and pilots to practice the landing task sequence to maintain task proficiency. The ability to retain and/or assess manual control efficiency via a simple laptop-based simulation will impact our crew override approach for extended exploration missions. This approach can be easily adapted to a wide variety of simulated vehicle designs to provide similar assessments in other operational and civilian populations.

Task Progress & Bibliography Information FY2023 
Task Progress: Lunar Landing Simulation: During the initial project year, our project has coordinated closely with the development of other Artemis lunar landing simulation developments that are being developed for both the Human Landing System (HLS) engineering insight and Flight Operations Directorate (FOD) training purposes to utilize an environment that is closely aligned to the HLS planned concept of operations. The specific experimental approach is based on previous lunar simulations performed by Dr. Duda and colleagues during previous ground-based research (Clark et al. 2014; Clark et al., 2011; Duda et al., 2020; Duda et al., 2009). During this simulation, crewmembers will have the responsibility of monitoring the automatic flight trajectory before being tasked to manually take over and control the attitude and rate-of-descent to the nominal or re-designated landing aimpoint during the approach phase. The primary task of the pilot is to control the flight path and attitude of the lunar lander, with a secondary task of responding to system status annunciators and a tertiary task of making verbal callouts of key vehicle states (Hainley et al., 2013). During the re-designation phase, subjects select from alternative landing points based upon avoiding hazards that the onboard system identifies during the landing. The subject makes inputs using a rotational hand controller (i.e., joystick) and a translational hand controller, which are processed by simulated vehicle dynamics to update the vehicle attitude and rate of descent. We are coordinating with the Johnson Space Center (JSC) Dynamic Skills Trainer (DST) Technology Lab to duplicate extra sets of the same hand controllers that are utilized by ROBoT aboard International Space Station (ISS). A new 6DOF platform (W10, CKAS Mechatronics Pty Ltd., Australia) will be implemented, while the current CKAS V7 model will provide an alternate platform for testing PAM crewmembers. The simulated vehicle roll and pitch tilt, and translation accelerations will be synced to provide representative vestibular cues to the subject while performing the task. The simulation incorporated in this 6DOF system at JSC will also utilize the same portable dual laptop design as ROBoT to maximize the transfer from the onboard training.

Subjects will utilize a combination of flight, situation, and status displays to monitor the state of the simulated vehicle. Several Technical Interchange Meetings (TIMs) have been conducted with the Langley Lunar Landing Simulator team and the JSC HLS Crew Compartment Office simulation team to define flight displays, control modes, and design reference vehicle dynamics. All sims expect to start in automatic flight, then transition to manual using two possible flight control modes. The first is referred to as Rate Control Attitude Hold (RCAH) all the way to the surface. The second is RCAH to “low” altitude, then Hover Hold with Incremental Position Command (HH/IPC) to the surface. To fit within the allotted experiment timeframe, two attitude maneuver control powers will be implemented, including low (1.1 deg/sec2) – designed to push at pilot “lead” and prevent pilot-induced oscillations (PIOs), and mid-power (1.6 deg/sec2), although a third high control power (2.9 deg/sec2) will also be evaluated. Each combination of flight control modes and control powers, each performed with a landing point designation, will be repeated three times for a total of 12 trials/session. The landing site will be varied among candidate Lunar South Pole landing regions. The vehicle mass properties will be based on Altair Lander Design Analysis Cycle 2 (LDAC-2) with no gimballed main engine.

Sensorimotor test battery: During this first year, we have implemented the test battery that enables us to examine how adaptive changes in sensorimotor function relate to proficiency during supervisory manual control and crew override. This battery will leverage the most sensitive test conditions utilized in our previous manual control study by Moore et al., (2019), in which astronauts exhibited significant changes in motion perception, manual dexterity, dual-tasking, and sleepiness. We are also including quantitative measures of motion sickness symptoms at the time of testing, tilt perceptual precision and eye-hand coordination used in other flight studies (Field Tests and Sensorimotor Predictors). (1) Motion sickness (used throughout both lunar landing and test battery): Diagnostic indices for characterizing acute motion sickness symptoms have been used extensively in motion sickness research by many laboratories over the past 5 decades (e.g., Graybiel et al., 1968). However, Oman et al., (1986) developed a magnitude-estimation-based subjective discomfort rating that could be easily implemented in a flight operational environment. Subjects will be asked to subjectively rate their motion sickness after each task on a scale of 0-20, where 0 is normal, 10 is halfway to vomiting, and 20 is vomiting. This measure was used in the Field Tests (Reschke et al., 2020) and the ongoing Spaceflight Standard Measures. (2) Motion perception accuracy: The previous motion perception task (Moore et al., 2019) will also be performed with the subject in the motion simulator, seated and restrained. With eyes closed, subjects will be tasked with indicating gravitational vertical with the control stick as the cabin moves in a pseudorandom manner driven by a sum of seven sines with frequencies at 0.12, 0.25, 0.32, 0.43, 0.62, 0.80, and 0.98 Hz in roll for 60 s. A power spectrum analysis will be performed to determine the peak input response at each frequency. (3) Motion perception precision: As reviewed by Diaz-Artiles and Karmali (2021), characterizing vestibular precision as well as accuracy is important to fully understand adaptive changes in vestibular processing. Vestibular precision will be measured with a perceptual direction-recognition task while seated with eyes closed during lateral translations. Test sessions will consist of 75-100 trials. Each trial will be a leftward or rightward 1 Hz (1 s motion duration) single cycle sinusoid of acceleration. At the end of the motion subjects are prompted to report their perceived direction of motion (forced choice) and return to the starting position. The dependent variables (threshold and bias) will be derived from psychometric curve fits. The mean of this curve fit represents the perceptual bias, the point at which a subject is equally likely to perceive a motion as leftward or rightward. The “one sigma threshold” is linearly proportional to the standard deviation of the noise, e.g., the standard deviation of a Gaussian probability density function underlying the psychometric function (Clark et al., 2018; Merfeld, 2011). This test is completed within 10 minutes. (4) Sleepiness scale: The Stanford Sleepiness scale was previously used to quantify significant subjective changes in sleepiness in our returning ISS crewmembers (Moore et al., 2019). Subjects are asked to choose an ordinal value from a list of statements that best describ their state of sleepiness (Hoddes et al., 1973). (5) Manual Dexterity: The Perdue Pegboard test has been used to quantify manual dexterity in a number of recent studies (Koppelmans et al., 2013; Miller et al., 2018; Moore et al., 2019). Subjects are seated and tasked to place as many pins in a vertical row of slots (one at a time) within 30 s, first with the right hand, then with the left. The pins are then removed, and subjects are asked to place pairs of pins (with both hands simultaneously) in two vertical rows of slots within a 30 s period. (6) Manual tracking: Subjects are required to use the joystick controller with their dominant hand to maintain a crosshair target inside a 15mm-diameter circle moving at 20 mm/s on the computer screen and randomly changing direction over a 60 s epoch. The primary measure will be mean tracking error (pixels). (7) Manual Tracking with Dual Tasking: Subjects will then repeat this tracking task while responding to prompts from a second computer monitor for a 4-digit code to be entered on a keypad with the non-dominant hand. The distracting task will be performed continuously, and the time to respond and the number of correct responses will be acquired, in addition to tracking performance. (8) Eye-hand coordination: This test is based on the Field Test assessment (Reschke et al., 2020). Crewmembers will perform this on a tablet fixed at arm's distance where they are presented with a series of circles and squares in different locations on the screen. They will be told to hit only the circles as quickly and accurately as possible with the index finger of their dominant hand. Performance will be evaluated as number of errors (squares hit), response time, and accuracy (distance of finger press to the center of the circle).

Pilatus PC-12 flight field testing: During this initial project year, we evaluated the use of a Glenn Research Center airplane, the Pilatus PC-12, for potential field testing at the rally airport. The versatility of the PC-12 would enable us to functionally assess piloting skills using an operational flight platform close to the planned landing sites. We initially evaluated an automated supervisory control phase followed by a manual control phase using the advanced digital cockpit interface. In this scenario, Foreflight (or similar simulation software) would be used to create a series of waypoints and deviations during flight that the crewmembers would need to detect and override. An onboard PC-12 simulation using Xplane (Laminar Research, Columbia, SC) was developed. Although the flight would limit the bank angles to 30 deg (1.15g resultant) and a medical preflight check was proposed, flight medicine concerns regarding inflight medical care of an incapacitated crewmember in the cockpit caused this protocol to be tabled at the Institutional Review Board. As a potential way forward for rally airport testing, we are evaluating the feasibility of conducting a lunar landing simulation in the rear of the aircraft. The Glenn aircraft operations team is evaluating an interface to the PC-12 instrument landing system (ILS), which could be used to control the aircraft from the rear through the automated navigation system.

Bibliography: Description: (Last Updated: 06/03/2025) 

Show Cumulative Bibliography
 
 None in FY 2023
Project Title:  Manual Crew Override of Vehicle Landings Following G-Transitions Reduce
Images: icon  Fiscal Year: FY 2022 
Division: Human Research 
Research Discipline/Element:
HRP HHC:Human Health Countermeasures
Start Date: 04/04/2022  
End Date: 09/30/2032  
Task Last Updated: 12/07/2022 
Download Task Book report in PDF pdf
Principal Investigator/Affiliation:   Wood, Scott J. Ph.D. / NASA Johnson Space Center 
Address:  2101 NASA Parkway 
Mail code SD2 
Houston , TX 77058 
Email: scott.j.wood@nasa.gov 
Phone: (281) 483-6329  
Congressional District: 36 
Web:  
Organization Type: NASA CENTER 
Organization Name: NASA Johnson Space Center 
Joint Agency:  
Comments: NOTE: PI returned to NASA JSC in January 2017. PI was at Azusa Pacific University from August 2013 – January 2017; prior to August 2013, PI was at NASA JSC. 
Co-Investigator(s)
Affiliation: 
Barratt, Michael  M.D. NASA Johnson Space Center 
Duda, Kevin  Ph.D. Draper Laboratory 
Heineman, Raymond  M.S. NASA Johnson Space Center 
Moore, Steven  Ph.D. Central Queensland University, Rockhampton, Australia 
Reschke, Millard  Ph.D. NASA Johnson Space Center 
Wheelock, Douglas  M.S. NASA Johnson Space Center 
Young, Millennia  Ph.D. NASA Johnson Space Center 
Bishop, Michael  M.S. NASA Johnson Space Center 
Project Information: Grant/Contract No. Directed Research 
Responsible Center: NASA JSC 
Grant Monitor: Brocato, Becky  
Center Contact:  
becky.brocato@nasa.gov 
Unique ID: 15190 
Solicitation / Funding Source: Directed Research 
Grant/Contract No.: Directed Research 
Project Type: Flight 
Flight Program: ISS 
TechPort: No 
No. of Post Docs:  
No. of PhD Candidates:  
No. of Master's Candidates:  
No. of Bachelor's Candidates:  
No. of PhD Degrees:  
No. of Master's Degrees:  
No. of Bachelor's Degrees:  
Human Research Program Elements: (1) HHC:Human Health Countermeasures
Human Research Program Risks: None
Human Research Program Gaps: None
Task Description: Manual control during exploration spaceflight consists of both planned automated supervisory control and unplanned crew override. This crew override capability is critical to enable overall mission success during landing contingencies. However, the introduction of manual override capabilities must be implemented to enable crews to mitigate risks introduced by human error. Adaptive changes in the sensorimotor system can manifest during G-transitions as spatial disorientation. While training and landing aids enable successful landing through disorientation, these adaptive changes may increase cognitive demand that need to be accounted for in the manual control strategy. It is important to characterize these effects as soon as possible following the G-transition. Therefore, during this study, we will examine two types of piloting tasks following International Space Station (ISS) missions: an actual T-38 flight performed at the rally airport and a simulated lunar landing using a six degree-of-freedom (6DOF) motion-base. The motion base simulation will be implemented both in the laboratory at the NASA Johnson Space Center (JSC) and at the NASA Kennedy Space Center (KSC) and will be available within hours following return from commercial crew landings. The primary goals of this study are (1) to understand the impact of spaceflight on crew ability to perform manual crew override tasks, (2) to examine how adaptive changes in vestibular and cognitive function relate to changes in manual crew override proficiency, and (3) compare performance during late in-flight “just-in-time” training with early post-flight crew performance.

The impact of spaceflight on piloting capability will be assessed from pre- versus post-flight changes in crewmembers assigned to either short duration (< 30 day) or long duration (~6-month) missions to the ISS. Individual differences in post-flight vestibular and cognitive changes include motion sickness reports, measures of tilt motion perception accuracy and precision, and dual task tracking. During the T-38 flights, pilots will be tasked to take over controls and set up the final approach for landing through “minimums” (i.e., short of touchdown). During the 6DOF lunar simulation, the crew will manually take over attitude and rate-of-descent to the nominal or re-designated landing aimpoint during the approach phase. The outcome measures for both T-38 and lunar crew override tasks will include the percent time maintaining actual vehicle states, e.g., attitude and rate-of-descent, within recommended guidance during the landing approach, number and maximum deviation outside limits and root mean square error (RMSE). Given that ‘just-in-time” (JIT) training is an operational expectation for the Human Landing System (HLS) program, all participants will perform late inflight JIT training for each manual crew override task they will participate in. Crew proficiency will be captured inflight during JIT training that will be implemented on a laptop with hand controllers to allow the crewmember to practice the landing task procedures, like the approach implemented for JIT training with Shuttle landing and ISS telerobotic tasks. This project will deliver an operational demonstration of crew override capability following spaceflight and identify potential deficits that may require remediation. Comparison of individual vestibular and cognitive changes with crew override performance will help better characterize the manual control risks associated with sensorimotor alterations. Comparing performance parameters from the JIT training to post-flight performance will help demonstrate transfer of inflight JIT training to post-flight manual crew override performance. The inclusion of “just-in-time” training will ensure we are characterizing changes in override proficiency with this expected countermeasure in place.

Rationale for HRP Directed Research: This research is directed because it contains highly constrained research. This flight study addresses the sensorimotor research emphasis stated in the Human Research Program (HRP) Integrated Research Plan titled “Risk of Altered Sensorimotor/Vestibular Function Impacting Critical Mission Tasks”. One gap associated with this risk (SM-102) is to “characterize the effects of short and long-duration weightlessness on manual control after G-transitions.” This research gap led to the solicitation of a manual control study conducted before and after long duration flights on the ISS to map changes in sensorimotor function to manual control decrements. Unfortunately, these results (Moore et al., 2019) were limited due to testing delays related to time required for direct returns from Kazakhstan, with the initial measurements conducted more than 20 hr following landing. The approach of this investigation is to leverage the commercial crew landings in the US to obtain measurements as early as possible. While the Moore study used a T-38 X-plane simulation, we will obtain measures during actual T-38 flights. We will also add a lunar landing simulation based on the current concept of operations for the HLS. Further refinements are also proposed in the sensorimotor and cognitive test battery based on the previous study.

Research Impact/Earth Benefits:

Task Progress & Bibliography Information FY2022 
Task Progress: New project for FY2022.

Bibliography: Description: (Last Updated: 06/03/2025) 

Show Cumulative Bibliography
 
 None in FY 2022