Menu

 

 
Task Last Updated: 01/08/2007 
Division Name: Human Research 
Program/Discipline: NSBRI Teams 
Element/Subdiscipline: Sensorimotor Adaptation Team 
Project Title: Visual Orientation, Navigation, and Spatial Memory Countermeasures 
Joint Agency Name:  
PI Name: Oman, Charles M.  PI Phone: 617-253-7508  
PI Email: coman@mit.edu  Fax: 617-258-8111 
PI Organization Type: UNIVERSITY 
Organization Name: Massachusetts Institute of Technology 
PI Address 1: 77 Massachusetts Avenue 
PI Address 2: Room 37-219 
PI Web Page: http://mvl.mit.edu/  
City: Cambridge State: MA Zip Code: 02139-4301 Congressional District: 8
Comments:  
Project Type: GROUND  Solicitation: 03-OBPR-04 
Start Date: 03/01/2004  End Date: 02/28/2007 
Fiscal Year: 2006     
No. of Post Docs: No. of PhD Degrees:
No. of PhD Candidates: No. of Master' Degrees:
No. of Master's Candidates: No. of Bachelor's Degrees:
No. of Bachelor's Candidates: Monitoring Center: NSBRI 
Contact Monitor:   Contact Phone:  
Contact Email:      
Flight Program:  
Flight Assignment:

 

Key Personnel Changes/Previous PI:  
COI Name: COI Institution:
Harris, Laurence   York University 
Liu, Andrew   Massachusetts Institute of Technology 
Jenkin, Michael   York University 
Aoki, Hirofumi   Massachusetts Institute of Technology 
Grant/Contract No.: NCC 9-58-NA00402 
Performance Goal No.:  
Performance Goal Text:

 

Task Description:  How should spacecraft designers configure interior architectural features, work areas, and the relative orientations of adjacent or docked spacecraft modules to minimize spatial disorientation and navigation problems in 0-g ? Current standards (e.g. NASA Standard 3000) offer little guidance. Can virtual reality (VR) training techniques – which astronauts currently use to plan their spacewalks - also be used to reduce the incidence of visual reorientation and inversion illusions while working inside the spacecraft? If so the incidence of space sickness should be reduced, and crews will be less disoriented when transiting modules with differently oriented visual verticals. Is a fully immersive VR system needed for such training, or could simpler, portable training systems be used? Can individual performance on operationally relevant 3D orientation, navigation, and teleoperation tasks be predicted based on simple tests of individual mental rotation and perspective taking skills? What is the best way to assess and control the direction of the perceptual vertical in an environment where there is no gravitational “down”? Can head movement contingent instability of the perceived visual world (“oscillopsia”), experienced by most returning astronauts, be quantified using visual feedback techniques? Answers can be directly applied to the design of the NASA CEV, Lunar Surface Access Module and eventually the Mars Transfer Hab interiors, to the physical arrangement of ground simulators and to the development of VR based techniques for preflight orientation and navigation training for astronauts.

The goal of this multi-institutional neurovestibular project is to develop four types of design, assessment, training, and procedural countermeasures: a) Evidence-based spacecraft architecture and work area design standards. b) Methods for quantitative assessment of inflight and postflight oscillopsia. c) Preflight visual orientation training techniques to reduce disorientation and improve inflight emergency egress. d) Teleoperation procedure and training improvements based on crewmember spatial skills.

Our specific aims are: 1) To quantify how environmental geometric frame and object polarity cues determine human visual orientation, to support engineering and design of spacecraft work areas. 2) To develop reliable means for quantifying head-movement-contingent oscillopsia. 3) To determine whether preflight virtual reality techniques can improve astronaut 3D spatial memory and navigation abilities by reducing direction vertigo, and teaching ISS configuration and emergency egress routes. 4) To improve astronaut teleoperation performance by taking into account the mental object rotation and perspective taking abilities of individuals while training and during operations.

Inflight spatial disorientation, spatial memory, navigation and teleoperation problems, and oscillopsia during re-entry and after landing have been identified as neurovestibular risks by Shuttle, Mir and ISS astronauts, NASA’s Critical Path Roadmap, the Neurovestibular Adaptation Team Strategic Plan, and a National Academy of Sciences committee report. NRA 03-OBPR-04 solicits research to determine what spacecraft architectures, interior visual cues, and preflight orientation training techniques will minimize inflight disorientation.

The project utilizes the unique virtual reality research capabilities at York and MIT. Six sets of experiments are being conducted: 1) Measuring the effect of environmental geometry (frame) cues using psychophysical techniques (York). 2) Assessing the influence of polarized objects on self-orientation perception using psychophysical judgments (York). 3) Assessing the extent and pattern of head-contingent oscillopsia and visual motion (York). 4) Effect of training module orientation on inflight direction vertigo (MIT). 5) Influence of relative body orientation in preflight visual orientation and egress training (MIT). 6) Correlation of spatial abilities with simulated space station remote manipulator training performance(MIT).

 

Research Impact/Earth Benefits: Results support the development of neurovestibular countermeasures for spatial orientation, navigation, and spatial memory difficulties among astronauts, and the design of future vehicles, including the CEV, Lunar Surface Access Module and later the Mars Transit Hab. Our results also pertain to human health on Earth, for example: origins and assessment of oscillopsia, and disorientation, spatial memory and navigation problems in vestibular, Alzheimer's and Multiple Sclerosis patients. Our results also pertain to the interior design of buildings to reduce disorientation by providing strong visual cues for orientation in both the vertical (to reduce falls in the elderly on stairs) and gravitational horizontal planes (e.g. the origins of “wrong door” phenomena in buildings and “geographic disorientation” in cities, and among sport orienteers, and in the design of visual cueing systems for civil and military flight simulators). To the extent that disorientation is reduced, motion sickness will also be alleviated.

Task Progress: At York, experiments in a tumbled room and in parabolic flight demonstrated that the direction of the perceptual vertical can be reliably assessed (and mathematically modeled) by having subjects distinguish the identity of an orientationally ambiguous character (e.g. “p” vs. “d”), rather than by manually rotating a visual target or manual rod, since the latter two methods require the subject to make a judgment of the direction of the perceived gravitational vertical – something that many cannot do in weightlessness. Results from a second experiment suggest that the strength of the “levitation” visual reorientation illusion depends on scene content (scene viewed), rather than geometric field of view (view seen). Experiments in the York 6-walled immersive virtual environment (IVY) manipulating the floor/ceiling aspect ratio of simple frame cue interiors demonstrate that the surface perceived to be "the floor" depends on aspect ratio in a predictable, quantifiable manner. This year we also began experiments to see if head movement contingent instability of the perceived visual world (“oscillopsia”) experienced by most returning astronauts could be quantified using visual feedback techniques. As a surrogate stimulus for an astronaut’s return to Earth’s gravity we are using vestibular coriolis illusions produced when our normal subjects make out-of-rotation-plane head movements in a rotating chair.

At MIT, our studies of how subjects learn to judge the relative orientation of two docked modules with locally consistent but incongruently aligned interior visual verticals have shown that subjects naturally tend to remember each module in a visually upright orientation. Individual performance correlates with mental rotation and perspective taking skills, and also depends on relative body orientation, and the relative orientation of the modules. Pilot tests suggest that it is the number of successive mental rotations required about principal environmental axes that determines orientation difficulty, and may explain the docked module visualization difficulties previously reported by Apollo, Mir and ISS astronauts. This year we also developed an immersive VR 3D navigation simulation based on an ISS emergency egress task, and have studied the effect of training in a locally vs globally “upright” configuration, with and without smoke obscuration. Most subjects learn quickly, but performance correlated with individual 3D spatial skills. We are currently comparing performance of subjects trained with a non-immersive (laptop) based version of the task. If subjects can learn the 3D station configuration using a simple laptop based training technique, it will greatly facilitate configuration refresher training both at home and onboard the spacecraft.

 

Bibliography Type: Description: (Last Updated: 09/16/2009)
Articles in Peer-reviewed Journals Oman, C. M. "Visual orientation and navigation in microgravity" Jan-2006
Awards Aoki H. "NSBRI Postdoctoral Fellowship to Hirofumi Aoki. October 2005." Oct-2005
Abstracts for Journals and Proceedings Aoki, H, Oman, C M, Natapoff, A and Liu, A. "The effect of the configuration, frame of reference, and spatial ability on spatial orientation during virtual 3-dimentional navigation training." ESTEC Noordwijk, The Netherlands,2006 June.

. Submitted for Publication, 2006 June;. , Jun-2006

Abstracts for Journals and Proceedings Dyde, R T, Jenkin, M R, and Harris, L. "Measuring the perceptual upright while manipulating body orientation, the orientation of the visual background and the direction of gravity." ESTEC, Noordwijk, the Netherlands.

. Submitted for Publication. , Jan-2006

Abstracts for Journals and Proceedings Dyde, R T, Jenkin, M R, Jenkin H L, Zacher J E and Haris L R. "The role of visual background orientation on the perceptual upright during parabolic flight." ESTEC, Noordwijk, the Netherlands,2006 June.

. Submitted for Publication, 2006 June;. , Jun-2006

Papers from Meeting Proceedings Harris LR, Dyde RT, Jenkin MR. "The use of visual and non-visual cues of in updating the perceived position of the world during translation." Human Vision and Electronic Imaging X, 2005.

Proceedings of SPIE Volume: 5666:462-472, March 2005. ISBN: 9780819456397 , Mar-2005

Abstracts for Journals and Proceedings Harris, L R, Dyde, R, Oman, C M and Jenkin M. "Visual cues to the direction of the floor." ESTEC Noordwijk, The Netherlands,2006 June.

. Submitted for Publication, 2006 June;. , Jun-2006

Abstracts for Journals and Proceedings Jenkin, H L, Zacher, J E Oman, C M and Harris, L R. "Effect of field of view on visual reorientation illusion: does the levitation illusion depend on the view seen or the scene viewed ?." . Submitted for Publication. , Jan-2006
Abstracts for Journals and Proceedings Marquez JJ, Oman CM, Liu AM. "You-Are-Here Maps for International Space Station: Approach and Guidelines." 34th International Conference of Environmental Systems, Colorado Springs, CO, July 2004,

Proc of the 34th International Conference of Environmental Systems. 2004 July;1-7. , Jul-2004

Abstracts for Journals and Proceedings Oman, C M, Benveniste, D, Buckland, D A, Aoki, H, Liu, A M, Natapoff, A, and Kozhevnikov, M. "Incongruent Spacecraft Module Visual Verticals Affect Spatial Task Performance." ESTEC Noordwijk, The Netherlands,2006 June.

. Submitted for Publication, 2006 June;. , Jun-2006

Abstracts for Journals and Proceedings Oman CM, Benveniste D, Buckland DA, Aoki H, Liu AM, Natapoff A, Kozhevnikov M. "Spacecraft Module Visual Verticals and Individual Abilities Determine 3D Spatial Task Performance." 77th Annual Meeting of the Aerospace Medical Association, Orlando, FL, May 14-18, 2006.

Aviat Space Env Med. 2006 Mar;77(3):349. , Mar-2006

Abstracts for Journals and Proceedings Oman C M, Harris LR, Taube JS, Dyde RT, Jenkin HL, Liu AM, Aoki H, Benveniste D, Buckland D, Natapoff A, Richards J. "Visual orientation, navigation, and spatial memory: mechanisms and countermeasures." Bioastronautics Investigator's Workshop, Houston, TX, January 2005.

Proceedings Bioastronautics Investigator's Workshop, 2005 January. , Jan-2005

Abstracts for Journals and Proceedings Sanderson, J, Oman, C M, and Harris L R. "Measuring and attenuating head-movement induced oscillopsia." ESTEC Noordwijk, The Netherlands,2006 June.

. Submitted for Publication, 2006 June;. , Jun-2006

Articles in Peer-reviewed Journals Barnett-Cowan M, Dyde RT, Harris LR . "Is an internal model of head orientation necessary for oculomotor control?" Ann N Y Acad Sci. 2005 Apr;1039:314-24. PMID: 15826985 , Apr-2005
Articles in Peer-reviewed Journals Dyde RT, Jenkin MR, Harris LR. "The subjective visual vertical and the perceptual upright." Exp Brain Res. 2006 Sep;173(4):612-22. Epub 2006 Mar 21. PMID: 16550392 , Sep-2006
Articles in Peer-reviewed Journals Jaekl P, Jenkin MR, Harris LR . "Perceiving a stable world during active rotational and translational head movements." Exp Brain Res. 2005 Jun;163(3):388-99. PMID: 15856212 , Jun-2005
Articles in Peer-reviewed Journals Jaekl P, Zikovitz DC, Jenkin MR, Jenkin HL, Zacher JE, Harris LR. "Gravity and perceptual stability during translational head movement on earth and in microgravity." Acta Astronaut. 2005 May-Jun;56(9-12):1033-40. PMID: 15835061 , May-2005
Papers from Meeting Proceedings Jenkin HL, Dyde RT, Jenkin MJ, Harris LR. "Pitching up in VR." International Conference on Artificial Reality and Telexistence ICAT 2004, Seoul, Korea, November 30-December 4, 2004.

International Conference on Artificial Reality and Telexistence ICAT 2004, November 30-December 4, 2004, presentation S10-3. , Nov-2004

Articles in Peer-reviewed Journals Jenkin HL, Jenkin MR, Dyde RT, Harris LR. "Shape-from-shading depends on visual, gravitational, and body-orientation cues." Perception. 2004;33(12):1453-61. PMID: 15729912 , Jan-2004
Articles in Peer-reviewed Journals Mast FW, Oman CM. "Top-down processing and visual reorientation illusions in a virtual reality environment. " Swiss Journal of Pyschology. 2004;63(3):143-9. http://dx.doi.org/10.1024/1421-0185.63.3.143 , Jul-2004
Articles in Peer-reviewed Journals Jenkin HL, Dyde RT, Zacher JT, Zikovitz DC, Jenkin MR, Allison RS, Howard IP, Harris LR "The relative role of visual and non-visual cues in determining the perceived direction of “up“: experiments in parabolic flight." Acta Astronaut. 2005 May-Jun;56(9-12):1025-32. PMID: 15838949 , May-2005