Abstract
During performance of natural tasks subjects sometimes fixate objects that are manipulated several seconds later. Such early looks are known as “look-ahead fixations” (Pelz and Canosa in Vision Res 41(25–26):3587–3596, 2001). To date, little is known about their function. To investigate the possible role of these fixations, we measured fixation patterns in a model-building task. Subjects assembled models in two sequences where reaching and grasping were interrupted in one sequence by an additional action. Results show look-ahead fixations prior to 20% of the reaching and grasping movements, occurring on average 3 s before the reach. Their frequency was influenced by task sequence, suggesting that they are purposeful and have a role in task planning. To see if look-aheads influenced the subsequent eye movement during the reach, we measured eye-hand latencies and found they increased by 122 ms following a look-ahead to the target. The initial saccades to the target that accompanied a reach were also more accurate following a look-ahead. These results demonstrate that look-aheads influence subsequent visuo-motor coordination, and imply that visual information on the temporal and spatial structure of the scene was retained across intervening fixations and influenced subsequent movement programming. Additionally, head movements that accompanied look-aheads were significantly smaller in amplitude (by 10°) than those that accompanied reaches to the same locations, supporting previous evidence that head movements play a role in the control of hand movements. This study provides evidence of the anticipatory use of gaze in acquiring information about objects for future manipulation.
Similar content being viewed by others
References
Abrams R, Meyer D, Kornblum S (1990) Eye-hand coordination: oculomotor control in rapid aimed limb movements. J Exp Psychol Hum Percept Perform 15:248–267
Aivar MP, Hayhoe MM, Chizk CL, Mruczek REB (2005) Spatial memory and saccadic targeting in a natural task. J Vis 5(3):177–193
Andrews TJ, Coppola DM (1999) Idiosyncratic characteristics of saccadic eye movements when viewing different visual environments. Vision Res 39(17):2947–2953
Babcock JS, Pelz JB (2004) The RIT Wearable Eyetracker. In: ACM SIGCHI eye tracking research & applications symposium 2000, pp 109–114
Ballard DH, Hayhoe MM, Li F, Whitehead SD (1992) Hand-eye coordination during sequential tasks. Philos Trans R Soc Lond B Biol Sci 337(1281):331–338; discussion 338–339
Ballard DH, Hayhoe MM, Pelz JB (1995) Memory representations in natural tasks. J Cogn Neurosci 7(1):66–80
Ballard D, Sprague N (2005) Modeling the brain's operating system. Lect Notes Comput Sci 3704: 347–366
Batista AP, Buneo CA, Snyder LH, Andersen RA (1999) Reach plans in eye-centered coordinates. Science 285(5425):257–260
Biguer B, Jeannerod M, Prablanc C (1985) The role of position of gaze in movement accuracy. In: Posner M, Marin O (eds) Mechanisms of attention (attention and performance XI). Erlbaum, Hillsdale
Boussaoud D, Jouffrais C, Bremmer F (1998) Eye position effects on the neuronal activity of dorsal premotor cortex in the macaque monkey. J Neurophysiol 80(3):1132–1150
Buneo CA, Jarvis MR, Batista AP, Andersen RA (2002) Direct visuomotor transformations for reaching. Nature 416(6881):632–636
Calton JL, Dickinson AR, Snyder LH (2002) Non-spatial, motor-specific activation in posterior parietal cortex. Nature Neurosci 5(6):580–588
Carey DP (2000) Eye-hand coordination: Eye to hand or hand to eye? Curr Biol 10(11):R416–R419
Chun MM (2000) Contextual cueing of visual attention. Trends Cogn Sci 4(5):170–178
Chun MM, Jiang YH (1998) Contextual cueing: implicit learning and memory of visual context guides spatial attention. Cogn Psychol 36(1):28–71
Chun MM, Nakayama K (2000) On the functional role of implicit visual memory for the adaptive deployment of attention across scenes. Vision Cogn 7(1–3):65–81
De Graef P, Verfaille K, Lamote C (2001) Transsaccadic coding of object position: effects of saccadic status and allocentric reference frame. Psychol Belg 41:29–54
Epelboim J, Steinman RM, Kowler E, Edwards M, Pizlo Z, Erkelens CJ et al (1995) The function of visual-search and memory in sequential looking tasks. Vision Res 35(23–24):3401–3422
Flanders M, Daghestani L, Berthoz A (1999) Reaching beyond reach. Exp Brain Res 126(1):19–30
Forde EME, Humphreys GW (2002) Dissociations in routine behaviour across patients and everyday tasks. Neurocase 8(1–2):151–167
Forde EME, Humphreys GW, Remoundou M (2004) Disordered knowledge of action and action disorganization syndrome. Neurocase 10(1):19–28
Forde E, Rusted J, Humphreys G, Mennie N, Land M (2006) The eyes have it: an exploration of eye movements in action disorganisation syndrome (under review)
Freedman EG, Stanford TR, Sparks DL (1996) Combined eye-head gaze shifts produced by electrical stimulation of the superior colliculus in rhesus monkeys. J Neurophysiol 76(2):927–952
Fujii N, Mushiake H, Tanji J (2002) Distribution of eye- and arm-movement-related neuronal activity in the SEF and in the SMA and pre-SMA of monkeys. J Neurophysiol 87(4):2158–2166
Hayhoe M (2000) Vision using routines: a functional account of vision. Vision Cogn 7(1–3):43–64
Hayhoe M, Lachter J, Moeller P (1992) Spatial memory and integration across saccadic eye movements. In: Rayner K (ed) Eye movements and visual cognition: scene perception and reading. Springer, Berlin Heidelberg New York, pp 130–145
Hayhoe MM, Shrivastava A, Mruczek R, Pelz JB (2003) Visual memory and motor planning in a natural task. J Vis 3(1):49–63
Henderson JM, Hollingworth A (1999) High-level scene perception. Ann Rev Psychol 50:243–271
Henderson JM, Williams CC, Falk RJ (2005) Eye movements are functional during face learning. Mem Cogn 33:98–106
Hodgson TL, Bajwa A, Owen AM, Kennard C (2000) The strategic control of gaze direction in the tower of London task. J Cogn Neurosci 12(5):894–907
Hollingworth A, Henderson JM (2002) Accurate visual memory for previously attended objects in natural scenes. J Exp Psychol-Hum Percept Perform 28(1):113–136
Humphreys GW, Forde EME (1998) Disordered action schema and action disorganisation syndrome. Cogn Neuropsychol 15(6–8):771–811
Irwin D, Andrews R (1996) Integration and accumulation of information across saccadic eye movements. In: Inui T, McClelland JL (eds) Attention and performance XVI: information integration in perception and communication. MIT, Cambridge, pp 125–155
Irwin DE (1991) Information integration across saccadic eye movements. Cognit Psychol 23(3):420–456
Irwin DE, Zacks JL, Brown JS (1990) Visual memory and the perception of a stable visual environment. Percept Psychophys 47(1):35–46
Jeannerod M (1988) The neural and behavioral organisation of goal-directed movements. Oxford University Press, Oxford
Johansson RS, Westling GR, Backstrom A, Flanagan JR (2001) Eye-hand coordination in object manipulation. J Neurosci 21(17):6917–6932
Land M, Mennie N, Rusted J (1999) The roles of vision and eye movements in the control of activities of daily living. Perception 28(11):1311–1328
Land MF, Furneaux S (1997) The knowledge base of the oculomotor system. Philos Trans R Soc Lond Ser B-Biol Sci 352(1358):1231–1239
Land MF, Lee DN (1994) Where we look when we steer. Nature 369(6483):742–744
Land MF, McLeod P (2000) From eye movements to actions: how batsmen hit the ball. Nature Neurosci 3(12):1340–1345
Melcher D, Kowler E (2001) Visual scene memory and the guidance of saccadic eye movements. Vision Res 41(25–26):3597–3611
O’Regan JK (1992) Solving the “real” mysteries of visual perception: the world as an outside memory. Can J Psychol 46(3):461–488
O’Regan JK, Levy-Schoen A (1983) Integrating visual information from successive fixations: does trans-saccadic fusion exist? Vision Res 23(8):765–768
Patla AE, Vickers JN (1997) Where and when do we look as we approach and step over an obstacle in the travel path? Neuroreport 8(17):3661–3665
Pelz J, Hayhoe M, Loeber R (2001) The coordination of eye, head, and hand movements in a natural task. Exp Brain Res 139(3):266–277
Pelz JB, Canosa R (2001) Oculomotor behavior and perceptual strategies in complex tasks. Vision Res 41(25–26):3587–3596
Rothkopf C, Pelz J (2004) Head movement estimation for wearable eye trackers. In: Paper presented at the ACM SIGCHI eye tracking research & applications symposium 2000, San Antonio
Schwartz MF, Montgomery MW, Fitzpatrick-DeSalme EJ, Ochipa C, Coslett H, Mayer N (1995) Analysis of a disorder of everyday action. Cognit Neuropsychol 12:863–892
Smeets JBJ, Hayhoe MM, Ballard DH (1996) Goal-directed arm movements change eye-head coordination. Exp Brain Res 109(3):434–440
Tatler BW, Gilchrist ID, Rusted J (2003) The time course of abstract visual representation. Perception 32(5):579–592
Terao Y, Andersson NEM, Flanagan JR, Johansson RS (2002) Engagement of gaze in capturing targets for future sequential manual actions. J Neurophysiol 88(4):1716–1725
Acknowledgments
This work was supported by NIH grants EY05729 and RR09283. Thanks to Constantin Rothkopf and Jeff Pelz for their assistance, and to five anonymous reviewers for their helpful comments. Parts of this work have been previously presented at the Vision Sciences Society (VSS) annual conference in Sarasota, Florida.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Video object (MPG 26,454 kb)
Rights and permissions
About this article
Cite this article
Mennie, N., Hayhoe, M. & Sullivan, B. Look-ahead fixations: anticipatory eye movements in natural tasks. Exp Brain Res 179, 427–442 (2007). https://doi.org/10.1007/s00221-006-0804-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00221-006-0804-0