Abstract
Responding rapidly to visual stimuli is fundamental for many animals. For example, predatory birds and insects alike have amazing target detection abilities, with incredibly short neural and behavioral delays, enabling efficient prey capture. Similarly, looming objects need to be rapidly avoided to ensure immediate survival, as these could represent approaching predators. Male Eristalis tenax hoverflies are nonpredatory, highly territorial insects that perform high-speed pursuits of conspecifics and other territorial intruders. During the initial stages of the pursuit, the retinal projection of the target is very small, but this grows to a larger object before physical interaction. Supporting such behaviors, E. tenax and other insects have both target-tuned and loom-sensitive neurons in the optic lobes and the descending pathways. We here show that these visual stimuli are not necessarily encoded in parallel. Indeed, we describe a class of descending neurons that respond to small targets, to looming and to wide-field stimuli. We show that these descending neurons have two distinct receptive fields where the dorsal receptive field is sensitive to the motion of small targets and the ventral receptive field responds to larger objects or wide-field stimuli. Our data suggest that the two receptive fields have different presynaptic input, where the inputs are not linearly summed. This novel and unique arrangement could support different behaviors, including obstacle avoidance, flower landing, and target pursuit or capture.
Significance Statement
If you are playing baseball, when the ball is far away, it appears as a very small object on your retina. However, as the ball gets closer, its image becomes a rapidly expanding object. Here, we show that within the hoverfly visual system, a single neuron responds to both of these images. Indeed, we found a class of descending neurons with dual sensitivity, separated into two distinct parts of the visual field. The neurons have a more dorsal receptive field that is sensitive to small targets and a more ventral receptive field that is sensitive to larger objects.
Introduction
The ability to respond quickly to visual stimuli is vital for the survival of many animals. Indeed, visual input may be used for a variety of tasks, from navigating around obstacles, to choosing a suitable surface to rest on and detecting predators or prey. For example, many predatory insects rely on vision to identify suitable prey and engage in pursuits, doing so with astonishing precision and accuracy (Olberg et al., 2007; Nityananda et al., 2016; Fabian et al., 2018). Some nonpredatory insects, including hoverflies, also have superb target-detecting capabilities, which they may use for territorial defense or courtship (Fitzpatrick and Wellington, 1983; Zeil, 1986). Small target motion detector (STMD) neurons in the hoverfly optic lobe, and their presumed postsynaptic targets, the target selective descending neurons (TSDNs), have size and velocity tuning properties that match the target image at the start of the pursuit, suggesting that they could support these behaviors (Nordström et al., 2006; Nicholas et al., 2020; Thyselius et al., 2023).
In addition to the precise responses which occur during pursuit, behaviors elicited by looming stimuli, such as the escape response, also need to be fast and accurate (Fotowat et al., 2009; Santer et al., 2012; von Reyn et al., 2017; Mancienne et al., 2021; Lenzi et al., 2022). Indeed, neurons that respond strongly to rapidly looming stimuli exist in a range of species and visual structures, including the cat superior colliculus (Liu et al., 2011), the bullfrog optic tectum (Nakagawa and Hongjian, 2010), and zebrafish retinal ganglion cells (Temizer et al., 2015). In insects, there are looming neurons in the optic lobes as well as in the descending pathways. Examples of these include the locust lobula giant movement detector (LGMD)/descending contralateral movement detector (DCMD) system (Santer et al., 2012), the Drosophila Foma-1 neurons (de Vries and Clandinin, 2012), and the descending giant fiber (Fotowat et al., 2009).
Historically, insect looming neurons have been studied in the context of predator avoidance (Fotowat et al., 2009; Santer et al., 2012; von Reyn et al., 2017). However, there is emerging evidence that looming neurons also play a key role in pursuit behaviors. For example, silencing Drosophila Foma-1 neurons not only affects the escape response (de Vries and Clandinin, 2012), but also the ability of male flies to follow females during courtship (Coen et al., 2016). This is interesting as many looming neurons also respond strongly to small moving targets. For example, the locust LGMD/DCMD pathway was originally thought to play a role in object tracking (Rind and Simmons, 1992), and several looming-sensitive neurons in the locust central complex also respond to small moving targets (Rosner and Homberg, 2013). Conversely, some dragonfly TSDNs respond not only to targets but also to looming stimuli (Frye and Olberg, 1995; Gonzalez-Bellido et al., 2013).
Together, this shows that some neurons typically referred to as either target or looming selective (Santer et al., 2008; Gonzalez-Bellido et al., 2013) respond to both. Like locusts (Santer et al., 2008) and dragonflies (Gonzalez-Bellido et al., 2013), hoverflies have descending neurons that respond to both looming stimuli and to small moving targets (Nicholas et al., 2020). We here investigate this dual sensitivity and find that these descending neurons have two distinct receptive fields, one more dorsal that responds selectively to the motion of small targets, and one more ventral that responds to larger objects, including sinusoidal gratings and high-contrast edges. We show that when the center of the ventral grating receptive field is to the right of the visual midline, the local motion sensitivity is to rightward motion, and vice versa. However, the preferred direction of the dorsal target receptive field and the ventral grating receptive field are not always the same. We also show that the two receptive fields receive separate input, from the presynaptic target pathway and the presynaptic wide-field motion pathway, respectively, and, when stimulated simultaneously, the responses are not linearly summed. We hypothesize that the unique response characteristics of these neurons could be used in different behaviors.
Materials and Methods
Electrophysiology
We recorded from 98 looming-sensitive descending neurons (Nicholas et al., 2020) in 94 male Eristalis tenax hoverflies, reared and maintained in-house as described previously (Nicholas et al., 2018a). At experimental time, the hoverfly was immobilized ventral side up, using a beeswax and resin mixture, before an opening was made in the thoracic cavity. A small silver hook was used to elevate and support the cervical connective, and a silver wire inside the opening served as a reference electrode.
Recordings were made from the cervical connective using a sharp polyimide-insulated tungsten microelectrode (2 MΩ; Microprobes). Signals were amplified at 100× gain and filtered through a 10–3000 Hz bandwidth filter using a DAM50 differential amplifier (World Precision Instruments), with 50 Hz noise removed with a Hum Bug noise eliminator (Quest Scientific). The data were digitized via a Powerlab 4/30 system and recorded at 40 kHz with LabChart 7 Pro software (ADInstruments). Single units were discriminated by amplitude and half-width using Spike Histogram software (ADInstruments).
Visual stimuli
Hoverflies were positioned perpendicular to and 6.5 cm away from the middle of a linearized Asus LCD screen (ASUS) with a mean illuminance of 200 lux, a refresh rate of 165 Hz, and a spatial resolution of 2560 × 1440 pixels (59.5 × 33.5 cm), giving a projected screen size of 155 × 138°. Visual stimuli were displayed using custom software written in MATLAB (version R2019b; MathWorks) using the Psychophysics toolbox (Brainard, 1997; Pelli, 1997). The stimuli were not perspective corrected. When values are given in degrees, this corresponds to the retinal size in the center of the visual field. Velocities are given in millimeters per second.
Potential looming-sensitive descending neurons were initially identified based on their response to a small, black, moving target (Fig. 1A–D, left; Nicholas et al., 2020). Those neurons that also responded to a looming stimulus (Nicholas et al., 2020) were kept for further analysis. All neurons responded stronger to the looming stimulus than to an appearance control (Fig. 1E,F). The looming stimulus was a black circle on a white background, expanding over 1 s from 1° diameter to 118° (Fig. 1A,C, right), with a 10 ms rate of expansion (Fotowat and Gabbiani, 2007), also referred to as l/|v|. The appearance control was a black circle with 118° diameter that appeared and remained on the screen for 1 s.
Looming-sensitive descending neurons respond robustly to looming stimuli and to small targets. A, Pictograms of the 3° × 3° square target moving horizontally (left) and the looming stimulus with an l/|v| of 10 ms and a final size of 118° (right), as projected on the frontal visual monitor. B, Raw data trace from an extracellular recording of a looming-sensitive descending neuron in response to a small target (left) or a looming stimulus (right). C, The position of the target on the visual monitor (left) and the diameter of the looming stimulus (right), time aligned with the data in B. D, Spike histograms of the responses in B using 20 ms bins. E, Example response from a single neuron (mean ± SEM, n = 4) to the looming stimulus and the appearance of a stationary black disk with a diameter of 118°. F, The peak amplitude of the response to a looming stimulus was significantly stronger than the peak response to the appearance control (p < 0.0001, paired t test).
We mapped the target receptive field (Nordström et al., 2006; Nicholas et al., 2020) of each neuron by scanning a target horizontally and vertically at 20 evenly spaced elevations and azimuths to create a 20 × 20 grid (Fig. 2A). The 3.5 × 3.5 mm (3 × 3°) black, square target moved at a velocity of 209 mm/s. As the screen width was larger than its height, the horizontal scans lasted for 2.8 s, while the vertical scans lasted for 1.6 s. There was a minimum 0.5 s interval between each stimulation.
Receptive field mapping method. A, The resulting 20 × 20 analysis windows after scanning the entire monitor along 20 evenly spaced horizontal and vertical target trajectories. The blue boxes highlight the positions of the analysis windows [position 1 (P1) to P4] shown in C. B, The resulting 8 × 6 grid of overlapping patches of sinusoidal gratings. The red boxes highlight the grid locations (P1–P4) shown in D. C, The responses (open symbols) to 4 directions of target motion within the analysis windows highlighted in A. We fit a cosine function (black) to the responses and used this to extract the local preferred direction (LPD; filled triangle), and local motion sensitivity (LMS; vertical bar). The dotted line shows the mean response. D, The responses (open symbols) to 8 different directions within the positions highlighted in B, the resulting cosine function (black), the LPD (filled triangle), LMS (vertical bar), and the mean response (dotted line). E, The position of the target receptive field, shown as contour lines (blue and gray). The center position (blue circle) was defined as the centroid of the 50% contour line. F, The position of the grating receptive field, shown as contour lines (red and gray), and its center (red circle). G, The arrows show the local motion sensitivity (arrow length) and local preferred direction (arrow angle) of the target receptive field. Blue arrows indicate the preferred direction in positions where the local motion sensitivity was >50% of the maximum for this neuron. Bottom right pictogram indicates the resulting average preferred direction. H, Local motion sensitivity and the preferred direction of the grating receptive field. The bottom right pictogram indicates the average preferred direction (red). The data in this figure come from the example neuron shown in Figure 3A.
We mapped the grating receptive field (Straw et al., 2006; Nicholas et al., 2020) using local sinusoidal gratings (93 × 93 mm, 71 × 71° in the visual field center; Fig. 2B), where the internal pattern moved in a series of eight different directions presented in a pseudorandom order for 0.36 s each. The gratings had a wavelength of 17 mm (central patch, 13°; 0.08 cycles/°) and drifted at 5 Hz. The local gratings were placed in an overlapping tiling fashion so that 8 × 6 (width × height) squares covered most of the screen (Fig. 2B). There was a minimum 1 s interval between each stimulation.
To map the leading-edge receptive field, we scanned the entire height or width of the screen with an OFF-contrast edge moving left, right, down, or up, at 209 mm/s.
For size-tuning experiments a bar drifted at 209 mm/s, in the preferred direction of the target receptive field of each neuron. The bar drifted either horizontally or vertically through the center of the target or grating receptive field, as specified. The bar side parallel to the direction of travel was maintained at a fixed size of 3.5 mm (3°), while the perpendicular side varied from 0.2° to 155° (1 pixel to the full height of the screen). When presented simultaneously with a small target, the bar moved in the preferred horizontal direction through the grating receptive field only. In this case, the bar height was varied between 5.7° and 106° (6.5–174 mm), while a fixed size 3° × 3° target moved through the target receptive field.
To determine the input mechanism of each receptive field, an OFF edge, an ON edge, and a discrete bar, with a width of 3.5 mm (3°) drifted horizontally at 209 mm/s across the entire width of the screen. The height of these objects was 3° (3.5 mm) when drifted through the target receptive field, 84° (116 mm) when drifted through the grating receptive field, or the height of the screen (138°) to cover both receptive fields.
All stimuli were presented in a random order, except for the receptive field stimuli, which were presented in a pseudorandom order.
Experimental design and statistical analyses
All data analysis was performed in MATLAB and GraphPad Prism 9.3.1 (GraphPad Software). Statistical analysis was performed using either GraphPad Prism 9.3.1 or the circular statistics toolbox (Berens, 2009) in MATLAB, as appropriate. The sample size, statistical test, and p-values are indicated in each figure legend, where n refers to the number of repetitions within one neuron, and N to the number of neurons. Neurons were initially identified based on the response to a small, black target, with data from all neurons that subsequently passed the definition of a looming neuron (Nicholas et al., 2020; see above) included in the analysis.
Even if the hoverfly was placed ventral side up in the experiments, all receptive fields are shown with the dorsal side of the hoverfly up (Figs. 2–5). For target receptive field mapping, we used the resulting 20 × 20 grid (Fig. 2A) to calculate the local preferred direction and local motion sensitivity (Fig. 2C), assuming a neural delay of 20 ms (Leibbrandt et al., 2021). We calculated the local average spike rate to the four directions of motion (Fig. 2C, dotted line) after subtracting the spontaneous rate, averaged in the 485 ms before stimulus presentation. We interpolated this to a 100 × 100 grid to generate receptive field maps (Fig. 2E) using the MATLAB contour function. We defined the center of the receptive field (Fig. 2E) as the center of the 50% contour line using the MATLAB centroid function. We fitted a cosine function (Nicholas et al., 2020) to the response to the four directions of motion (Nordström et al., 2006) and extracted its local preferred direction and amplitude (Fig. 2C). We calculated the preferred direction for each neuron by averaging the local preferred directions from the locations where the local motion sensitivity was >50% of the maximum (Fig. 2G, blue).
For the grating receptive fields, we used the resulting 8 × 6 grid (Fig. 2B) to quantify the local mean spike rate for each direction of motion, after removing the first 100 ms of the response, to avoid initial onset transients (Nordström and O’Carroll, 2009). We calculated the local mean response (Fig. 2D, dotted line) after subtracting the spontaneous spike rate, averaged during 800 ms preceding stimulus presentation. We spatially interpolated this 10 times and calculated the center from the 50% contour line (Fig. 2F). For each spatial location, we fitted a cosine function (Fig. 2D) to the response to get the local preferred direction and local motion sensitivity (Nicholas et al., 2020). We calculated the overall direction selectivity using the top 50% of the local preferred directions (Fig. 2H, red).
We calculated the horizontal and vertical distance between the receptive field centers and the midline and equator. The distance between the two receptive field centers was calculated using the Euclidean distance.
For leading-edge receptive field mapping, we first quantified the spike rate histogram for each neuron, after smoothing the spike rate with a 100 ms square-wave filter with 40 kHz resolution (Fig. 6A–D). We identified the maximum response to any direction of motion (Fig. 6D, purple). A 50% maximum response was used as a threshold to determine the limits of the leading-edge receptive field (Fig. 6A,C,D, cyan). If the response of a neuron did not reach threshold to one direction of motion (Fig. 6B), the opposite direction of motion determined the receptive field outlines. If a neuron responded to both directions of motion (e.g., up and down), the outer thresholds were used to delineate the receptive field (Fig. 6E). From the resulting rectangular receptive field, we determined the center, and the proximity to the target and the grating receptive fields, respectively (Fig. 6F), using the following proximity index:
For all stimuli other than receptive field mapping, the quantification of responses was performed by averaging the spike rate within a 0.56 s analysis window centered on the target or grating receptive field center of each neuron, as specified.
Data availability
All MATLAB scripts used for data analysis in this paper can be found here: https://doi.org/10.5281/zenodo.7227236.
All raw and analyzed data presented here have been deposited to DataDryad: https://doi.org/10.5061/dryad.6wwpzgn2p.
Results
Looming neurons have dorsal target receptive fields and ventral grating receptive fields
We recorded from 98 looming-sensitive descending neurons in male E. tenax hoverflies. The neurons described here responded both to small target motion (Fig. 1A–D, left) and to looming stimuli (Fig. 1A–D, right). The response to a looming stimulus (Fig. 1B,D, right) started well before the stimulus reached its full size (Fig. 1C, right), and was much stronger than the response to an appearance control (Fig. 1E,F; Nicholas et al., 2020).
To investigate this dual sensitivity (Fig. 1A–D) in more detail, we mapped the receptive fields using two different methods. For this purpose, we either scanned the visual monitor with a small black target (Nordström et al., 2006) moving in four different directions (Fig. 2A,C) or used a local sinusoidal grating (Fig. 2B,D) where the internal pattern drifted in eight different directions (Straw et al., 2006; Nicholas et al., 2020). The data from an example neuron show two distinct receptive fields, with a dorsal target receptive field (Figs. 2E, 3A, blue), and a ventral grating receptive field (Figs. 2F, 3A, red).
Two different receptive fields. A, The location of the two receptive fields of an example neuron as projected onto the visual monitor. The outlines show the 50% response of and the small circle shows the center of the target receptive field (blue) and the grating receptive field (red). Euclidean distance between the receptive field centers (black line and value) and the distance of each receptive field center to the equator and the visual midline (colored lines and values) are indicated. Bottom right pictogram indicates the preferred direction of the target (blue arrow) and the grating receptive field (red arrow), and the difference between the two (black number). B, Location of target (blue) and grating receptive field centers (red) across 98 neurons. C, Vertical distance between target (blue) and grating receptive field centers (red) and the visual equator (10° bins). The target receptive field center locations were significantly different from the grating receptive field center locations (p < 0.0001, Mann–Whitney test). D, Horizontal distance from the visual midline (10° bins). There was no significant difference between the target receptive field center distance to the midline, and the grating receptive field distance (Mann–Whitney test). E, Euclidean distance between the two receptive field centers of each neuron (10° bins). Gray data come from neurons where the target receptive field was dorsal to the grating receptive field center (N = 83), and black data come from neurons where the grating receptive field was dorsal to the target receptive field center (N = 15). When the grating receptive field center was dorsal (black), the distance between the two was significantly smaller (p < 0.0001, Mann–Whitney test). RF = receptive field.
We used the 50% response contours to locate the two receptive field centers (Figs. 2E,F, 3A, blue and red circles). Across the 98 neurons, the target receptive field centers cluster above the visual equator (Fig. 3B, blue), whereas the grating receptive field centers cluster below the equator (Fig. 3B, red), even if there are some exceptions (but see Fig. 4). We quantified the vertical distance between each receptive field center and the visual equator (44° and −50° in the example neuron; Fig. 3A), and found a bimodal distribution with target receptive field centers peaking 36° dorsal (median value) and grating receptive field centers peaking −36° (Fig. 3B,C, ventral).
A heterogeneous group of neurons. A, Target (blue) and grating (red) receptive field of an example neuron. The contour lines show the 50% response, and the circles show the centers of each receptive field. The arrows show the local preferred direction for positions where the response was >50% of the maximum local motion sensitivity. The bottom right pictogram indicates the average preferred direction for the target receptive field (blue) and the grating receptive field (red), as well as the difference between the two (black arc and value). The Euclidean distance between the two receptive field centers (black line and value) is indicated on the left. B, Example of a looming-sensitive neuron with small target and grating receptive fields, and a large distance between the centers. C, Example neuron with a large difference between their preferred directions. D, Example neuron where the grating receptive field is dorsal to the target receptive field. E, Example neuron where the grating receptive field is dorsal to the equator and overlapping with the target receptive field. F, Example neuron where the grating and target receptive fields are large and partially overlapping.
We next quantified the horizontal distance between each receptive field center and the visual midline (14° and 21° in the example neuron; Fig. 3A). Across neurons, we found a bimodal distribution with a gap along the visual midline (Fig. 3B,D). The grating receptive field center medians were at −27° and 19°, whereas the target receptive field center medians were at −25° and 20° (Fig. 3B,D). There was no significant difference between the target and the grating receptive field center distributions (Mann–Whitney test; left visual field, p = 0.31; right visual field, p = 0.40).
We noted that the target receptive field was often in the dorsal visual field, but that there were some exceptions (Figs. 3B,C, 4). We next investigated whether the target receptive field was always dorsal to the grating receptive field and determined the Euclidean distance between the two receptive field centers (Fig. 3A, black line, 82°). Across neurons, we found that the target receptive field was indeed most often dorsal to the grating receptive field (Fig. 3E, gray), and that the median distance between the two was 77°. When the grating receptive field was more dorsal, the two receptive field centers were significantly closer to each other (Fig. 3E, black data; median distance, 26°; p < 0.0001, Mann–Whitney test).
The grating receptive field is sensitive to motion away from the midline
We next determined the local motion sensitivity and average preferred direction of the target and grating receptive field of each neuron (Figs. 2G,H, 4, colored arrows). In the example neuron, the preferred direction of the target receptive field is toward the right (Figs. 2G, 3A, blue arrows), similar to the preferred direction of the grating receptive field (Figs. 2H, 3A, red arrows). For comparison across neurons, we color coded the preferred direction into four cardinal directions and plotted them as a function of receptive field center location. This analysis shows that the preferred direction of the target receptive fields depended on location (Fig. 5A). We found a significantly nonuniform distribution (p < 0.01, Rayleigh test), with a median direction preference up and away from the visual midline (vector lengths, 0.37 and 0.37; Fig. 5C, insets).
The preferred direction depends on the receptive field center location. A, The target receptive field centers, color coded according to their preferred direction (pictogram bottom right). B, The grating receptive field centers, color coded according to their preferred direction. C, Preferred direction of target receptive fields with centers in either the left or the right visual field (30° bins). The distribution for target receptive fields in the left visual field was significantly nonuniform (p < 0.001, Rayleigh test) with median preferred direction up and to the left, and a median vector length of 0.37 (polar plot, scale 0–1). The distribution for target receptive fields in the right visual field was significantly nonuniform (p = 0.0025, Rayleigh test) with median preferred direction up and to the right, and a median vector length of 0.37. D, Preferred direction of grating receptive fields centers in either the left or the right visual field (30° bins). The distribution for grating receptive fields in the left visual field was significantly nonuniform (p < 0.0001, Rayleigh test) with median preferred direction slightly up and to the left, and a median vector length of 0.83. The distribution for grating receptive fields in the right visual field was significantly nonuniform (p < 0.0001, Rayleigh test) with median preferred direction slightly up and to the right, and a median vector length of 0.66. E, Preferred direction difference between the target and grating receptive field of each neuron (10° bins). Gray data show neurons where the two receptive field centers were on the same side of the visual midline (N = 87), and black data show neurons with receptive fields on opposite sides of the visual midline (N = 11). These were not significantly different (p = 0.15, Mann–Whitney test). RF = receptive field.
The directionality of the grating receptive fields depended more strongly on center location (Fig. 5B,D). Indeed, we found a significantly nonuniform distribution (p < 0.0001, Rayleigh test), with median direction preferences slightly up and away from the visual midline (vector lengths, 0.82 and 0.66; Fig. 5D, inset).
We next quantified the difference between the preferred directions of the target and the grating receptive fields and if this depended on whether the receptive field centers were on the same side or not. In the example neuron, the difference is 8° (Figs. 2G,H, 3A, bottom right pictogram). We found that 87 neurons had receptive field centers on the same side of the visual midline (Fig. 5E, gray), whereas 11 had receptive field centers on opposite sides (Fig. 5E, black). The median direction difference was 75° if they were on opposite sides of the visual midline, and 44° if they were on the same side, albeit with neurons encompassing the entire span of possible directionality differences [Fig. 5E (but see Fig. 4)]. However, there was no distribution difference based on whether the two receptive field centers were on the same side (Fig. 5E, gray) or opposite sides (Fig. 5E, black) of the visual midline (Mann–Whitney test, p = 0.15).
Leading-edge sensitivity matches grating receptive field
These descending neurons thus have two receptive fields, one that responds to small target motion (Figs. 2–4, blue) and one that responds to local sinusoidal gratings (Figs. 2–4, red). Which one of these receptive fields is most likely to contribute to their looming sensitivity (Fig. 1A–D, right)? Looming-sensitive neurons in Drosophila, including the giant fiber, also respond strongly to high-contrast bars and edges (Ache et al., 2019b). We thus used full-screen OFF edges to map the looming receptive field (Fig. 6). An example neuron shows strong responses to an OFF edge sweeping left (Fig. 6A), down (Fig. 6C), or up (Fig. 6D) across the visual field, but not right (Fig. 6B). The resulting leading-edge receptive field (Fig. 6E,F, cyan) overlaps substantially with the grating receptive field (Fig. 6F, red), but not the target receptive field (Fig. 6F, blue).
Leading edge receptive field method. A, Example response from a single neuron (mean ± SEM) to a full-screen OFF edge moving left across the entire width of the screen. Dashed purple line indicates 50% of the maximum response achieved to any direction of leading-edge motion in this neuron. Thresholds (cyan lines) are defined as the time when the neuronal response passes 50% of the maximal response. B, Neuronal response to an OFF edge moving right. As the response did not reach 50% maximum, thresholds were not achieved in this direction. C, Neuronal response to an OFF edge moving down. D, The example neuron showed maximal response (solid purple line) to an OFF edge moving up. E, Leading edge receptive field (shaded cyan region), based on the screen position of stimulus when thresholds were reached (dashed cyan lines). F, Screen position for grating (red), target (blue), and leading edge (cyan) receptive fields for this example neuron. The data in A–D have been smoothed with a 100 ms square-wave filter and are shown at 40 kHz resolution. RF = receptive field.
Across neurons, we compared the location of the leading-edge, the target, and the grating receptive field centers (Figs. 6F, 7A, circles). A qualitative analysis shows that the leading-edge receptive field centers tend to cluster below the visual equator, just like the grating receptive field centers do (Fig. 7A, cyan and red). For quantification, we calculated a proximity index (Fig. 7B). When the leading-edge receptive field center is closer to the grating receptive field center the proximity index is positive, up to a maximum of 100%. In the example neuron, the proximity index is 83% (Figs. 6F, 7B). Across neurons, we found that the leading-edge receptive field centers were more frequently closer to the grating receptive field centers (11 vs 4 neurons; Fig. 7C). In those neurons where the leading-edge receptive field center was closer to the target receptive field center, the proximity index was lower (medians, −30%, 48%; Fig. 7C) and the difference was significant (Mann–Whitney test, p = 0.0015). In summary, it is likely that these neurons get their looming sensitivity predominantly within the ventral visual field, overlapping with the location of the grating receptive field.
The leading-edge receptive field is closer to the grating receptive field. A, The location of the target (blue), grating (red), and leading-edge (cyan) receptive field centers in 15 neurons. B, The receptive field centers for one example neuron (left), with distances (black lines) between the leading-edge and the target receptive field center (d1), or the grating receptive field center (d2), used to calculate the proximity index (right). C, Leading-edge proximity index across neurons (N = 15). The leading-edge receptive field was closer to the grating receptive field center (red) in more neurons (N = 11) than to the target receptive field (blue; N = 4). The distribution was significantly different from 0 (p < 0.01, one-sample t and Wilcoxon signed-rank test), and the two distributions were different from each other (p = 0.0015, Mann–Whitney test). RF = receptive field.
Different size response function in the two receptive fields
We previously showed that looming-sensitive neurons have a peculiar size response function, with one peak to bars of a few degrees height, similar to the size tuning of target-selective neurons, and a second peak to full-screen bars (Nicholas et al., 2020). To investigate whether this size sensitivity differs between the two receptive fields, we scanned bars of fixed width across the visual monitor, while varying the height. We used two different trajectories, one centered on the target receptive field (Figs. 8, 9A, blue), and one on the grating receptive field (Figs. 8, 9A, red). We found that the neurons responded strongly to small bars moving through the target receptive field (Figs. 8A–E, 9A, blue), but not through the grating receptive field (Fig. 8A–E, red). For the middle-sized bars, the neurons responded weakly whether they traversed the target or the grating receptive field (Figs. 8F–I, 9A).
Response to small bars is stronger in the dorsal target receptive field. Response from a single example neuron to a bar of varying height traversing the entire width of the screen (mean ± SEM, n = 4) across either the target receptive field (blue) or the grating receptive field (red). The 50% contour lines and centers for the target receptive field (blue) and grating receptive field (red) for this neuron are shown. Gray shading indicates the analysis window used to calculate the mean response for this neuron in Figure 9A. Bar heights for each panel are as follows: A, 0.2°; B, 0.8°; C, 1.6°; D, 3.1°; E, 5.7°; F, 11.2°; G, 21.2°; H, 39.7°; I, 69.7°; J, 106.5°; K, 137.6°. The data have been smoothed with a 100 ms square-wave filter and are shown at 40 kHz resolution.
The two receptive fields have different size response functions. A, The pictograms indicate the bar trajectory as it moved horizontally across the screen, subtending either the target receptive field (left, blue dashed line and arrow) or the grating receptive field (right, red dashed line and arrow; example bar height, 84°). Typical target and grating receptive fields for an example neuron are shown. The gray shading shows the analysis window used to calculate the mean response rate, which is the same for both trajectories. The graph shows that responses to small bars are significantly stronger when passing through the target receptive field (blue) compared with the grating receptive field (red, mean ± SEM, N = 8). B, The pictogram indicates the analysis windows used to calculate the response to a bar of varying width as it moved vertically along the screen (trajectory in black) subtending the target receptive field (blue) or the grating receptive field (red). The graph shows that responses to narrow bars are significantly stronger within the target analysis window (AW; blue), while responses to wider bars are significantly stronger within the grating analysis window (red, mean ± SEM, N = 10). Statistical test was a two-way ANOVA followed by Sidak’s multiple-comparisons test. ****p < 0.0001, ***p < 0.001, **p < 0.01, and *p < 0.05. RF = receptive field; AW = analysis window.
When the bars were extended to cover a large part of the visual monitor, they traversed both receptive fields (Fig. 8J,K), making it hard to determine which receptive field the strong response came from (Fig. 9A). To bypass this, we scanned the bars vertically instead of horizontally, so that they traversed the grating receptive field and the target receptive field at different points in time (Figs. 9B, 10, pictogram). We found that the neurons responded strongly when small bars moved through the target analysis window (Figs. 9B, 10A–E, blue), and strongly to large bars when they moved through the grating analysis window (Figs. 9B, 10G–L, red). This shows that the target receptive field is tuned to small targets, whereas the grating receptive field responds better to full-screen bars.
Sensitivity to bar width depends on which receptive field it is in. Response from an example neuron to a bar of varying width traversing the entire height of the screen (mean ± SEM, n = 4). Pictograms indicate the position of the bar trajectory as it moved vertically up the screen (black dashed line and arrow), traversing first the grating receptive field (red) and then the target receptive field (blue). Shading indicates the two analysis windows used to calculate the mean neuronal response for this neuron in Figure 9B. Bar widths for each panel are as follows: A, 0.2°; B, 0.8°; C, 1.6°; D, 3.1°; E, 5.7°; F, 11.2°; G, 21.2°; H, 39.7°; I, 69.7°; J, 106.5°; K, 137.6°; L, 155.4°. The data have been smoothed with a 100 ms square-wave filter and are shown at 40 kHz resolution. AW = analysis window.
Separate inputs to the two receptive fields
The data above show that looming neurons have two receptive fields (Figs. 2–7), with size tuning suggesting that they receive separate input (Figs. 8–10). What happens when they are stimulated simultaneously? To investigate this, we first determined the response when the two receptive fields were stimulated separately, by scanning a small target through the target receptive field (Fig. 11A, blue), and a series of bars through the grating receptive field [Fig. 11A, red (consistent with the data in Fig. 9)]. We compared this to the response to simultaneous stimulation (Fig. 11B, black). We found that the response to simultaneous presentation (Fig. 11B, black) was smaller than the linear sum of the two independent presentations (Fig. 11B, purple). Importantly, this cannot be because of response saturation, as the linear sum to the smallest bars (Fig. 11B, purple) is on par with the measured response to the largest bars (Fig. 11B, black).
Response to simultaneous stimulation of the two receptive fields. A, Responses to a small target traversing the target receptive field (blue) or bars of varying heights traversing the grating receptive field (red). The pictograms at the top show the screen position of each trajectory in relation to the receptive fields for an example neuron. Gray shading indicated the analysis window used to calculate the mean response rate. B, Pictogram showing the screen position of simultaneously presented target and the bar traversing the target and grating receptive fields. The graph shows that the responses to simultaneous presentation (black) are significantly lower than the sum of the responses to the same stimuli presented on their own (purple). C, The responses to simultaneous stimuli (black) are not significantly different from the strongest response evoked by either the target or the bar on its own (green). For all panels, the data show the mean ± SEM for the same N = 5. Statistical analysis was performed using two-way ANOVA. ****p < 0.0001, **p < 0.01; ns, p > 0.05. RF = receptive field.
We next compared the response to simultaneous presentation (Fig. 11C, black) with the strongest response for each neuron (Fig. 11C, green). We found that while there was a significant dependence on bar size, there was no significant difference between the two conditions (Fig. 11C, compare green, black; two-way ANOVA), suggesting nonlinear interactions. Similarly, the locust LGMD (Krapp and Gabbiani, 2005) displays nonlinear interactions when stimuli are placed in different parts of the visual field, suggesting that the details of its receptive fields may be worth investigating in the future.
Target receptive field is based on 1 point correlator input, whereas the grating receptive field uses 2 point correlator input
The data above show two independent receptive fields. What is the likely presynaptic input to each? Both optic lobe and descending target tuned neurons (Wiederman et al., 2013; Nicholas and Nordström, 2021) generate their target selectivity using 1 point correlators, which are based on the comparison of an OFF contrast change immediately followed by an ON contrast change at a single point in space (Wiederman et al., 2008). These correlators are fundamentally different from 2 point correlators, such as Hassenstein–Reichard elementary motion detectors (Hassenstein and Reichardt, 1956), in their response to high-contrast edges. For example, a 1 point correlator will respond only weakly to either OFF or ON contrast edges, compared with complete objects, whereas 2 point correlators respond equally well to single edges and complete objects [Fig. 12, inset (data replotted from the study by Wiederman et al., 2013)].
These looming neurons get input from both 1 and 2 point correlators. The response to a leading OFF edge, a trailing ON edge, or a complete bar, all with a height of 84°, traversing the grating receptive field (red, N = 9), a height of 3° traversing the target receptive field (blue, N = 10), or the full height of the screen (black, N = 7). The stimuli moved horizontally at a velocity of 209 mm/s. In all cases, the response from each neuron was normalized to the sum of the response to all three stimuli from the same trajectory (i.e., OFF edge only, ON edge only, or complete bar). The inset shows the predicted response of a motion detector that compares luminance changes over 1 point (also referred to as an elementary STMD) or 2 points in space (often referred to as an EMD). The inset pictograms are replotted from the study by Wiederman et al. (2013).
To investigate the potential input to the two receptive fields, we first scanned an OFF edge through the grating receptive field, then an ON edge, followed by a complete bar (Fig. 12, red). We found that the responses to single edges were similar to the response to a complete bar (ns; Fig. 12, red). The response was thus consistent with an underlying 2 point correlator input (Fig. 12, compare red data, inset). In contrast, when we scanned edges or targets through the target receptive field, the response to a complete target was much stronger than to either OFF or ON edges on their own (one-way ANOVA, followed by Tukey’s multiple-comparisons test, p < 0.0001; Fig. 12, blue). Indeed, the response was consistent with an underlying 1 point correlator input (Fig. 12, compare blue data, inset). In response to full-screen edges and bars, which cover both receptive fields, we found the strongest response to the OFF edge (p = 0.0049 for OFF vs bar, ns for ON vs bar; Fig. 12, black).
Discussion
We have shown here a group of descending neurons in the hoverfly E. tenax that are sensitive to both small moving targets and to looming stimuli (Fig. 1). We show that the neurons have two discrete receptive fields, with different locations (Figs. 2–4) and preferred directions (Figs. 2, 4, 5). We show that the looming sensitivity is likely associated with the ventral receptive field (Figs. 6, 7). The size tuning (Figs. 8–10) and sensitivity to OFF and ON contrast edges (Fig. 12) supports independent input to the two receptive fields, using two fundamentally different presynaptic pathways. The input from the two pathways is not linearly summed (Fig. 11).
Dual receptive fields
The neurons that we describe here were classified as looming sensitive based on a strong response to a looming stimulus (Fig. 1E,F) compared with an appearance control (Nicholas et al., 2020). However, as they also respond strongly to small moving targets (Figs. 1A–D, 9, left), they could have been classified as TSDNs. Indeed, the dragonfly TSDN DIT3 responds strongly to both small targets and to looming stimuli (Gonzalez-Bellido et al., 2013). In the locust, LGMD/DCMD neurons respond to both targets and to looming stimuli (Santer et al., 2012), and some central complex looming-sensitive neurons also respond to small moving targets (Rosner and Homberg, 2013). Similarly, in Drosophila, some optic lobe and descending looming-sensitive neurons also respond to smaller objects (de Vries and Clandinin, 2012; Klapoetke et al., 2017; Namiki et al., 2018; Ache et al., 2019b).
However, as opposed to these examples (Santer et al., 2012; Gonzalez-Bellido et al., 2013; Rosner and Homberg, 2013; Ache et al., 2019b), we show that the dual sensitivity to small targets and to larger objects is associated with two discrete receptive fields (Figs. 2–5). It is currently unknown whether the dual sensitivity described in other insects (Santer et al., 2012; Gonzalez-Bellido et al., 2013; Rosner and Homberg, 2013; Ache et al., 2019b) also comes from different receptive fields. In Drosophila, Foma-1 target sensitivity was specific to the dorsal visual field, similar to our data (Fig. 3B,C, blue), while the visual field location of the looming sensitivity was not specified (de Vries and Clandinin, 2012).
Our recordings were done extracellularly (Fig. 1), meaning that neurons with no spontaneous activity are difficult to discover without presenting a suitable stimulus. We used a small moving target to initially identify visual neurons (Fig. 1A–D, left), thus biasing our results toward those looming-sensitive descending neurons that also responded to small, dark targets. However, it is likely that there are looming neurons that do not respond to small objects, such as found in, for example, Drosophila (Klapoetke et al., 2017; Ache et al., 2019a) and crabs (Cámera et al., 2020). Additionally, our visual monitor was placed in front of the animal, thus biasing our results to neurons with frontal sensitivity. It is unlikely that the frontal clustering of receptive fields (Fig. 3B) was biased by our stimuli not being perspective distorted, as the response did not extend substantially laterally when using larger object sizes (Fig. 8, blue data). However, it is likely that there are additional looming-sensitive descending neurons with dorsal receptive fields, which could be useful, for example, in detecting predators approaching from above, or lateral receptive fields, which could be useful for avoiding imminent collision. For example, in the crab there are 16 retinotopically arranged looming-sensitive MLG1 neurons that underlie directional escape behaviors (Medan et al., 2015). While each receptive field is small, together the 16 neurons cover 360° of the visual field (Medan et al., 2015) and are thus able to encode directional escape responses.
A further technical limitation of our work was that we recorded from immobile animals that were placed upside down in front of the monitor. In this situation, there is no feedback from the motor system, which could affect neural responses (Fujiwara et al., 2017; Fenk et al., 2021).
Neuronal input mechanisms
We showed that the looming-sensitive descending neurons likely receive distinct input to the two receptive fields (Figs. 8–12). Indeed, the dorsal target receptive field is likely to use presynaptic 1 point correlators (Fig. 12, blue), just like TSDNs without looming sensitivity do (Nicholas and Nordström, 2021). Furthermore, the size tuning of the dorsal target receptive field (Figs. 8–10, blue) is similar to the size tuning of TSDNs without looming sensitivity (Nicholas et al., 2018b; Nicholas and Nordström, 2021), and of the presumably presynaptic STMDs (Nordström, 2012). This suggests that the dorsal target receptive field could share input with TSDNs without looming sensitivity.
In contrast, the ventral grating receptive field responded better to larger bars than to small targets (Figs. 8–10, red), similar to optic flow-sensitive descending neurons (Nicholas and Nordström, 2021). In addition, the ventral grating receptive field is likely to use presynaptic 2 point correlators of the elementary motion detector type (Fig. 12, red), similar to optic flow-sensitive neurons (Harris et al., 1999). Interestingly, the looming-sensitive LPLC2 neurons, which are presynaptic to the Drosophila giant fiber (Ache et al., 2019a), get their input from T4/T5 (Klapoetke et al., 2017), which is consistent with a 2 point, EMD-type, correlator input (Salazar-Gatzimas et al., 2016). As our leading-edge data suggest that looming sensitivity could be associated with the grating receptive field (Figs. 6, 7), this indicates that looming sensitivity might be generated by 2 point correlation. Indeed, in the housefly, escapes can be triggered by wide-field gratings, even if not as efficiently as by looming stimuli (Holmqvist and Srinivasan, 1991).
We found that the directionality of the grating receptive field depended strongly on the azimuthal location of the receptive field center (Fig. 5B,D). However, the directionality of the target receptive field was less dependent on its visual field location (Fig. 5A,C). In contrast, the preferred directions of TSDNs without looming sensitivity are highly correlated with receptive field location (Ogawa et al., 2023). In addition, we found that the direction preference differences of the two receptive fields covered the full 180° of possible direction differences (Fig. 5E), further supporting independent inputs.
Behavioral role
Previous work has shown that the same stimulus displayed in different parts of the visual field can elicit different behavioral output. For example, when crabs living in mudflats see a small dummy moved at ground level, they initiate prey pursuit behavior, but when the same dummy is moved above the crab, they try to escape it (Tomsic et al., 2017). In flying Drosophila, a looming stimulus in the lateral visual field leads to an escape response, whereas a looming stimulus in the frontal visual field leads to landing attempts (Tammero and Dickinson, 2002). While we did not stimulate the lateral visual field in our setups, the strong responses to frontal looming stimuli (Fig. 1A–D, right), likely associated with the ventral receptive field (Figs. 6, 7), suggest that this could be used during landing behaviors on, for example, flowers. Indeed, bees adjust their body angle when landing, so that the landing surface ends up in the ventral visual field (Evangelista et al., 2010).
Alternatively, the neurons that we described here could potentially be used in pursuit. Indeed, when a hoverfly is pursuing a target, during most of the pursuit it will be projected as a small object on the eye of the pursuer (Thyselius et al., 2023). When the hoverfly is below the target, having a dorsal target receptive field would be appropriate (Fig. 3A–C, blue). This could thus be supported by either the neurons described here (Figs. 2–4, blue) or by TSDNs without looming sensitivity (Nicholas et al., 2018b, 2020; Nicholas and Nordström, 2021).
During later stages of the pursuit, when the hoverfly gets closer to the target (Thyselius et al., 2023), this will be seen as a looming object. It has been suggested that this part of the pursuit cannot be subserved by classic target-tuned neurons, but instead requires neurons that respond to larger objects and looming stimuli (Bagheri et al., 2015, their Discussion section) like in zebrafish larvae (Henriques et al., 2019). Furthermore, during the final stages before capture, the pursuer would need to orient itself to grab the target with its legs. During this stage, the target would be seen as a larger object in the ventral visual field, which would make the more ventral receptive field useful (Figs. 2–4, red).
The behavioral output required during initial target detection and final capture, for predator avoidance and landing, are all quite different. The descending neurons play an important role in sensorimotor transformation (Namiki et al., 2018), but it is difficult to see how the same descending neuron could control such different behaviors. However, as behavioral state has a strong effect on visual neurons (Fujiwara et al., 2017; Fenk et al., 2021), this could help modulate the behavioral output. For example, Drosophila Foma-1 controls escape responses in stationary flies (de Vries and Clandinin, 2012) as well as courtship in moving flies (Coen et al., 2016). Future work investigating the impact of internal state, as well as where the neurons described here project to (Lesser et al., 2023), and which behaviors they thus could contribute to, will help to elucidate this.
Acknowledgments
Acknowledgment: We thank past and current laboratory members for constructive feedback, and the Botanic Gardens of Adelaide for their ongoing support.
Footnotes
The authors declare no competing financial interests.
This research was funded by the US Air Force Office of Scientific Research (Grant FA9550-19-1-0294) and the Australian Research Council (Grants DP180100144, DP210100740, DP230100006, and FT180100289).
This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International license, which permits unrestricted use, distribution and reproduction in any medium provided that the original work is properly attributed.