Quantifying Mesoscale Neuroanatomy Using X-Ray Microtomography

Synchrotron X-ray tomography of a millimeter-scale brain sample. A schematic illustration of the imaging setup is displayed along the bottom: from left to right, the synchrotron X-ray source interacting with an embedded sample of somatosensory cortex as it is rotated during the collection of multi-angle projections. To collect this projection data, X-rays are passed through a scintillator crystal that converts the energy into visible light photons. These photons are then focused onto a light camera sensor, before a sinogram is generated via data collection from a row of sensor pixels. In the three panels above, visualizations of the neocortical sample preparation (a), location of the mounted sample within the instrument (b), and conversion and focusing of X-rays into light photons (c).

Synchrotron X-ray imaging provides micron resolution within a neocortical volume. a, Microscopic visualization of cells, blood vessels, and dendrites within an X-ray–imaged volume of somatosensory cortex. Each panel shows one of three perspectives within the xyz coordinate framework (panels to the right are 11.5 µm wide, large panel to the left is 100 µm wide). b, Digital rendering of a manually reconstructed subset of blood vessels and cell bodies (nuclei highlighted) selected from within the neocortical volume. c, Photomicrographs of a subvolume within this sample, using µCT and EM to identify overlapping regions. These images were collected at three different pixel sizes (0.65 µm, 100 nm, 3 nm). In the left panel, a subset of a single virtual slice from an X-ray tomogram that spans the neocortical volume (0.65 µm pixel size). Outlined in blue to the right of this is a subset of the volume (within a) that highlights a configuration of three cell bodies and distinct proximal microvessels. This sample was subsequently serially sectioned and imaged in a scanning electron microscope. These cells are located in the EM dataset (inset), the ultrastructure of which is well preserved, even after µCT (right in red).

Image processing and computer vision pipeline for segmentation and cell detection. Block diagram displaying the entire X-BRAIN workflow is described. The integration of sparsely labeled training data into our segmentation module (Step 1) is used to train a random forest classifier using ilastik. Densely annotated training data are used to perform hyperparameter optimization to tune our cell detection algorithm in Step 2. The final map of detected cells is displayed at the bottom of Step 2, with detected cells overlaid on the original X-ray image. Solid arrows, inputs into a module; dashed arrows, outputs; filled circle terminal, outputs that are stored in the spatial database.

Visualization of X-ray image data, overlaid probability maps, and final segmentations. On the left, an X-ray micrograph. On the right, clockwise from upper left: vessel probabilities, cell probabilities, cell probabilities and segmentations, and the segmentations of cells and vessels.

Automated methods for segmentation and cell detection reveal dense mesoscale brain maps. a, Performance of vessel segmentation and cell detection methods, as hyperparameters that affect the performance of the method, are varied. To optimize performance of the vessel segmentation method, the f₂ score is computed—emphasizing recall—for multiple operating points (each curve represents a fixed parameter set with a varying vessel segmentation threshold). To measure performance for cell detection, the f₁ score—balancing precision and recall—is calculated for multiple operating points as the stopping criterion is increased (x axis) in the greedy cell finder algorithm. Highlighted curves within each plot and the accompanying “star” indicate optimal hyperparameter performance. b, Results of cell detection and vessel segmentation algorithms on manually annotated test datasets. The training volumes V1 (195 × 195 × 65 µm and V2 (130 × 130 × 65 µm) and test volume V3 (130 × 130 × 130 µm) are visualized within the entire volume of X-ray–imaged tissue. c, Training volumes V1 and V2 and test volume V3 individually visualized. In each manually annotated subvolume, the results of X-BRAIN are overlaid, based on the best operating point selected by the parameter optimization approach in a. The precision (p) and recall (r) values for each subvolume are further annotated.

Visualization of 3D reconstructions of the neural architecture within a millimeter-scale neocortical sample. a, Renderings of the vessel segmentation algorithm output across the depth of the entire analyzed sample. b, Visual perspective of the cell detection algorithm output integrated with renderings from vasculature displayed in a, with hatched inset showing the same subset of both neurons and vessels.

Spatial statistics of X-ray volumes reveal layering and spatially diverse distribution of cell bodies. Top right, histograms of the estimates of the cell density over the extent of the entire sample of mouse cortex, distances between the center of each cell and its nearest neighbor (cell-to-cell distances), and distances between the center of each cell and the closest vessel voxel (cell-to-vessel distances). Top left, 3D rendering of the detected cells and vessels in the entire sample, with a manually labeled cube (V1) highlighted in blue. To confirm the 3D structure of this visualization (bottom left), confirmation is provided in the maps provided to the right: cell probability (red indicating high probability), detected cells (each detected cell displayed in a different color), and density estimates (bright yellow indicating high density). These results provide further confirmation that the 3D structure of the sample is preserved within our density estimate.