Tractography is a powerful technique capable of non-invasively reconstructing the structural connections in the brain using diffusion MRI images, but the validation of tractograms is challenging due to lack of ground truth. Owing to recent developments in mapping the mouse brain connectome, high-resolution tracer injection-based axonal projection maps have been created and quickly adopted for the validation of tractography. Previous studies using tracer injections mainly focused on investigating the match in projections and optimal tractography protocols. Being a complicated technique, however, tractography relies on multiple stages of operations and parameters. These factors introduce large variabilities in tractograms, hindering the optimization of protocols and making the interpretation of results difficult. Based on this observation, in contrast to previous studies, in this work we focused on quantifying and ranking the amount of performance variation introduced by these factors. For this purpose, we performed over a million tractography experiments and studied the variability across different subjects, injections, anatomical constraints and tractography parameters. By using N-way ANOVA analysis, we show that all tractography parameters are significant and importantly performance variations with respect to the differences in subjects are comparable to the variations due to tractography parameters, which strongly underlines the importance of fully documenting the tractography protocols in scientific experiments. We also quantitatively show that inclusion of anatomical constraints is the most significant factor for improving tractography performance. Although this critical factor helps reduce false positives, our analysis indicates that anatomy-informed tractography still fails to capture a large portion of axonal projections.
Keywords: ANOVA; Connectome; Mouse; Tractography; Validation.