TY - JOUR T1 - Machine Learning-Based Pipette Positional Correction for Automatic Patch Clamp <em>In Vitro</em> JF - eneuro JO - eNeuro DO - 10.1523/ENEURO.0051-21.2021 VL - 8 IS - 4 SP - ENEURO.0051-21.2021 AU - Mercedes M. Gonzalez AU - Colby F. Lewallen AU - Mighten C. Yip AU - Craig R. Forest Y1 - 2021/07/01 UR - http://www.eneuro.org/content/8/4/ENEURO.0051-21.2021.abstract N2 - Patch clamp electrophysiology is a common technique used in neuroscience to understand individual neuron behavior, allowing one to record current and voltage changes with superior spatiotemporal resolution compared with most electrophysiology methods. While patch clamp experiments produce high fidelity electrophysiology data, the technique is onerous and labor intensive. Despite the emergence of patch clamp systems that automate key stages in the typical patch clamp procedure, full automation remains elusive. Patch clamp pipettes can miss the target cell during automated experiments because of positioning errors in the robotic manipulators, which can easily exceed the diameter of a neuron. Further, when patching in acute brain slices, the inherent light scattering from non-uniform brain tissue can complicate pipette tip identification. We present a convolutional neural network (CNN), based on ResNet101, to identify and correct pipette positioning errors before each patch clamp attempt, thereby preventing the deleterious effects of and accumulation of positioning errors. This deep-learning-based pipette detection method enabled superior localization of the pipette within 0.62 ± 0.58 μm, resulting in improved cell detection success rate and whole-cell patch clamp success rates by 71% and 59%, respectively, compared with the state-of-the-art cross-correlation method. Furthermore, this technique reduced the average time for pipette correction by 81%. This technique enables real-time correction of pipette position during patch clamp experiments with similar accuracy and quality of recording to manual patch clamp, making notable progress toward full human-out-of-the-loop automation for patch clamp electrophysiology. ER -