Convolutional Networks Can Learn to Generate Affinity Graphs for Image Segmentation
Top Cited Papers
- 1 February 2010
- journal article
- Published by MIT Press in Neural Computation
- Vol. 22 (2) , 511-538
- https://doi.org/10.1162/neco.2009.10-08-881
Abstract
Many image segmentation algorithms first generate an affinity graph and then partition it. We present a machine learning approach to computing an affinity graph using a convolutional network (CN) trained using ground truth provided by human experts. The CN affinity graph can be paired with any standard partitioning algorithm and improves segmentation accuracy significantly compared to standard hand-designed affinity functions. We apply our algorithm to the challenging 3D segmentation problem of reconstructing neuronal processes from volumetric electron microscopy (EM) and show that we are able to learn a good affinity graph directly from the raw EM images. Further, we show that our affinity graph improves the segmentation accuracy of both simple and sophisticated graph partitioning algorithms. In contrast to previous work, we do not rely on prior knowledge in the form of hand-designed image features or image preprocessing. Thus, we expect our algorithm to generalize effectively to arbitrary image types.Keywords
This publication has 29 references indexed in Scilit:
- Segmentation of SBFSEM Volume Data of Neural Tissue by Hierarchical ClassificationPublished by Springer Nature ,2008
- Towards neural circuit reconstruction with volume electron microscopy techniquesCurrent Opinion in Neurobiology, 2006
- A fast kernel-based multilevel algorithm for graph clusteringPublished by Association for Computing Machinery (ACM) ,2005
- Spectral Segmentation with Multiscale Graph DecompositionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Serial Block-Face Scanning Electron Microscopy to Reconstruct Three-Dimensional Tissue NanostructurePLoS Biology, 2004
- Efficient Graph-Based Image SegmentationInternational Journal of Computer Vision, 2004
- Rapid automated three-dimensional tracing of neurons from confocal image stacksIEEE Transactions on Information Technology in Biomedicine, 2002
- Image processing with neural networks—a reviewPattern Recognition, 2002
- Fast approximate energy minimization via graph cutsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2001
- Computer-assisted registration, segmentation, and 3D reconstruction from images of neuronal tissue sectionsIEEE Transactions on Medical Imaging, 1994