U-Net: Convolutional Networks for Biomedical Image Segmentation

Lecture notes in computer sciencePublished 1 January 2015Open access

Olaf Ronneberger, Philipp Fischer, Thomas Brox

DOI10.1007/978-3-319-24574-4_28

Source URL

Citations88,939

SJR quartileQ2

SJR score0.35

SNIP0.55

View PDF

TL;DR

It is shown that such a network can be trained end-to-end from very few images and outperforms the prior best method (a sliding-window convolutional network) on the ISBI challenge for segmentation of neuronal structures in electron microscopic stacks.

Abstract

There is large consent that successful training of deep networks requires many thousand annotated training samples. In this paper, we present a network and training strategy that relies on the strong use of data augmentation to use the available annotated samples more efficiently. The architecture consists of a contracting path to capture context and a symmetric expanding path that enables precise localization. We show that such a network can be trained end-to-end from very few images and outperforms the prior best method (a sliding-window convolutional network) on the ISBI challenge for segmentation of neuronal structures in electron microscopic stacks. Using the same network trained on transmitted light microscopy images (phase contrast and DIC) we won the ISBI cell tracking challenge 2015 in these categories by a large margin. Moreover, the network is fast. Segmentation of a 512x512 image takes less than a second on a recent GPU. The full implementation (based on Caffe) and the trained networks are available at .

Keywords

Computer ScienceBiochemistry, Genetics and Molecular BiologyEngineering

Communications of the ACMImageNet classification with deep convolutional neural networks

75,709 Citations2017Alex Krizhevsky, Ilya Sutskever +1 more

A large, deep convolutional neural network was trained to classify the 1.2 million high-resolution images in the ImageNet LSVRC-2010 contest into the 1000 different classes and employed a recently developed regularization method called "dropout" that proved to be very effective.

View PDF

arXiv (Cornell University)Very Deep Convolutional Networks for Large-Scale Image Recognition

75,540 Citations2014Karen Simonyan, Andrew Zisserman

This work investigates the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting using an architecture with very small convolution filters, which shows that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 weight layers.

View PDF

Fully convolutional networks for semantic segmentation

36,888 Citations2015Jonathan Long, Evan Shelhamer +1 more

The key insight is to build “fully convolutional” networks that take input of arbitrary size and produce correspondingly-sized output with efficient inference and learning.

Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification

18,777 Citations2015Kaiming He, Xiangyu Zhang +2 more

This work proposes a Parametric Rectified Linear Unit (PReLU) that generalizes the traditional rectified unit and derives a robust initialization method that particularly considers the rectifier nonlinearities.

Neural ComputationBackpropagation Applied to Handwritten Zip Code Recognition

11,878 Citations1989Yann LeCun, Bernhard E. Boser +5 more

This paper demonstrates how constraints from the task domain can be integrated into a backpropagation network through the architecture of the network, successfully applied to the recognition of handwritten zip code digits provided by the U.S. Postal Service.

Caffe

11,194 Citations2014Yangqing Jia, Evan Shelhamer +6 more

Caffe provides multimedia scientists and practitioners with a clean and modifiable framework for state-of-the-art deep learning algorithms and a collection of reference models for training and deploying general-purpose convolutional neural networks and other deep models efficiently on commodity architectures.

Hypercolumns for object segmentation and fine-grained localization

1,578 Citations2015Bharath Hariharan, Pablo Arbeláez +2 more

Using hypercolumns as pixel descriptors, this work defines the hypercolumn at a pixel as the vector of activations of all CNN units above that pixel, and shows results on three fine-grained localization tasks: simultaneous detection and segmentation, and keypoint localization.

Neural Information Processing SystemsDeep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images

1,280 Citations2012Dan Cireşan, Alessandro Giusti +2 more

This work addresses a central problem of neuroanatomy, namely, the automatic segmentation of neuronal structures depicted in stacks of electron microscopy images, using a special type of deep artificial neural network as a pixel classifier to segment biological neuron membranes.

Learning to generate chairs with convolutional neural networks

683 Citations2015Alexey Dosovitskiy, Jost Tobias Springenberg +1 more

This work trains a generative convolutional neural network which is able to generate images of objects given object type, viewpoint, and color and shows that the network can be used to find correspondences between different chairs from the dataset, outperforming existing approaches on this task.

arXiv (Cornell University)Discriminative Unsupervised Feature Learning with Convolutional Neural Networks

649 Citations2014Alexey Dosovitskiy, Jost Tobias Springenberg +2 more

This paper presents an approach for training a convolutional neural network using only unlabeled data and trains the network to discriminate between a set of surrogate classes, finding that this simple feature learning algorithm is surprisingly successful when applied to visual object recognition.

View PDF