object_detection

Tensorflow Object Detection API

Creating accurate machine learning models capable of localizing and identifying multiple objects in a single image remains a core challenge in computer vision. The TensorFlow Object Detection API is an open source framework built on top of TensorFlow that makes it easy to construct, train and deploy object detection models. At Google we’ve certainly found this codebase to be useful for our computer vision needs, and we hope that you will as well.

Contributions to the codebase are welcome and we would love to hear back from you if you find this API useful. Finally if you use the Tensorflow Object Detection API for a research publication, please consider citing:

"Speed/accuracy trade-offs for modern convolutional object detectors."
Huang J, Rathod V, Sun C, Zhu M, Korattikara A, Fathi A, Fischer I, Wojna Z,
Song Y, Guadarrama S, Murphy K, CVPR 2017

[link][bibtex]

Maintainers

• Jonathan Huang, github: jch1
• Vivek Rathod, github: tombstone
• Derek Chow, github: derekjchow
• Chen Sun, github: jesu9
• Menglong Zhu, github: dreamdragon

Table of contents

Quick Start:

• Quick Start: Jupyter notebook for off-the-shelf inference
  
• Quick Start: Training a pet detector
  

Setup:

• Installation
  
• Configuring an object detection pipeline
  
• Preparing inputs
  

Running:

• Running locally
  
• Running on the cloud
  

Extras:

• Tensorflow detection model zoo
  
• Exporting a trained model for inference
  
• Defining your own model architecture
  
• Bringing in your own dataset
  

Getting Help

To get help with issues you may encounter using the Tensorflow Object Detection API, create a new question on StackOverflow with the tags "tensorflow" and "object-detection".

Please report bugs (actually broken code, not usage questions) to the tensorflow/models Github issue tracker, prefixing the issue name with "object_detection".

Release information

October 31, 2017

We have released a new state-of-the-art model for object detection using the Faster-RCNN with the NASNet-A image featurization. This model achieves mAP of 43.1% on the test-dev validation dataset for COCO, improving on the best available model in the zoo by 6% in terms of absolute mAP.

Thanks to contributors: Barret Zoph, Vijay Vasudevan, Jonathon Shlens, Quoc Le

August 11, 2017

We have released an update to the Android Detect demo which will now run models trained using the Tensorflow Object Detection API on an Android device. By default, it currently runs a frozen SSD w/Mobilenet detector trained on COCO, but we encourage you to try out other detection models!

Thanks to contributors: Jonathan Huang, Andrew Harp

June 15, 2017

In addition to our base Tensorflow detection model definitions, this release includes:

• A selection of trainable detection models, including:
  • Single Shot Multibox Detector (SSD) with MobileNet,
  • SSD with Inception V2,
  • Region-Based Fully Convolutional Networks (R-FCN) with Resnet 101,
  • Faster RCNN with Resnet 101,
  • Faster RCNN with Inception Resnet v2
• Frozen weights (trained on the COCO dataset) for each of the above models to be used for out-of-the-box inference purposes.
• A Jupyter notebook for performing out-of-the-box inference with one of our released models
• Convenient local training scripts as well as distributed training and evaluation pipelines via Google Cloud.

Thanks to contributors: Jonathan Huang, Vivek Rathod, Derek Chow, Chen Sun, Menglong Zhu, Matthew Tang, Anoop Korattikara, Alireza Fathi, Ian Fischer, Zbigniew Wojna, Yang Song, Sergio Guadarrama, Jasper Uijlings, Viacheslav Kovalevskyi, Kevin Murphy