computer vision

Mask R-CNN with the TensorFlow C++/CUDA API: Automatic Rotoscoping

I made a Plug-in for Adobe Premiere/After Effects that uses the TensorFlow object detection framework to automatically detect objects and generate segmentation masks for them. Compiling the TensorFlow as a C++ library for Windows with CUDA functionality was quite a tedious task, but in the end I was able to build a plug-in using Mask R-CNN to generate quite acceptable masks for objects contained in the 90 COCO classes.