DeepRoute-Engine is an inference engine that speeds up the neural network computation, allowing algorithms to run on an energy-efficient computing platform. This results in a 6x faster inference process than that of widely used open source deep learning frameworks (e.g. TensorFlow, PyTorch, Caffe) and is compatible with GPU of various brands, including NVIDIA, Intel, and AMD.
(video) DeepRoute’s Inference Engine
