Support Yolov5(4.0)/Yolov5(5.0)/YoloR/YoloX/Yolov4/Yolov3/CenterNet/CenterFace/RetinaFace/Classify/Unet. use darknet/libtorch/pytorch/mxnet to onnx to tensorrt

Torchserve server using a YoloV5 model running on docker with GPU and static batch inference to perform production ready and real time inference.

Ray Saturday Dec 2022 edition

Serve pytorch inference requests using batching with redis for faster performance.

Torchfusion is a very opinionated torch inference on datafusion.

Support batch inference of Grounding DINO. "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"

[WIP] Advanced workshop covering ML Batch serving on Azure

This repository provides sample codes, which enable you to learn how to use auto-ml image classification, or object detection under Azure ML(AML) environment.

LightGBM Inference on Datafusion

We perform batch inference on lead scoring task using Pyspark.

MLOps project that recommends movies to watch implementing Data Engineering and MLOps best practices.