8000 Commits · pytorch/serve · GitHub

More Web Proxy on the site http://driver.im/

Commits

Commits on Sep 13, 2024

Example to demonstrate building a custom endpoint plugin (#3306)
namannandan
authored

Commits on Jul 23, 2024

Implement stateful inference session timeout (#3263)

namannandan
and
mreso
authored

Commits on Jul 16, 2024

Enable token authorization and model control for gRPC (#3238)
namannandan
authored

Commits on Jul 15, 2024

Reduce severity of xpu-smi logging (#3239)
namannandan
authored

Commits on Jun 22, 2024

Fix sequence continuous batching close session race condition (#3198)
namannandan
authored

Commits on Jun 5, 2024

Fix Inf2 benchmark (#3177)
namannandan
authored

Commits on May 16, 2024

Update supported TS version in security documentation (#3144)
namannandan
authored

Commits on May 9, 2024

Commits on Apr 26, 2024

Clean up metrics documentation (#3050)
namannandan
authored

Commits on Apr 24, 2024

Increase test timeout for test_handler_traceback_logging. (#3113)
namannandan
authored

Commits on Apr 22, 2024

Log entire stdout and stderr for terminated backend worker process (#3036)
namannandan
authored

Commits on Apr 17, 2024

Update security documentation to include security scanning tools (#3084)
namannandan
authored

Commits on Apr 11, 2024

Fix GRPC address assignment to localhost by default (#3083)
namannandan
authored

Commits on Mar 13, 2024

Publich torchserve nightly & release cpp dev docker images (#3023)
namannandan
authored

Commits on Mar 12, 2024

Refactor Dokcerfile.cpp and documentation (#3015)
namannandan
authored

Commits on Mar 11, 2024

Enable building dev docker image with CPP backend support (#2976)
namannandan
authored

Commits on Feb 23, 2024

Refactor model venv support (#2954)

namannandan
and
agunapal
authored

Commits on Feb 20, 2024

Enable venv to inherit site packages from base python environment (#2946)
namannandan
authored

Commits on Feb 9, 2024

Enable model custom dependency installation using virtual environment (#2910)

namannandan
and
agunapal
authored

Commits on Jan 22, 2024

Skip specifying numpy, protobuf and grpcio-tools in neuronx dependencies (#2900)
namannandan
authored

Commits on Jan 13, 2024

Install Neuron driver and associated packages (#2893)
namannandan
authored

Commits on Jan 3, 2024

Fix Inf2 package dependency version conflicts (#2887)
namannandan
authored

Commits on Dec 7, 2023

Add support for metrics legacy mode (#2816)
namannandan
authored

Commits on Nov 21, 2023

Auto detect backend metrics not defined in metrics configuration (#2769)
namannandan
authored

Commits on Nov 16, 2023

Enable inf2 benchmark (#2793)
namannandan
authored

Commits on Nov 9, 2023

Fix kserve docker nightly build (#2778)
namannandan
authored

Commits on Oct 12, 2023

Revert references to 127.0.0.1 back to 0.0.0.0 for Kserve and Kubernetes (#2698)

namannandan
and
Naman Nandan
authored

Commits on Oct 10, 2023

Fix metric unit assignment (#2693)

namannandan
and
Naman Nandan
authored

Commits on Oct 3, 2023

Bind torchserve container ports to localhost ports (#2646)

authored

Commits on Oct 2, 2023

Update default address from 0.0.0.0 to 127.0.0.1 in documentation and examples (#2624)

namannandan
and
Naman Nandan
authored

Commits on Sep 26, 2023

Update path to sample input text for inf2 opt benchmark model (#2617)

namannandan
and
Naman Nandan
authored
Llama2 on inf2 example tests, bug fixes and documentation (#2607)

namannandan
and
Naman Nandan
authored

Commits on Sep 19, 2023

Example for Llama2 on Inf2 (#2458)

namannandan
and
Naman Nandan
authored

0