daviestechlabs/ray-serve
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
2edafc33c0495ef75b244709b86728076d320050
ray-serve/ray_serve/serve_llm.py
Billy D. 2edafc33c0
All checks were successful
Build and Publish ray-serve-apps / build-and-publish (push) Successful in 1m3s
Details
async vllm is better.
2026-02-11 06:05:50 -05:00

4.0 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink