Billy D.
a16ffff73f
- Add Dockerfiles for nvidia, rdna2, strixhalo, and intel GPU targets - Add ray-serve modules (embeddings, whisper, tts, llm, reranker) - Add Gitea Actions workflow for automated builds - Add Makefile for local development - Update README with comprehensive documentation
25 lines
306 B
Plaintext
25 lines
306 B
Plaintext
# Ray Serve dependencies
|
|
ray[serve]==2.53.0
|
|
|
|
# LLM inference
|
|
vllm
|
|
|
|
# Embeddings and reranking
|
|
sentence-transformers
|
|
|
|
# Speech-to-text
|
|
faster-whisper
|
|
|
|
# Text-to-speech
|
|
TTS
|
|
|
|
# HTTP client
|
|
httpx
|
|
|
|
# Numerical computing
|
|
numpy
|
|
scipy
|
|
|
|
# Optional: Intel GPU support (for danilo node)
|
|
# intel-extension-for-pytorch
|