daviestechlabs/kuberay-images
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fixing nvidia and strixhalo
Some checks failed
Build and Push Images / determine-version (push) Successful in 4s
Details
Build and Push Images / Release (push) Has been cancelled
Details
Build and Push Images / Notify (push) Has been cancelled
Details
Build and Push Images / build (Dockerfile.ray-worker-rdna2, rdna2) (push) Has been cancelled
Details
Build and Push Images / build (Dockerfile.ray-worker-strixhalo, strixhalo) (push) Has been cancelled
Details
Build and Push Images / build (Dockerfile.ray-worker-intel, intel) (push) Has been cancelled
Details
Build and Push Images / build (Dockerfile.ray-worker-nvidia, nvidia) (push) Has been cancelled
Details

Browse Source
This commit is contained in:
Billy Davies
2026-02-09 10:24:32 -05:00
parent 2a32dddd59
commit 2e3e014b80
2 changed files with 6 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
dockerfiles/Dockerfile.ray-worker-nvidia
View File

@@ -45,6 +45,7 @@ RUN --mount=type=cache,target=/home/ray/.cache/uv,uid=1000,gid=1000 \
'librosa>=0.10.0,<1.0' \ 'librosa>=0.10.0,<1.0' \
'torch>=2.0.0,<3.0' \ 'torch>=2.0.0,<3.0' \
'torchaudio>=2.0.0,<3.0' \ 'torchaudio>=2.0.0,<3.0' \
'transformers>=4.46.0,<5.0' \
'fastapi>=0.100.0,<1.0' \ 'fastapi>=0.100.0,<1.0' \
'uvicorn>=0.23.0,<1.0' \ 'uvicorn>=0.23.0,<1.0' \
'httpx>=0.27.0,<1.0' \ 'httpx>=0.27.0,<1.0' \

5
dockerfiles/Dockerfile.ray-worker-strixhalo
View File

@@ -115,6 +115,11 @@ RUN echo "import strixhalo_vram_fix" > \
# Pre-download common models for faster cold starts (optional, increases image size) # Pre-download common models for faster cold starts (optional, increases image size)
# RUN python3 -c "from sentence_transformers import SentenceTransformer; SentenceTransformer('BAAI/bge-large-en-v1.5')" # RUN python3 -c "from sentence_transformers import SentenceTransformer; SentenceTransformer('BAAI/bge-large-en-v1.5')"
# Pre-create aiter JIT build cache directory.
# The vLLM ROCm aiter package compiles kernels on first import and needs
# this directory writable by the ray user (uid 1000).
RUN mkdir -p /home/ray/.aiter
# Copy entrypoint script (ray-serve-apps is installed from PyPI at runtime) # Copy entrypoint script (ray-serve-apps is installed from PyPI at runtime)
COPY --chown=1000:100 --chmod=755 dockerfiles/ray-entrypoint.sh /app/ray-entrypoint.sh COPY --chown=1000:100 --chmod=755 dockerfiles/ray-entrypoint.sh /app/ray-entrypoint.sh