Billy D.
1f833e0124
- embeddings.py: BGE embeddings demo with similarity - stt.py: Whisper speech-to-text demo - tts.py: XTTS text-to-speech demo - theme.py: Shared DaviesTechLabs Gradio theme - K8s deployments for each app
107 lines
2.8 KiB
Markdown
107 lines
2.8 KiB
Markdown
# Gradio UI
|
|
|
|
Interactive Gradio web interfaces for the DaviesTechLabs AI/ML platform.
|
|
|
|
## Apps
|
|
|
|
| App | Description | Port |
|
|
|-----|-------------|------|
|
|
| `embeddings.py` | BGE Embeddings demo with similarity comparison | 7860 |
|
|
| `stt.py` | Whisper Speech-to-Text demo | 7861 |
|
|
| `tts.py` | XTTS Text-to-Speech demo | 7862 |
|
|
|
|
## Features
|
|
|
|
- **Consistent theme** - Shared DaviesTechLabs theme via `theme.py`
|
|
- **MLflow integration** - Metrics logged for demo usage
|
|
- **Service endpoints** - Connect to KServe inference services
|
|
|
|
## Running Locally
|
|
|
|
```bash
|
|
pip install -r requirements.txt
|
|
|
|
# Run individual apps
|
|
python embeddings.py # http://localhost:7860
|
|
python stt.py # http://localhost:7861
|
|
python tts.py # http://localhost:7862
|
|
```
|
|
|
|
## Docker
|
|
|
|
```bash
|
|
# Build
|
|
docker build -t gradio-ui:latest .
|
|
|
|
# Run specific app
|
|
docker run -p 7860:7860 -e APP=embeddings gradio-ui:latest
|
|
docker run -p 7861:7861 -e APP=stt gradio-ui:latest
|
|
docker run -p 7862:7862 -e APP=tts gradio-ui:latest
|
|
```
|
|
|
|
## Kubernetes Deployment
|
|
|
|
```bash
|
|
# Deploy all apps
|
|
kubectl apply -k .
|
|
|
|
# Or individual apps
|
|
kubectl apply -f embeddings.yaml
|
|
kubectl apply -f stt.yaml
|
|
kubectl apply -f tts.yaml
|
|
```
|
|
|
|
## Configuration
|
|
|
|
| Environment Variable | Default | Description |
|
|
|---------------------|---------|-------------|
|
|
| `EMBEDDINGS_URL` | `http://embeddings-predictor.ai-ml.svc.cluster.local` | Embeddings service |
|
|
| `WHISPER_URL` | `http://whisper-predictor.ai-ml.svc.cluster.local` | STT service |
|
|
| `TTS_URL` | `http://tts-predictor.ai-ml.svc.cluster.local` | TTS service |
|
|
| `MLFLOW_TRACKING_URI` | `http://mlflow.mlflow.svc.cluster.local:80` | MLflow server |
|
|
|
|
## App Details
|
|
|
|
### embeddings.py
|
|
|
|
- Generate embeddings for text input
|
|
- Batch embedding support
|
|
- Cosine similarity comparison
|
|
- Visual embedding dimension display
|
|
|
|
### stt.py
|
|
|
|
- Upload audio or record from microphone
|
|
- Transcribe using Whisper
|
|
- Language detection
|
|
- Timestamp display
|
|
|
|
### tts.py
|
|
|
|
- Text input for synthesis
|
|
- Voice selection
|
|
- Audio playback and download
|
|
- Speed/pitch controls
|
|
|
|
## File Structure
|
|
|
|
```
|
|
gradio-ui/
|
|
├── embeddings.py # Embeddings demo
|
|
├── stt.py # Speech-to-Text demo
|
|
├── tts.py # Text-to-Speech demo
|
|
├── theme.py # Shared Gradio theme
|
|
├── requirements.txt # Python dependencies
|
|
├── Dockerfile # Container image
|
|
├── kustomization.yaml # Kustomize config
|
|
├── embeddings.yaml # K8s deployment
|
|
├── stt.yaml # K8s deployment
|
|
└── tts.yaml # K8s deployment
|
|
```
|
|
|
|
## Related
|
|
|
|
- [kuberay-images](https://git.daviestechlabs.io/daviestechlabs/kuberay-images) - Ray workers
|
|
- [handler-base](https://git.daviestechlabs.io/daviestechlabs/handler-base) - Handler library
|
|
- [homelab-design](https://git.daviestechlabs.io/daviestechlabs/homelab-design) - Architecture docs
|