6 Commits

Author	SHA1	Message	Date
bhetherman	175ed943df	add KV-cache and move system promt to the config	2026-04-08 10:25:03 -04:00
bhetherman	c7c4019ecc	add lm studio option	2026-04-08 10:17:20 -04:00
bhetherman	08c5757b31	vad fix	2026-04-08 04:42:12 -04:00
bhetherman	263f39e0a3	Switch to CUDA 12.8 + ONNX-based VAD for RTX 5090 Blackwell support ... Upgrade PyTorch to 2.7+ with cu128 wheels for Blackwell (sm_120) GPU support. Replace silero-vad (which depends on torchaudio) with a direct ONNX Runtime implementation of the same Silero VAD model, eliminating the torchaudio dependency entirely. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	2026-04-08 04:01:27 -04:00
bhetherman	0305f1dccd	updates for docker take 1	2026-04-08 03:05:26 -04:00
bhetherman	ce41bca422	initial commit	2026-04-07 03:58:35 -04:00