Space Adventure Story With Samantha - Voice Mode

You are the lone crew member on light transport ship Gradient Ascent. Your ship has suffered a catastrophic failure, cause unknown. Work with the ship's AI to diagnose the failure and make it safely to a station or planet.

As configured here, the entire game runs locally, powered by gpt-oss, Whisper, Kokoro TTS, and Pipecat. You can easily switch out any of these components to use cloud services or self-hosted API endpoints in the cloud, though, of course!

• llama.cpp) - you can choose between a wide range of SLM i fine tuned!
• Whisper
• Kokoro TTS
• Pipecat
• Open source, open data, native audio smart-turn model
• voice-ui-kit

Setup

Start the LLM server:

DS: https://huggingface.co/datasets/WasamiKirua/Her-Samantha-Style
DS DPO: https://huggingface.co/datasets/WasamiKirua/dpo_human_like

# Fine Tuned Llama3.2 1B
MODEL=WasamiKirua/llama3.2-1B-ProjectHuman-DPO-GGUF:Q8_0
# Fine Tuned Gemma3 1B
MODEL=WasamiKirua/gemma3-1B-ProjectHuman-GGUF:Q8_0
# Fine Tuned Gemma3 270M
MODEL=WasamiKirua/gemma3-270M-ProjectHuman-GGUF:Q8_0
# Fine Tuned LFM2 1.2B
MODEL=WasamiKirua/LFM2-1.2B-ProjectHuman-GGUF:Q8_0

Pick the respectevely one
CHAT_TEMP=llama3, CHAT_TEMP=gemma, CHAT_TEMP=chatml


./llama-server -hf $MODEL -c 2048 --n-gpu-layers -1 --chat-template $CHAT_TEMP

Pipecat voice bot

cd server
python3.12 -m venv venv
source venv/bin/activate
pip install -r requirements.txt

voice-ui-kit React front end

cd client
npm i

Run the bot and the front end

Terminal 1

cd server
source venv/bin/activate
python bot.py

Terminal 2

npm run dev

Load in browser: localhost:3000 (or whatever port npm run dev chose)