Dograh
Open-weight models

Voice agents on your own GPUs, with no audio sent to AI model providers

Dograh is the self-hostable voice agent platform with an open-source workflow builder. Put open-weight speech and language models on a GPU you own while Dograh runs the call around them, so no audio goes out to a model provider.

6,000+GitHub starsBSD-2open source$0platform fee, self-hostedAny systemconnects to the tools you use
01 / How it works

Two layers on one machine

Example
Pick open-weight modelsload them on one 24GB cardpoint Dograh at the local endpointstest on a real phone call
01 · Choose

Fill the model layer yourself

Open weightsmodels you download and run

Each model in the call can be an open-weight release you host, so no provider ever hears the audio.

→ Read each licence, some ban commercial use

02 · Fit

Size it to one card

Quantizationsmaller weights, a little less accuracy

A 4-bit 27B language model fits beside a small speech-to-text model on a single 24GB GPU.

→ Check the speech model's memory before adding it

03 · Connect

Keep the orchestrator as it is

Orchestrationthe call flow, kept apart from the models

Dograh runs the call flow and telephony whichever models sit underneath, so moving them local later means changing settings.

→ Start on hosted models, move local when ready

02 / What runs where

Choose what fills the model layer

Open weights you host
Your own GPUQwen3.8 27BGemma 4 31BParakeet TDT 0.6B v2Chatterbox (clones voices)Magpie TTS (fixed voices)

Only this column keeps the call audio on your hardware.

Hosted models
Dograh's model stackYour own LLM keysYour own speech and voice keys

Quick to start, but the provider still receives the audio.

Same on every option
Visual workflow builderHTTP API toolKnowledge baseCall tracesWebhooks

None of this changes when the models move.

03 / Before you go live

Check these before the first real call

  1. Licences readEach model allows commercial use, and attribution is in place where the licence asks for it.
  2. Memory measuredBoth models loaded together at your context length, with room left on the card.
  3. Phone call testedLatency was measured on a real phone call, since the phone network adds delay a browser test hides.
  4. Voice choice checkedIf the design needs a cloned voice, the TTS model can clone. Magpie cannot.
  5. No outside endpointsEvery model URL in the agent points at your own hardware.
04 / Why it holds up

What owning the model layer buys you

Audio stays on your hardware

Self-host Dograh with open weights beside it, and no part of the call reaches a model provider.

No hop between stages

Colocated models pass audio to each other on one machine, so there is no round trip to wait on.

Flat cost at any volume

A GPU you own costs the same at 200 calls a day or 20,000. Engineer time still costs money.

Move local when you're ready

Start on hosted models and swap the model layer later without rebuilding the agent.

05 / Dograh vs hosted platforms

What changes when you own both layers

What you getDograhHosted voice platforms
Open-source orchestrator you can read and change (BSD-2)✓✕
Runs on your own servers✓✕
Open-weight models on your own GPU✓✕
No per-minute platform fee when self-hosted✓✕
06 / Guides

Build the local stack, step by step

Complete guideRunning Voice AI on Local, Self-Hosted Models: The Complete GuideRead →GuideLive vs Recorded Speech-to-Text: Which One Does a Voice Agent Need?Live speech-to-text hears the caller during a voice agent call, and recorded speech-to-text reads the saved audio afterwards. What each one needs, Nvidia's two Nemotron models as the example, and where each runs in Dograh.Industry InsightNvidia Nemotron 3.5 Transcribe: What It Means for Voice AgentsWhat Nvidia's open-weight Nemotron 3.5 Transcribe does, why it is built for recordings rather than live calls, and how to run it on a voice agent's call recordings on your own servers.TechnicalSTT and TTS Concurrency Limits: When Several API Keys HelpWhere speech-to-text and text-to-speech vendors count concurrency, what several API keys on one Dograh connection do, when separate keys add capacity, how to turn a limit into a call count, and when to ask the vendor instead.GuideVoice Cloning for Pre-Recorded and TTS Playback in One VoiceHow to make a voice agent's recorded lines and generated speech sound like one person: get written consent, clone the speaker with a TTS provider, put the recordings and the voice ID in Dograh, and tell callers it is AI.TutorialHow to Run Kokoro TTS Locally for a Phone Voice AgentA step-by-step tutorial to run Kokoro TTS on your own GPU with Kokoro-FastAPI inside Dograh's Docker setup, set the model, voice and speed fields, and prove the voice with a browser call and a phone call.TutorialHow to Run Faster-Whisper Locally for a Voice Agent With SpeachesA step-by-step tutorial to run faster-whisper on your own GPU with Speaches, inside Dograh's Docker setup, connect it as the agent's speech-to-text, pick a model size for phone audio and prove it with a test call.ComparisonKokoro vs Chatterbox vs Coqui XTTS: Open-Source TTS for Voice AgentsA comparison of Kokoro, Chatterbox and Coqui XTTS for a self-hosted voice agent: licenses, how each connects to Dograh, voice quality and speed on a phone line, and voice cloning.ComparisonWhisper vs Parakeet vs Voxtral: Choosing a Self-Hosted STT ModelA comparison of Whisper, Parakeet and Voxtral for a self-hosted phone voice agent: how each model is served, accuracy on phone audio, speed and GPU memory, languages and licenses, and how each connects to Dograh.TechnicalHow to Choose an LLM for Voice Agents: Test the Tool Calls FirstHow to choose a language model for a voice agent: test tool calls made from spoken input first, then reply speed on a real phone call, then cost per call, and decide between hosted models and open weights, with the models Dograh can run.ComparisonBYOK vs Managed Models: Controlling Voice AI SpendBring your own key (BYOK) versus a platform's managed models for voice AI: who bills you, what each rate covers, how key pools and backup models control spend and outages, what BYOK does not change about data, and how to set up each mode in Dograh.TutorialHow to Cut Voice AI Costs by Mixing Pre-Recorded Audio With TTSRecord the lines your agent repeats, synthesise the rest in the same cloned voice, and see which line on the bill actually moves.Industry InsightWhy Voice Data Needs to Stay Local: Privacy, PII, and Biometric RiskA phone call is ordinary personal data and a biometric identifier at the same time. What Illinois, the EDPB and the 2026 voiceprint filings mean for where your inference runs.TutorialHow to Build a Voice Agent on Fully Local Open-Source ModelsThe build side of running voice AI locally: what fits on one 24GB card, which runtime to use per stage, and what the latency actually looks like on a phone call.
Questions
Does bring your own key give me data sovereignty?+

No. It changes who holds the billing relationship. The audio still travels to the provider and is processed on their servers.

Is Dograh a voice model?+

No. Dograh is the orchestrator that runs the call flow and telephony. The speech and language models are a separate layer you choose.

What hardware do I need to run open weights?+

One 24GB GPU fits a 4-bit 27B language model beside a small speech model such as Parakeet TDT 0.6B v2. Benchmark your own box.

Will self-hosting make my agent slower?+

Running every stage on one machine removes the network hop between them. Test on a real phone call, because the phone network adds its own delay.

Can I start hosted and move to open weights later?+

Yes. The orchestration layer stays the same, so moving the models onto your own hardware is a configuration change.

Are open-weight models the same as open source?+

No. Open weights means you can download and run them. Licences vary, and some forbid commercial use, so read each one.

Keep the orchestrator. Change the models later.

Self-host in one command, or start on Dograh Cloud.

$ curl … start_docker.sh && ./start_docker.sh