AssemblyAI

AssemblyAI is a Voice AI platform for developers. It provides speech-to-text, streaming transcription, speech understanding, LLM Gateway, guardrails, and a Voice Agent API for teams building speech products.

The main decision is not AssemblyAI versus a meeting note app. It is AssemblyAI versus Deepgram, Whisper, Google Speech-to-Text, Azure AI Speech, Amazon Transcribe, and other API providers.

What Changed Since The Last Refresh

The June 18 refresh found that AssemblyAI changed more in product shape than in headline STT prices.

• Universal 3.5 Pro is now documented as a preview pre-recorded model with 18-language support.
• Its main test reasons are stronger accented-English handling, code switching, contextual prompting, and Universal-2 fallback for broader language coverage.
• reasoning, TTS, tool calling, logs, and observability at $4.50/hr.
• The model map is sharper: Universal-3 Pro remains the high-accuracy pre-recorded route, Universal-2 is the lower-cost and 99-language fallback route, Universal-3 Pro Streaming is the premium real-time route, and Universal-Streaming is the lower-cost real-time route.
• LLM Gateway and Speech Understanding now need regional scrutiny because AssemblyAI documents US and EU endpoints, 25+ model access, fallbacks, post-processing, transcript injection, streaming-turn LLM calls, and paid rate limits.
• Billing risk is clearer than the older page implied: pre-recorded files bill by processed audio seconds, streaming bills by open WebSocket session duration, unclosed streams can bill until the 3-hour auto-close, and multichannel files bill per channel.
• The docs now explicitly support AI coding-agent workflows through an integration prompt, docs MCP server, and AssemblyAI skill, which matters for teams letting Codex, Claude Code, Cursor, Copilot, or Devin scaffold integrations.

When to pick AssemblyAI

• You need strong transcription quality. Test against your own audio before committing.
• You need more than a transcript. Speaker labels, formatting, summaries, chapters, and content signals matter.
• You are building real-time voice experiences. Streaming transcription is a core product.
• You want one voice AI API surface. STT, speech understanding, LLM Gateway, and guardrails are under one vendor.
• You need developer documentation and examples. The platform is built for API integration.
• You want a voice-agent path. AssemblyAI now promotes a Voice Agent API as the fastest path to a working voice agent.
• You need AI-agent-friendly docs. The docs now publish coding-agent instructions, MCP setup, and skill guidance for integration work.

When to pick something else

• Voice agents with bundled TTS: Deepgram may be cleaner for full live voice stacks.
• Meeting assistant: Fathom, Fireflies, Read AI, Tactiq.
• Editing: Descript.
• Local open transcription: Whisper.

Pricing

AssemblyAI now ships a generous free tier (up to 185 hours of pre-recorded transcription and 333 hours of streaming with no credit card) in place of the older $50 credit grant shown on stale third-party summaries. Paid speech-to-text pricing varies by model, with Universal-2 and Universal-3 Pro listed at different hourly rates. Streaming transcription, Voice Agent API usage, guardrails, LLM Gateway, and speech understanding features have separate pricing.

The practical unit is audio hours plus add-ons. Teams should test cost using real audio length, concurrency, required features, and volume discounts.

As verified on 2026-06-18, the pricing page lists pre-recorded Universal-3 Pro at $0.21/hour and Universal-2 at $0.15/hour. Streaming pricing ranges from $0.15/hour for Universal-Streaming and Universal-Streaming Multilingual, up to $0.45/hour for Universal-3 Pro Streaming. Voice Agent API stays at $4.50/hour ($0.075/minute). Add-ons such as diarization, keyterms prompting, prompting beta, Medical Mode, Voice Focus, PII text redaction, translation, entity detection, sentiment, chapters, and summaries can add separate hourly charges.

Important: streaming is billed by WebSocket session duration, not by audio actually sent. Close sessions deliberately. AssemblyAI’s billing docs say unclosed streaming sessions can auto-close after 3 hours and bill for that full session time.

Evaluation checklist

Run AssemblyAI against the exact audio that matters:

• Clean recordings, noisy calls, crosstalk, accents, and specialized vocabulary.
• latency and reconnect behavior for live products.
• Diarization and speaker identification quality for multi-speaker audio.
• Universal 3.5 Pro preview behavior on accented English, code-switching, and contextual prompts.
• Medical, legal, sales, or support terminology if the domain is specialized.
• Voice Agent API fit versus owning your own STT, LLM, TTS, telephony, and observability stack.
• Speech Understanding features such as summaries, chapters, sentiment, PII, entities, and translation.
• Total cost after add-ons, not just base transcription.

Buyer fit

AssemblyAI is strongest for teams that want a speech API with richer interpretation layers. A transcription product, call-intelligence system, voice-notes app, customer-support analytics workflow, or voice-agent prototype can benefit from having transcription and speech understanding under one vendor.

It is less attractive when the job is simply recording meetings or editing podcasts. In those cases, a finished app handles calendar joins, UI, sharing, editing, and summaries without requiring an engineering team to build the product around the API.