NVIDIA TensorRT-LLM
Don’t want to install NVIDIA TensorRT-LLM? Drop the file here.
The first 20 minutes of any recording are transcribed free: a recording up to 20 minutes transcribes in full, a longer one is previewed, and a pack from $6 (500 minutes) transcribes the rest and opens every export, and credits never expire.
NVIDIA's optimized inference for Whisper, Canary, Parakeet on Triton.
Best for squeezing the last 30% of throughput out of NVIDIA GPUs for ASR. Pricing: free.
What it is
The premier NVIDIA inference engine; produces engine files via TRT compilation. Apache-2.0.
Watch out for: NVIDIA-only; high engineering overhead; license is Apache-2.0 but requires NGC.
Install / use
git clone https://github.com/NVIDIA/TensorRT-LLMWhat people actually do with NVIDIA TensorRT-LLM-style transcription
The tool is the means. These are the jobs — each one priced at published rates, each one wired up on its own page.
Features
| Speaker diarization | No |
| Word-level timestamps | Yes |
| Streaming / real-time | No |
| Languages supported | 60 |
| HIPAA eligible | No |
Links
NVIDIA TensorRT-LLM vs Whipscribe
| Feature | NVIDIA TensorRT-LLM | Whipscribe |
|---|---|---|
| Category | Open source | Transcription APIs |
| Pricing | free | $6–$24 one-time packs (credits never expire) · first 20 minutes free |
| Speaker identification | No | Named in the summary, key quotes and chapters |
| Word timestamps | Yes | Yes |
| Streaming | No | No |
| Languages | 60 | 99 |
| Platforms | Linux, Docker | Web, API, MCP |
Alternatives to NVIDIA TensorRT-LLM
Frequently asked about NVIDIA TensorRT-LLM
Is NVIDIA TensorRT-LLM free?
Yes. NVIDIA TensorRT-LLM is free and open source.
Does NVIDIA TensorRT-LLM work on Mac, Windows and Linux?
NVIDIA TensorRT-LLM runs on Linux and Docker. It is not listed for other platforms; check the vendor for anything beyond Linux and Docker.
How do I install NVIDIA TensorRT-LLM?
Clone and run it from source: `git clone https://github.com/NVIDIA/TensorRT-LLM`. Expect to install its dependencies yourself — the README has the exact steps per OS.
How many languages does NVIDIA TensorRT-LLM support?
NVIDIA TensorRT-LLM lists 60 languages.
Does NVIDIA TensorRT-LLM identify different speakers?
No. NVIDIA TensorRT-LLM does not label speakers; a conversation comes back as one continuous text. If you need speaker labels, that is a separate tool or a different service.
Does NVIDIA TensorRT-LLM give word-level timestamps?
Yes — NVIDIA TensorRT-LLM produces timing per word, which is what subtitle cues and clip boundaries need.
Can NVIDIA TensorRT-LLM transcribe live audio?
No — NVIDIA TensorRT-LLM works on finished files, not a live stream.
Is NVIDIA TensorRT-LLM HIPAA compliant?
NVIDIA TensorRT-LLM does not claim HIPAA compliance. For PHI, run it on infrastructure you control or choose a service that will sign a BAA.
What are the limitations of NVIDIA TensorRT-LLM?
NVIDIA-only; high engineering overhead; license is Apache-2.0 but requires NGC.
Who is NVIDIA TensorRT-LLM best for?
Squeezing the last 30% of throughput out of NVIDIA GPUs for ASR.
Does NVIDIA TensorRT-LLM run offline?
NVIDIA TensorRT-LLM runs on your own machine — it is open source, so nothing leaves the computer unless you configure it to.
Can I use NVIDIA TensorRT-LLM in the browser?
No — NVIDIA TensorRT-LLM is a Linux and Docker application, not a web app. You install it rather than sign in to it.
Where is the NVIDIA TensorRT-LLM source code?
On GitHub at github.com/NVIDIA/TensorRT-LLM.
What kind of tool is NVIDIA TensorRT-LLM?
In this directory NVIDIA TensorRT-LLM is filed under framework, accelerator, nvidia as a open-source tool.
What are the alternatives to NVIDIA TensorRT-LLM?
There is a side-by-side page at /tools/tensorrt-llm-alternatives comparing NVIDIA TensorRT-LLM with the closest tools in the same category on price, platform and features.
Whipscribe is a hosted transcription service. If you want transcripts without running infrastructure, paste a URL or drop a file in the form below — you'll have a transcript in seconds.
Transcribe your recordings
Running NVIDIA TensorRT-LLM yourself? Send the same file here and compare the transcript. Transcribe any language, any recording · Transcription services from $0.29 an hour · Transcribe from any meeting or recording platform · How to transcribe, step by step
Explore
All transcription tools · By language · By platform · By file format · How-to guides · Transcription services · Transcription API · Pricing
Long recording to get through?
One file up to 10 hours, as an upload or a link: see MP3 to text for long recordings, a podcast episode as text from its link and the SRT file generator.
Looking at paid options?
Before you choose a transcription tool or service: see how the best transcription services compare, the cheapest way to transcribe an hour of audio and transcription services from $6.