vLLM

by vLLM Project

Don’t want to install vLLM? Drop the file here.

The first 20 minutes of any recording are transcribed free: a recording up to 20 minutes transcribes in full, a longer one is previewed, and a pack from $6 (500 minutes) transcribes the rest and opens every export, and credits never expire.

High-throughput inference engine — supports Whisper / Llava / Qwen-Audio.

Linux, Docker  ·  free

TL;DR

Best for bulk Whisper inference + audio-LLM serving with continuous batching. Pricing: free.

Category
Open source
License
Apache-2.0
Stars
★ 88.5k
Last push
2026-08-08
Pricing
free
Platforms
Linux, Docker

What it is

The reference paged-attention inference engine. Apache-2.0.

Best for: Bulk Whisper inference + audio-LLM serving with continuous batching.
Watch out for: GPU-only; Whisper integration newer than text generation paths.

Install / use

pip install vllm

What people actually do with vLLM-style transcription

The tool is the means. These are the jobs — each one priced at published rates, each one wired up on its own page.

Wire it into Amazon S3n8nMake.comGoogle DriveZapierSlack

Features

Speaker diarizationNo
Word-level timestampsYes
Streaming / real-timeNo
Languages supported99
HIPAA eligibleNo

Links

GitHub repo ↗

vLLM vs Whipscribe

FeaturevLLMWhipscribe
CategoryOpen sourceTranscription APIs
Pricingfree$6–$24 one-time packs (credits never expire) · first 20 minutes free
Speaker identificationNoNamed in the summary, key quotes and chapters
Word timestampsYesYes
StreamingNoNo
Languages9999
PlatformsLinux, DockerWeb, API, MCP

Alternatives to vLLM

Frequently asked about vLLM

Is vLLM free?

Yes. vLLM is free and open source.

Does vLLM work on Mac, Windows and Linux?

vLLM runs on Linux and Docker. It is not listed for other platforms; check the vendor for anything beyond Linux and Docker.

How do I install vLLM?

With pip: `pip install vllm`. You need Python and, for most audio tools, ffmpeg on your PATH first.

How many languages does vLLM support?

vLLM lists 99 languages. That is the Whisper-family multilingual set, so quality varies by language — English and the large European languages are strongest.

Does vLLM identify different speakers?

No. vLLM does not label speakers; a conversation comes back as one continuous text. If you need speaker labels, that is a separate tool or a different service.

Does vLLM give word-level timestamps?

Yes — vLLM produces timing per word, which is what subtitle cues and clip boundaries need.

Can vLLM transcribe live audio?

No — vLLM works on finished files, not a live stream.

Is vLLM HIPAA compliant?

vLLM does not claim HIPAA compliance. For PHI, run it on infrastructure you control or choose a service that will sign a BAA.

What are the limitations of vLLM?

GPU-only; Whisper integration newer than text generation paths.

Who is vLLM best for?

Bulk Whisper inference + audio-LLM serving with continuous batching.

Does vLLM run offline?

vLLM runs on your own machine — it is open source, so nothing leaves the computer unless you configure it to.

Can I use vLLM in the browser?

No — vLLM is a Linux and Docker application, not a web app. You install it rather than sign in to it.

Where is the vLLM source code?

On GitHub at github.com/vllm-project/vllm. It is maintained by vLLM Project.

What kind of tool is vLLM?

In this directory vLLM is filed under framework, accelerator, server as a open-source tool.

What are the alternatives to vLLM?

There is a side-by-side page at /tools/vllm-alternatives comparing vLLM with the closest tools in the same category on price, platform and features.

Whipscribe is a hosted transcription service. If you want transcripts without running infrastructure, paste a URL or drop a file in the form below — you'll have a transcript in seconds.

Transcribe your recordings

Explore

Have the recording already?

Skip the setup and send the file or the link: see transcribing a long MP3 or M4A, transcribing a podcast episode and an SRT subtitle file from any recording.

Looking at paid options?

Before you choose a transcription tool or service: see how the best transcription services compare, cheap transcription services and the real cost per hour and how our transcription services work.