NVIDIA FasterTransformer

by NVIDIA

Don’t want to install NVIDIA FasterTransformer? Drop the file here.

The first 20 minutes of any recording are transcribed free: a recording up to 20 minutes transcribes in full, a longer one is previewed, and a pack from $6 (500 minutes) transcribes the rest and opens every export, and credits never expire.

Legacy NVIDIA inference engine — predecessor to TensorRT-LLM.

Linux  ·  free

TL;DR

Best for reference implementations of fused Transformer kernels. Pricing: free.

Category
Open source
License
Apache-2.0
Stars
★ 6.4k
Last push
2024-03-27
Pricing
free
Platforms
Linux

What it is

NVIDIA's early high-performance Transformer inference codebase. Apache-2.0.

Best for: Reference implementations of fused Transformer kernels.
Watch out for: Largely superseded by TensorRT-LLM.

Install / use

What people actually do with NVIDIA FasterTransformer-style transcription

The tool is the means. These are the jobs — each one priced at published rates, each one wired up on its own page.

Wire it into Amazon S3n8nMake.comGoogle DriveZapierSlack

Features

Speaker diarizationNo
Word-level timestampsYes
Streaming / real-timeNo
Languages supported60
HIPAA eligibleNo

Links

GitHub repo ↗

NVIDIA FasterTransformer vs Whipscribe

FeatureNVIDIA FasterTransformerWhipscribe
CategoryOpen sourceTranscription APIs
Pricingfree$6–$24 one-time packs (credits never expire) · first 20 minutes free
Speaker identificationNoNamed in the summary, key quotes and chapters
Word timestampsYesYes
StreamingNoNo
Languages6099
PlatformsLinuxWeb, API, MCP

Alternatives to NVIDIA FasterTransformer

Frequently asked about NVIDIA FasterTransformer

Is NVIDIA FasterTransformer free?

Yes. NVIDIA FasterTransformer is free and open source.

Does NVIDIA FasterTransformer work on Mac, Windows and Linux?

NVIDIA FasterTransformer runs on Linux. It is not listed for other platforms; check the vendor for anything beyond Linux.

How do I install NVIDIA FasterTransformer?

Clone and run it from source: `git clone https://github.com/NVIDIA/FasterTransformer`. Expect to install its dependencies yourself — the README has the exact steps per OS.

How many languages does NVIDIA FasterTransformer support?

NVIDIA FasterTransformer lists 60 languages.

Does NVIDIA FasterTransformer identify different speakers?

No. NVIDIA FasterTransformer does not label speakers; a conversation comes back as one continuous text. If you need speaker labels, that is a separate tool or a different service.

Does NVIDIA FasterTransformer give word-level timestamps?

Yes — NVIDIA FasterTransformer produces timing per word, which is what subtitle cues and clip boundaries need.

Can NVIDIA FasterTransformer transcribe live audio?

No — NVIDIA FasterTransformer works on finished files, not a live stream.

Is NVIDIA FasterTransformer HIPAA compliant?

NVIDIA FasterTransformer does not claim HIPAA compliance. For PHI, run it on infrastructure you control or choose a service that will sign a BAA.

What are the limitations of NVIDIA FasterTransformer?

Largely superseded by TensorRT-LLM.

Who is NVIDIA FasterTransformer best for?

Reference implementations of fused Transformer kernels.

Does NVIDIA FasterTransformer run offline?

NVIDIA FasterTransformer runs on your own machine — it is open source, so nothing leaves the computer unless you configure it to.

Can I use NVIDIA FasterTransformer in the browser?

No — NVIDIA FasterTransformer is a Linux application, not a web app. You install it rather than sign in to it.

Where is the NVIDIA FasterTransformer source code?

On GitHub at github.com/NVIDIA/FasterTransformer.

What kind of tool is NVIDIA FasterTransformer?

In this directory NVIDIA FasterTransformer is filed under framework, accelerator, nvidia as a open-source tool.

What are the alternatives to NVIDIA FasterTransformer?

There is a side-by-side page at /tools/faster-transformer-alternatives comparing NVIDIA FasterTransformer with the closest tools in the same category on price, platform and features.

Whipscribe is a hosted transcription service. If you want transcripts without running infrastructure, paste a URL or drop a file in the form below — you'll have a transcript in seconds.

Transcribe your recordings

Explore

Have the recording already?

Skip the setup and send the file or the link: see how to transcribe an MP3 of any length, how to transcribe a podcast and the SRT file generator.

Comparing tools before you pay?

If you would rather pay a service than run software yourself: see how the best transcription services compare, affordable transcription priced per hour and how our transcription services work.