talking-avatar-with-ai
This project is a digital human that can talk and listen to you. It uses OpenAI's GPT to generate responses, OpenAI's Whisper to transcript the audio, Eleven Labs to generate voice and Rhubarb Lip Sync to generate the lip sync.
Category
Speech-to-text
Type
Open source
Platform
JavaScript project
Pricing
Free / open source
GitHub stars
459
Last updated
2026-05-11
Need the recording as text?
Whatever you record or edit with talking-avatar-with-ai, Whipscribe turns it into an accurate, speaker-labeled transcript — 100+ languages, SRT/VTT/DOCX export, private self-hosted Whisper. About $2 per audio hour, 30 minutes free daily.
Transcribe a file →