FFmpeg and VLC, built by volunteers, quietly power nearly all internet video and remain drastically underfunded.
An address such as HTTP, a file or a DVD becomes a stream of bytes. The demuxer cuts it into audio, video and subtitle frames. Frames are parsed to decide whether the GPU can decode them, and up to 45% of files cannot, so software decoding does entropy decoding, prediction and inverse transforms before display.
Answered around 17:14Going from normal audio to MP3 compresses about 10 times, while video needs 100 to 200 times, with 1,000x as the target. Codecs mimic human hearing and sight, for example using YUV instead of RGB. Each codec generation saves about 30% for the same quality but needs one to two orders of magnitude more CPU.
Answered around 19:42The container, or muxer, is a collection of tracks, what people call the file format, such as AVI, MOV, MP4 or Matroska. The codec compresses each track. The confusion is the industry's fault: H.264 is officially MPEG-4 Part 10, and MP4 in practice means H.264 video with AAC audio 99% of the time.
Answered around 24:54VLC began as the client of a late-1990s streaming system over UDP, where packets get damaged, so it never trusts its inputs. It ignores the file extension, treating it only as a hint, and probes the content. It also played partially downloaded AVI files whose metadata sits at the end.
Answered around 28:46FFmpeg is a set of low-level libraries for codecs, muxers, demuxers and filters, plus tools like the ffmpeg command line and ffprobe to build processing pipelines. It runs inside VLC, Chrome, smart TVs, OBS and YouTube's servers. Its command line is almost a programming language, with some companies running 3,000-line commands.
Answered around 35:37First, so third-party applications such as games could embed the VLC engine without open-sourcing everything, while still giving back changes to the library. Second, Apple's App Store terms make GPL apps hard to ship, so the iOS and Apple TV versions use the MPL. Relicensing meant contacting more than 350 contributors.
Answered around 49:40At École Centrale Paris, a student-run campus, students wanted a faster network than token ring. The Network 2000 project streamed MPEG-2 satellite TV from one dish to 1,500 students over the network. Two students then started VideoLAN; its client became VLC, open-sourced in early 2001. Jean-Baptiste joined in 2003.
Answered around 1:04:20The offers came from shady ad companies wanting to bundle spyware toolbars, change browsers or search engines, or put ads in VLC. He is not against money and has founded several startups, but believes money must be earned ethically. Selling out would have betrayed others' work, and the project would likely have been forked.
Answered around 1:11:40Google used AI to file security reports against FFmpeg, provided very limited funding, and announced its AI's success to the media before fixes existed, with a standard 90-day deadline that ignores volunteer development. The vulnerability was in an obscure 1990s game codec. Google later started sending patches and rewarding fixes.
Answered around 1:16:16The core community of VLC is five people and FFmpeg's is 10 to 15. Only about 1% of contributors stay, since people change jobs or have life events, so the core team ends up maintaining submitted code. That is why patches must be excellent and maintainable, not merely good.
Answered around 57:40“I go to middle of nowhere in India or in China, people know the cone, right?”
“We have thousands of contributors, some of whom aren't even alive anymore.”
“The core community of FFmpeg is 10 to 15.”
“But I did not do it because I thought it was not moral and it was not the right thing to do.”
“FFmpeg and VLC with Jean-Baptiste Kempf and Kieran Cunha.” https://media.blubrry.com/takeituneasy/ins.blubrry.com/takeituneasy/lex_ai_ffmpeg.mp3. Transcript summary by WhipScribe, https://whipscribe.com/transcript-pages/ffmpeg-and-vlc-with-jean-baptiste-kempf-and-kieran-cunha.html.