AI generated
!video I've been building VoxaDub, an open-source, local-first AI dubbing system powered by VoxCPM2 + Hy-MT2. The project code is MIT-licensed. One of the hardest problems isn't translating speech — it's synchronizing it. A sentence that takes 4 seconds in English might take 6 seconds in Turkish. What happens when the translated voice no longer fits the original video? VoxaDub tackles this by measuring synthesized speech duration, refining translations with Hy-MT2, and applying bounded timing corrections to better fit the original scene. Key features: • Speaker-aware voice cloning using diarization and speaker-specific VoxCPM2 references. • Experimental live dubbing for authorized YouTube livestreams and supported videos through a Chrome extension, with adaptive buffering. • Local transcription, translation, and voice generation without external AI APIs after model setup; optional cloud compute for supported workflows. • Original background audio preservation and optional LatentSync lip-sync. I've published English → Turkish, Spanish, and Japanese comparison demos in the README. The repository also documents the pipeline, testing evidence, and known limitations. Timing and voice consistency can still fail; live dubbing is experimental and does not guarantee real-time synchronization. The attached 84-second video is a cinematic project introduction with short synthetic voice examples, not a measured end-to-end dubbing benchmark. Use the separate comparison demos to assess the actual dubbing output. VoxaDub is listed in the OpenBMB/VoxCPM Ecosystem & Community section. GitHub + comparison demos: https://github.com/kadirb4rut/voxadub I'd love technical feedback, especially on synchronization, voice consistency, and experimental live dubbing. Disclosure: Turkish is my native language. I used AI to refine the English wording of my own technical description and a browser assistant to submit it.