What is video translation?
Video translation is the process of taking the spoken words (and often the on-screen text) of a video and making them understandable in another language. In practice that means three steps: capturing what is said as a timed transcript, translating that transcript, and delivering the translation back to the viewer — as subtitles they read, or as a new audio track they hear.
For years each of those steps lived in a different tool, or with a different vendor. A transcription service produced the script, an agency translated it, a subtitling studio timed it, and a recording studio booked voice actors. AI has collapsed that chain. Smartcat’s AI video translator transcribes the speech, keeps the timing, translates the transcript into any of 280+ languages, and renders the result as subtitles, an AI-dubbed track or a voice-over — from a single upload.
Why video gets left behind — and why that is changing
Text content is usually first in line for translation; video tends to be last, because it has historically been the slowest and most expensive format to localize. Every language version meant a new subtitle file to time, a new recording session, or a new edit. The result is a familiar pattern: the English training library is complete, the product demo is polished, and every other market gets a link to the English version.
AI changes the economics in two ways. First, the transcript becomes the single source of truth: fix a misheard product name once and every language inherits the fix. Second, outputs are generated rather than produced — subtitles, burned-in captions and AI voice tracks are rendered from the translated transcript instead of being rebuilt by hand. That makes it realistic to translate the long tail of video — onboarding modules, webinars, support clips, social content — not just the flagship campaign.
Audio follows the same logic. Podcasts, interviews, call recordings and voice notes go through the same transcribe–translate–export path, which is why this guide covers audio translation alongside video.
Subtitles, dubbing or voice-over?
The first decision in any video translation project is how the viewer will receive the translation. There are three main outputs, and many teams use more than one — for example, AI dubbing for primary markets and subtitles for the rest. Smartcat lets you set the output per project, so different languages can get different treatments from the same transcript.
| Factor | Translated subtitles | AI dubbing | Voice-over |
|---|---|---|---|
| What the viewer gets | Original audio + translated text on screen | Original speech replaced by a synthetic voice in the target language | A translated narration track, typically over the original |
| Best for | Social, YouTube, webinars, film, accessibility | Training, product and marketing video | Explainers, narrated slides, eLearning |
| Language coverage on Smartcat | 280+ languages | 35 AI voice-over locales | 35 AI voice-over locales |
| Deliverable | SRT/VTT file or burned-in video | Video with dubbed audio (subtitles optional) | Video or audio file with new narration |
| Viewer effort | Reading required | None — just listen | None — just listen |
| Accessibility | ✓ Supports deaf and hard-of-hearing viewers | Pair with subtitles | Pair with subtitles |
Subtitles are the most universal option: they work for every language Smartcat translates, keep the original speaker’s voice, and serve viewers watching with the sound off. AI dubbing and voice-over remove the reading burden, which matters for training content and for audiences who prefer listening — but voice coverage is narrower than translation coverage. According to Smartcat’s AI dubbing page, AI voice-over is available in 35 locales, powered by ElevenLabs; where no voice exists for a target language, export translated subtitles instead.
Not sure which fits? The voice-over and subtitle translation workflow produces both from one upload, and the help guide on setting up video output for localization projects explains how to choose AI voice-over, burned-in subtitles or separate subtitle files at project creation.
How video translation works on Smartcat
Whatever output you choose, the workflow is the same: one upload, one transcript, as many languages as you need. Here is what happens between dropping in a file and downloading the finished video.
Upload video, audio or subtitles
Drop in a video (MP4, MOV, AVI, MKV, WMV and other common formats), an audio file (MP3, WAV, AAC, FLAC, M4A and more), or an existing SRT or VTT file. If you upload a subtitle file with the same name as the video, Smartcat links them instead of re-transcribing. The full list is in the video translation and AI dubbing workflow guide.
Check the transcript once
Smartcat extracts the audio and generates a timed transcript. Before anything is translated, you can review it — fixing a misheard brand name, acronym or speaker name in one place rather than in every language. Add a source layout check step to make this part of every project.
Translate with your glossary and memory
The corrected transcript is translated into any of 280+ languages using the glossary and translation memory attached to your project, so product names and terminology stay consistent across every video. Subtitle files keep their cue numbers and timecodes, as described on the AI subtitle translator page.
Review in the Subtitle Editor
Teammates or professional linguists review the translation side by side with a live video preview and timeline. AI dubbing is added from the same editor: pick a voice, preview it against the picture, and adjust. The Subtitle Editor guide covers every control.
Export the format you need
Download subtitles as SRT or VTT, a video with subtitles burned in, or a video with the AI voice track — in the source or target language. Separate subtitle files can be uploaded to YouTube, Vimeo, Wistia or any other video host. See exporting video, subtitles and dubbing.
Large jobs work the same way: full-length videos and whole batches of media can be uploaded into one project alongside documents and slides, with shared terminology across all of them — see translating large files and full videos. Smartcat first added direct video and audio upload with automatic transcription in 2023, as announced in upload video and audio files directly to Smartcat.
AI dubbing and voice-over translation
AI dubbing replaces a video’s spoken audio with a synthetic voice in another language. Smartcat generates the dub from the editable transcript: if you rewrite a sentence or correct a name, the voice says exactly what the script says. Speech is separated from the rest of the soundtrack, so the original music and effects can be preserved underneath the new voice.
Voice selection, multiple speakers and pronunciation
The quality of a dub depends as much on the voice as on the translation. Smartcat’s Subtitle Editor recommends voices that were created from the same native language as your target, so delivery sounds natural to local viewers, and lets you assign different voices to different speakers in the same video — announced in smarter voice selection and multi-speaker control. Two help articles go deeper: using recommended voices for AI dubbing and pronunciation control for AI voice-over, which lets you tell the voice how to say brand names, abbreviations and technical terms without changing the visible subtitle text.
Keeping the background sound
A dub that strips out the music and ambient sound feels flat. When you add AI dubbing, Smartcat separates background audio from the original track so you can keep it under the new voice, or switch it off. See extracting and preserving background sound in AI-dubbed videos.
Is AI dubbing ready for business video?
For training, product and marketing content, AI dubbing is now a production workflow rather than an experiment — but it still benefits from review. Smartcat’s blog compares the options in the 10 best AI dubbing tools for enterprise teams, and covers data handling and brand risk in is dubbing AI safe to use in your business videos? The step-by-step help guide is add multilingual AI dubbing to videos.
Subtitle and caption translation (SRT, VTT and more)
Subtitles are the workhorse of video translation. A subtitle file is plain text: a sequence of cues, each with a start and end timecode and one or two lines of text. Translating one sounds simple, but generic translators routinely break the file — merging cues, shifting timecodes or producing lines too long to read in time. A subtitle translator has to translate the text while leaving the timing structure untouched.
How Smartcat handles subtitle files
Smartcat parses an .srt or .vtt file into individual timed cues, translates each cue’s text using your glossary and translation memory, and rebuilds the file with identical cue numbering and timecodes, adjusting line breaks so translated subtitles still fit the screen. The subtitle translator accepts four subtitle formats — .srt, .vtt, .ass and .sbv — with conversion between them on export. No subtitle file yet? Upload the video and Smartcat generates the subtitles first.
In the Subtitle Editor, the timeline shows reading speed in characters per second (CPS) for each cue, colour-coded so reviewers can spot subtitles that are too dense to read in time — a feature introduced in translated video subtitles in Smartcat. Reviewers can add, delete, merge and split cues; see managing cues in the Subtitle Editor.
Burned-in subtitles vs. subtitle files
A separate subtitle file (SRT or VTT) lets viewers switch languages on platforms like YouTube and keeps the video file untouched. Burned-in (open) subtitles are rendered into the picture, which guarantees they display on social feeds and players that ignore caption tracks. Smartcat exports both; burned-in export was announced in export videos with burned-in subtitles.
Learn the formats
Audio translation, voice translation and transcription
Audio is the file type most translation tools can’t take: there is no text to extract until someone transcribes it. Smartcat treats audio like video without the picture. It transcribes the speech into a timed, speaker-labelled transcript, lets you correct it once, translates it into any of 280+ languages, and exports the result as a translated document, a subtitle file, or — in the 35 voice-over locales — an AI voice track.
Pricing for audio is metered by the words in the transcript, not by recording length: the MP3 translator page explains that one Smartword is charged per source word of transcript, so a long recording with little speech costs less than a short, densely scripted one. New accounts can try it free for 15 days with 15,000 Smartwords, no credit card.
Translate audio files
- AI Audio Translator — Recordings to Text or Subtitles in 280+ Languages
- MP3 Translator — Turn Any MP3 into Text, Subtitles or Speech
- WAV Translator — Translate WAV Files with AI
- Translate Audio to Text with AI
- Translate Recordings — Interviews, Voice Notes and Audio Files
- Record & Translate with the Media Translation Agent
Voice and speech translation
When the goal is a translated voice rather than translated text, the same pipeline adds an AI voice at the end. These pages cover spoken content in video, presentations and messages:
Transcription as the first step
Every audio and video translation starts with a transcript, and its accuracy sets the ceiling for everything downstream. Smartcat’s help center notes that its AI transcription is highly accurate but can miss an unfamiliar proper name or a strongly accented inflection — which is why the transcript review step exists (see add multilingual AI dubbing to videos). For recordings where you need a verbatim human transcript, or a transcript translated by a specialist, hire through the transcription services and transcript translation services marketplaces. For a practical walkthrough, read how to translate audio from a video automatically.
Training video creation, translation and AI avatars
Training is where video translation pays back fastest. A single compliance or onboarding video may need to reach employees in a dozen languages, and it will be updated again next quarter. Re-recording presenters for every language and every revision doesn’t scale; AI dubbing and AI avatars do.
Avatar-led video without re-recording
Avatar Studio sits inside Smartcat’s course builder. You pick a default avatar and voice for a course, apply branded backgrounds, and generate presenter-style videos straight from the script — no cameras or studio time. Because avatar videos are generated from text, translating the script is enough to produce every language version. Setup is covered in generate course videos with Avatar Studio; if you need the resulting video files outside your LMS, see downloading a video file from a microlearning course.
Localizing existing training video
For training you already have on film, the standard video translation workflow applies: transcribe, correct, translate, then add subtitles or an AI voice. Intradiem’s L&D team used Smartcat to translate 20 Articulate Rise courses plus job aids, videos and demos into Canadian French against a tight deadline — read the Intradiem case study. An international money transfer firm also used Smartcat for compliance training materials and multilingual video subtitles.
Live and real-time video translation
Not every video is a finished file. Town halls, webinars, product launches and training sessions happen live, and international audiences want to follow along in their own language. Live translation is a different problem from file translation: there is no chance to correct a transcript before it is shown, so terminology control and clear audio matter even more.
Smartcat’s pages on live and real-time translation describe how its AI applies to these scenarios — from captions for live streams and webinars to multilingual meetings and speech-to-speech voice features built into your own applications. For recorded sessions, the fastest route is usually to translate the recording afterwards with the standard video workflow, which adds review and AI dubbing.
Human-reviewed video translation services
AI handles the heavy lifting of video translation, but some content needs a professional linguist before it ships: brand campaigns, regulated training, film and entertainment subtitles, and any language where the AI voice or translation needs a native ear. Smartcat builds human review into the same workflow rather than sending files out to an agency.
| Factor | AI only | Smartcat AI + human review | Traditional studio / agency |
|---|---|---|---|
| Turnaround | Minutes | Hours to days | Days to weeks |
| Cost | Lowest | Low to moderate | Highest (studio time, voice talent) |
| Brand & terminology control | Glossary-driven | ✓ Glossary + reviewer sign-off | Varies by vendor |
| Cultural adaptation | × Limited | ✓ Native reviewer | ✓ Yes |
| Updates when the source changes | Re-run | ✓ Edit transcript, regenerate | New project, new session |
When you create a video translation project you can choose simple AI translation or AI translation with human review, and assign reviewers from your own team or from the Smartcat Marketplace. Marketplace linguists work directly in the Subtitle Editor — the Subtitle Editor guide for marketplace suppliers shows what reviewers see when they translate subtitles or check AI dubbing.
Hire video and audio specialists
Prefer to talk it through? Smartcat’s media localization specialists can scope an enterprise video program — book a demo.
Video translation by use case
The right mix of outputs depends on where the video will be watched and who is watching. These are the most common scenarios, with the resources that cover each.
Marketing, product and brand video
Campaign videos, product demos and explainers carry brand voice, so terminology and tone matter as much as accuracy. AI dubbing lets the same demo run in every priority market; subtitles cover the rest. For strategy, read multimedia marketing and how global brands get it right and how AI is rewiring global media production.
YouTube, TikTok and social video
Social video is often watched on mute, which makes burned-in subtitles the default, while YouTube rewards separate caption tracks per language. Smartcat’s guides walk through both platforms end to end.
eLearning, onboarding and internal communications
Training and internal video benefit most from AI dubbing and avatars, because learners absorb more when they don’t have to read and listen in a second language at once. See the training video section above for tools, case studies and guides.
Film, entertainment and media
Film and series subtitling has the strictest timing and reading-speed standards, and usually involves professional subtitlers. Smartcat supports SRT film translation with AI plus expert review, and industry practitioners discuss where the field is heading in the event recordings disruptive trends in multimedia localization, speech-to-text and video streaming and technology innovations in gaming and media localization.
Translate video and audio by language
Smartcat translates video transcripts and subtitles into 280+ languages. Some language pairs have their own quirks — Japanese formality and name readings, Chinese dialect and character handling — and the pages below address the most requested pairs directly.
The Japanese page is a good example of language-specific nuance: it notes that a Japanese dub should be reviewed rather than shipped on the first render, and that name readings and formality are best fixed once in the editable transcript before generating English subtitles or a dub.
Video translation tools & resources
Purpose-built tools for every video and audio scenario — from a single MP4 to an enterprise media library.
Video translation by file type
Subtitles & captions
Dubbing & voice-over
Audio
Browser extensions
Video translation guides, news & events
In-depth guides, product announcements and webinar recordings on video, subtitle and audio translation.
Smartcat product documentation
Step-by-step product guides for teams translating video, subtitles and audio in Smartcat. Browse the full Video & dubbing help category, or start here:
- Translate Videos, Subtitles and Audio — Workflow
- Translate Video, Audio and Transcripts — Overview
- Video Translation and Multilingual AI Dubbing: Complete Workflow Guide
- Add Multilingual AI Dubbing to Videos
- Use the Subtitle Editor to Translate, Edit and Export Subtitles
- Review and Edit AI Translations in the Subtitle Editor
- Export Video, Subtitles and Dubbing
- Setting Up Video Output for Localization Projects
- Translate Audio Files in Smartcat
- Pronunciation Control for AI Voice-over