Understanding AI in Audio Post: What It Means and How It’s Used

At Smart Post, the term “AI” in audio post doesn't point to one single thing. It covers a set of practical tools that help us work faster while keeping the craft fully in human hands.

This guide walks through the four families of technology we actually use in audio post. These include ML applied to audio, Speech AI such as ASR and TTS, LLM based automation tools that help with text and formatting, and generative audio tools. We also explain where each one fits into real workflows such as turnover, prep, cleanup, editorial, design, mixing, metadata, and delivery.

The simple idea behind all of this is that these tools take care of the repetitive tasks. This gives us more space to make creative decisions without slowing down.

Our "AI" motto has become: Tools speed the chores; people shape the story.

What AI Means to Us

In our daily work, AI takes four practical forms.

• Machine learning (ML) on audio

  These tools learn from examples and help clean, separate, enhance, or organize recorded material. They are used for denoising, dereverb, source separation, editorial cleanup, conforming, and anything that helps make rough production audio easier to work with.

  
  

• Speech AI, ASR and TTS

  ASR turns spoken words into text.

  TTS turns text into spoken words or performs voice modeling.

  We only use these when fully cleared within SAG AFTRA rules and with informed consent.

  
  

• Large Language Models for Text and Workflow Automation

  These tools summarize, outline, tag, organize, and prepare notes or metadata. Everything they produce is reviewed by a human. They simply help with speed.

  
  

• Generative Audio and Design Tools

  These tools can reference ambiences, textures, and sound libraries to spark ideas. They do not replace real performances, Foley, sound design, or mix decisions, EVER.

  
  

Where AI Helps Us

Below are the areas where these tools make a noticeable difference.

Turnover and Prep

• Quickly flag production audio that is noisy, clipped, roomy, or otherwise problematic

• Batch level dialogue and organize file naming and metadata

• Assist with cue sheet helpers and consistency checks

  
  

Dialogue Editorial

• Clean up dialogue with fewer artifacts

• Separate lines from noise, FX, or music when possible

• Spot alternate dialogue takes that appear in dailies but not in AAF or OMF turnovers

• Remove long silences or fillers in dialogue only material

  
  

ADR and Continuity

• Align ADR timing and pitch to production audio

• Align boom and lav tracks so they remain phase coherent

• When cleared, apply subtle timing or pitch fixes using voice modeling

  
  

Pre-Dub and Mix

• Provide first pass suggestions for leveling or EQ to speed up early decisions

• Perform light cleanup or balancing that keeps the mix moving

• Add semantic markers for lines that need attention in the final mix

• Help with object placement, upmixing, and preview formats for spatial audio

  
  

Delivery and QC

• Check and correct loudness for multiple platforms

• Generate captions and transcripts with human review

  
  

Archive and Asset Management

• Tag speakers and scenes so material is easier to retrieve later

• Keep transcripts linked to scripts, assets, and recorded material

  
  

Remote Recording, Playbacks, and Review

• Provide low latency tools for recording and streaming sessions

• Allow producers, directors, and mixers to review material and request fixes more efficiently

  
  

The Tools We Use (...and Why)

Cleanup and Restoration (these are our current ML workhorses)

• iZotope RX – Dialogue Isolate, Repair Assistant, Spectral Recovery; daily restoration backbone.

• Steinberg SpectraLayers Pro – visual spectral editing/separation that complements RX.

• Adobe Enhanced Speech – fast web cleanup for roughs/remote recordings.

• Waves Clarity Vx Pro / Hush – real-time dialogue-focused denoise for speed passes.

• Acon Extract:Dialogue / Accentize dxRevive / Supertone Clear – alternate flavors for specific noise/artifact profiling and cleanup.

• Absentia DX – batch de-click/de-hum tailored for production dialog.

• CEDAR / VoicEX 2 – adaptive dialogue suppression when transparency is critical.

• Auphonic – intelligent leveling and LUFS compliance for voice-heavy content.

• Krisp (real-time) – keeps remote VO/ADR/Podcast audio cleaner from the streaming source.

• Zynaptiq Unveil / Unchirp, CrumplePop and Acon Digital DeVerberate for "special-use" cases.

  
  

Alignment and Continuity

• Sound Radix Auto-Align Post – dynamic boom/lav mic alignment and spectral phase correction.

• Synchro Arts Revoice Pro / Vocalign – ADR timing/pitch alignment and doubling.

• DaVinci Resolve Fairlight Voice Isolation and Dialogue Leveler – light-lift tools inside picture editorial (when needed).

  
  

Conform and Change Management

• The Cargo Cult Matchbox – compare EDLs, find differences, build reconform maps and auto-conform sessions to new picture turnovers.

• Sounds In Sync EdiLoad – merge EDLs, create conform lists, spotting.

  
  

ADR, Dubbing, ASR/TTS/Voice Cloning and Recording

• Sounds In Sync EdiCue / EdiPrompt – cue sheets and on-screen overlay of streamers/beeps/prompting.

• Non-Lethal Applications Cue Pro – ADR cueing app with on-screen streamers and live, shareable cue sheets.

• VoiceQ – dubbing/ADR with clear syllable timing overlays.

• Resemble.ai – create, edit, emote, and localize voices (either web or API). Good for temp ADR, pickups, and localization - when cleared.

• ElevenLabs – platform of AI voice tools – high-quality text-to-speech, speech-to-speech, consent-based voice cloning, multilingual dubbing, and huge voice library – handy for temp ADR and quick pickups when cleared.

• Google TTS/ Custom Voice – wide language coverage; custom models with great review process.

  
  

Remote Record and Review

• Source-Connect – industry-standard low-latency remote record and playback.

• SessionLinkPRO / Cleanfeed – browser-based talent/producer connections.

• Audiomovers ListenTo – stream your DAW bus to clients in hi-res for approvals.

• ClearView Flex – secure, low-latency streaming for remote review.

• Streambox – Spectra (software) and Chroma (hardware) – deliver secure, low-latency, streaming for remote review/collaboration.

  
  

Sound Design and Foley

• Krotos Studio / Weaponiser / Dehumaniser – performance-driven, layered SFX with quick variation; great for fast, creative ideas and design.

• Krotos Reformer Pro – “perform” Foley/textures from mic or track input (cloth, footsteps, creatures, etc.) for natural, organic ideas.

• Soundly – our hub for fast search, collections, and consistent SFX tagging/versioning, plus Voice Designer for PA/airport announcements, background conversation, and quick utility VO.

• Accentize Chameleon – AI reverb-matching plugin that analyzes a recording’s room acoustics and builds a reverb profile you can apply to ADR, Foley, or dry tracks.

• ElevenLabs Sound Effects – generates sound effects from simple text prompts, with quick variations. Used as tools, not inventory – used in context, not resold, and we stick to the provider’s terms.

  
  

Library and Metadata

• Soundly (also listed above), Soundminer and BaseHead for deep metadata tagging/scanning, DAW spotting, and alternative search workflows of sound libraries.

  
  

Loudness, Metering and Delivery

• NUGEN VisLM / LM-Correct / ISL – realtime + one-click compliance and true-peak limiting.

• iZotope Insight 2 – complete metering (loudness, surround, spectrum).

• Dolby Atmos Production Suite / Renderer – ADM, binaural renders, deliverable checks.

  
  

Spatial and Immersive

• NUGEN Halo Upmix / Downmix – transparent format moves (stereo↔5.1↔Atmos beds).

• Sennheiser Dear Reality – binaural/immersive positioning for previews and temp 3D scenes.

• Flux/IRCAM SPAT Revolution – advanced immersive mixing and room modeling.

  
  

Union Compliance (SAG-AFTRA): Digital Replicas and Voice Synthesis

Most of the actors we record are SAG AFTRA members. Any form of digital voice replica follows strict rules.

• Consent first – informed, written consent before any creation or use of a digital replica. We are completely transparent and pride ourselves on that.

• Defined scope – where, how long, and for what the replica may be used; new uses require new approvals.

• Compensation and credit – union-compliant terms per the applicable agreement.

• Security – private handling, least-privilege access, documented chain of custody.

  
  

Our policy: We only engage TTS/voice-cloning workflows when a project has documented SAG-AFTRA compliance – in accordance with the SAG-AFTRA SOUND RECORDINGS CODE (consent on file, scope defined, compensation arranged). If not cleared, we strongly urge recording traditional ADR.

The Human Element: Why Craft Still Wins

Give ten pros the same tools and you’ll get ten different results... and that’s the point!

• Taste and intent – deciding what to fix vs what to keep is storytelling, not algorithmic decision making.

• Context and judging trade-offs – sometimes a little noise, air, or a slight rustle in the recording is the "life" that would otherwise be a lifeless, artifact-free line. This will ALWAYS feel more natural to the human ear.

• Performance direction – ADR/Dialect coaching/direction, mic choices, and/or room setups change outcomes before any tool runs a "process" to dictate a performance.

• Session architecture – how editors, assistants, and techs name, route, group, and setup templates for each session helps speed up creative decision-making and prevent errors.

• Problem framing – knowing why a clip might sound wrong guides the right decision making – and avoids any additional over-processing or time wasted.

• Ears and trust – feedback discussions with directors/producers/talent, fast A/B comparisons, and delivery confidence can’t be automated.

  
  

AI can help accelerate some tasks, but it can’t model your taste, your judgment, or your collaboration and vision with a director or producer.

THIS human touch is the difference between “fixed” and finished.

What AI Won’t Do Here

• Replace actors, mixers, or editors – taste and storytelling are human.

• Decide creative intent – it can suggest; it doesn’t direct.

• Break trust – no unapproved cloning of any kind; no shady data usage whatsoever.

  
  

Results You Can Expect

• Clean dialogue tracks built faster, with fewer artifacts.

• Quicker first passes that keep creative momentum flowing.

• Consistent loudness/metadata tagging/captioning across multiple versions.

• Better exchanges between editorial, recording, mix, and delivery departments.

  
  

FAQ

Let’s Post Smart.

Ready to hear how any of these workflows could help your next project?

Request a Quote or Contact the Team and we’ll review a sample and outline options for you.