Skip to content
exExperimentos
Speech & codecsResults10 Oct 2026

The decoder swap passed its word-error gate

Both routes used the same community 6-bit MLX T3 generator. The hybrid replaced only the audio stage with the unchanged published ONNX conditional decoder. No CoreML execution occurred in this hybrid.

⚡ Apple M5

Key finding

No hybrid output added word errors in 40 exact-token comparisons, but the ONNX decoder made the route slower.

Edited finding from the pinned experiment record. The report and figure metadata preserve the original workload and limits.

The boundary

Eight generic English phrases with two seeds and a smaller selected-voice subset. ASR agreement is not human naturalness or Spanish acceptance.

Data

Reviewed aggregate results with explicit units, sources and qualification limits. Different cohorts remain separate.

Recorded result

The ONNX audio stage added generation time

Same MLX T3 tokens · unchanged published ONNX decoder · M5

The ONNX audio stage added generation timeGeneric · MLX: 1.111 warm median seconds; Generic · hybrid: 2.069 warm median seconds; Selected voice · MLX: 0.954 warm median seconds; Selected voice · hybrid: 1.799 warm median seconds. No added ASR errors in 40 matched comparisons. This does not establish human quality or Spanish performance.Generic · MLX1.111Generic · MLX: 1.111 warm median secondsGeneric · hybrid2.069Generic · hybrid: 2.069 warm median secondsSelected voice · MLX0.954Selected voice · MLX: 0.954 warm median secondsSelected voice · hybrid1.799Selected voice · hybrid: 1.799 warm median seconds0warm median seconds
  1. Generic · MLX1.111
  2. Generic · hybrid2.069
  3. Selected voice · MLX0.954
  4. Selected voice · hybrid1.799

warm median seconds

No added ASR errors in 40 matched comparisons. This does not establish human quality or Spanish performance.

View data & source
The ONNX audio stage added generation time · warm median seconds
ConfigurationValue
Generic · MLX1.111
Generic · hybrid2.069
Selected voice · MLX0.954
Selected voice · hybrid1.799

Origin: reviewed report table. Revision 7e6fdbe3b1d1.

Download measurement metadata (JSON)

Write-ups

Report chatterbox-fidelity/community6-vs-coreml-2026-10-10/hybrid-decoder-test/README.md

Measure the proposed component swap

Both routes used the same community 6-bit MLX T3 generator. The hybrid replaced only the audio stage with the unchanged published ONNX conditional decoder. No CoreML execution occurred in this hybrid.

Every comparison checked the generated speech-token hash. Each MLX baseline was paired with two hybrid outputs using fresh internal noise. Thirty-eight of forty pairs tied on word errors; two hybrid outputs had two fewer edits each.

The cost of the swap

For the generic corpus, median warm time changed from 1.111 to 2.069 seconds and median RTF from 0.230 to 0.411. Selected-voice medians changed from 0.954 to 1.799 seconds. Instrumentation placed the extra time in audio decoding, rather than T3 generation.

The generic corpus had 8/250 baseline edits. Repeating each baseline score across its two matched hybrid comparisons gives 16/500 versus 12/500. Those equal denominators avoid implying that twice as many hybrid clips provide twice as much independent coverage.

The result I can use

The optional route passed its local intelligibility gate, while MLX remained faster. Reference voice audio and conditioning are excluded from this publication. Human preference, multilingual speech and longer-form behavior remain open.

Evidence and publication boundary

This is an edited account of the recorded experiment. The linked archive is private; the methods, aggregate findings and limits are included above. Reference recordings, raw conversations, authentication material and workstation configuration are excluded.

More in Speech & codecs