Longer Spanish phrases exposed the voice-transfer cost
Six phrases per language were synthesized with the production Supertonic stack, converted, then scored with an independent Parakeet recognizer. The experiment used public demo narrator references and did not alter the production application.
Key finding
Speaker resemblance improved on longer phrases, but Spanish word error increased and conversion added over a second.
Edited finding from the pinned experiment record. The report and figure metadata preserve the original workload and limits.
The boundary
Six utterances per language, 57 English and 56 Spanish reference words. Independent ASR is a proxy, not a human intelligibility panel.
Data
Reviewed aggregate results with explicit units, sources and qualification limits. Different cohorts remain separate.
The longer Spanish set exposed word errors
Six Spanish utterances · 56 reference words · timbre-only transfer
- Original Supertonic5.36
- Voice transfer · 4 steps10.71
- Voice transfer · 8 steps8.93
- Voice transfer · 12 steps7.14
ASR word error (%)
ASR proxy, not human listening. Six phrases are too few for a general language-quality claim.
View data & source
| Configuration | Value |
|---|---|
| Original Supertonic | 5.36 |
| Voice transfer · 4 steps | 10.71 |
| Voice transfer · 8 steps | 8.93 |
| Voice transfer · 12 steps | 7.14 |
Origin: reviewed report table. Revision 7e6fdbe3b1d1.
Write-ups
Report tts/seed-vc2-voice-transfer-2026-10-13/extended-cross-language/README.md
Expand beyond the greeting
Six phrases per language were synthesized with the production Supertonic stack, converted, then scored with an independent Parakeet recognizer. The experiment used public demo narrator references and did not alter the production application.
The result that the greeting missed
English stayed at zero observed WER after four-step conversion. Spanish changed from 5.36% before conversion to 10.71% at four steps, 8.93% at eight and 7.14% at twelve. Some accent and proper-name differences already existed in the unconverted recognizer output.
Spanish median conversion time rose from 1.263 to 2.214 to 3.241 seconds. More steps reduced observed word errors slightly, at a substantial latency cost.
Cross-language transfer also completed six requests in each direction. Spanish speech using an English narrator reference reached cosine 0.813 and WER 10.71%; English using a Spanish reference reached 0.823 and zero observed WER.
What is ready
This establishes limited zero-shot transfer, not an exact voice clone or a seamless call. Keep Spanish conversion optional and experimental while testing content preservation, caching, streaming and actual two-device latency.
Evidence and publication boundary
This is an edited account of the recorded experiment. The linked archive is private; the methods, aggregate findings and limits are included above. Reference recordings, raw conversations, authentication material and workstation configuration are excluded.
More in Speech & codecs
MOSS on a 3090: Q2 failed, AWQ4 stayed closer
Every profile began with the pinned BF16 generator. The comparison reused fixed reference codes and an FP32 decoder for the main quality measurements, keeping codec changes separate from generator quantization.
AWQ4 stayed close to the BF16 reference on WavLM and character errors; the sensitivity Q2 candidate was rejected.
Drama3: BF16 decoded the same codes about three times faster
The experiment replayed saved Spanish and English codes representing 21.5481 and 15.8824 seconds of audio. It compared FP32, BF16, mixed BF16 and two INT8 decoder variants on one RTX 3090.
BF16 reduced median decoder time from 390.07 to 129.54 ms in Spanish and from 292.42 to 96.88 ms in English.
Keeping FP32 and moving Supertonic to Triton
Rather than reduce the CPU graph precision again, this follow-up used NVIDIA Triton’s ONNX backend with CUDA execution and the unchanged FP32 graphs. The paired comparison retained both speed and acoustic checks.
The paired GPU test cut median first-audio time to about 0.35 seconds while preserving the measured ASR results.