Which metric is commonly used for evaluating Automatic Speech Recognition (ASR) models?
A.
CTC Loss
B.
F1 Score
C.
Mean Opinion Score (MOS)
D.
Word Error Rate (WER)
The Answer Is:
D
This question includes an explanation.
Explanation:
Word Error Rate is the standard evaluation metric for ASR systems. It measures the edit distance between the model's transcription and a human reference transcript, computed as (Substitutions + Deletions + Insertions) / Number of reference words, expressed as a percentage. Lower WER indicates better transcription accuracy. Its character-level analogue, Character Error Rate (CER), is used for languages without clear word boundaries or for morphologically complex languages.
The distractors target common confusions: CTC (Connectionist Temporal Classification) Loss (A) is a *training* objective used to align variable-length audio input with variable-length text output in ASR models like DeepSpeech — it optimizes the model but is not itself a post-hoc evaluation metric on held-out accuracy. F1 Score (B) evaluates classification tasks with defined positive/negative classes, such as keyword spotting or wake-word detection, not full transcription. Mean Opinion Score (C) is a subjective, human-rated metric used to evaluate speech *synthesis* quality (TTS) or perceived audio naturalness — the inverse task of ASR — not transcription accuracy.
On NVIDIA's Riva and NeMo ASR pipelines, WER is the benchmark reported against datasets like LibriSpeech, and it remains the figure typically referenced in the exam's Multimodal Data and Experimentation domains when discussing speech model evaluation.
[Reference: Multimodal Data domain — ASR evaluation metrics (WER, CER) vs. TTS metrics (MOS)., ]
NCA-GENM PDF/Engine
Printable Format
Value of Money
100% Pass Assurance
Verified Answers
Researched by Industry Experts
Based on Real Exams Scenarios
100% Real Questions
Get 65% Discount on All Products,
Use Coupon: "ac4s65"