Skip to content

TTS/STT: Proof of Concept implementation for STT eval #511

@Prajna1999

Description

@Prajna1999
  1. PoC implementation of STT eval for below providers along with Word Error Rate and Lenient Word Error Rate for the below providers.
    • Gemini-2.5-pro
    • Gemin-2.5-flash
    • Gemini-3
    • Chirp V3 (Google-STT)
    • OpenAI - Whisper -1
    • OpenAI - OpenAI-4o-transcribe
    • AI4Bharat
    • Bhasini

Evaluation metrics
- WER
- Lenient WER
- Average scores
- Count of errors insertion, substitution, deletion.
- Summary scores

Sub-issues

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Status

In Progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions