Examples: Eval


Speech Recognition Model Evaluator

Loading...

132 runs

This recipe is used with https://gooey.ai/bulk to evaluate the latest private & open source speech recognition models (from Google, Meta, OpenAI and others). It takes a CSV file of golden (aka human provided) translations and compares those against a set of AI created translations to generate scores from 0 to 1. It then takes the mean of the scores to determine which model performed best.

Documents

Evaluate Telugu Speech Reco + Translation

Loading...

163 runs

Here we compare the top 5 ASR models from a set of Telugu samples. Speech output created from https://gooey.ai/bulk/?example_id=nrkx2u17

Documents

Evaluate Kannada Speech Reco + Translation

Loading...

6 runs

Here we compare the top 3 ASR models from a set of Kannada samples. Speech output created from https://gooey.ai/bulk/?example_id=m8c3mb98

Documents

Evaluate Hindi Speech Reco + Translation

Loading...

12 runs

Here we compare the top 6 ASR models from a set of Hindi samples. Speech translations created from https://gooey.ai/bulk/?example_id=ueki9up0.

Documents