Gates Foundation

gatesfoundation

A workspace for the Gates Foundation DPI, FairFoward and Gooey teams focused on evals for low-resource languages plus the home of our Agriculture advisory work e.g. https://gooey.ai/ageval

489 Public Workflows
10 Members

(Updated Jan 2025)
This page shows a test of many English speech‑to‑text systems.
English Benchmark
We use the same English audio for every system. Then we compare each system’s text to a reference answer and give it a score between 0 and 1.
A higher score means the system is closer to the reference text and usually more accurate.

Ranking

WorkflowAccuracy (mean score)Latency (median, s)
GPT-4o Audio0.937.75
GPT-Realtime0.937.70
GPT‑5.20.915.99
Gemini 3 Pro0.8610.16
Llama 40.915.77
DeepSeek 3.20.886.17
Gemini 3 Flash0.897.77
GPT‑4.10.926.02

With this benchmark, you can:

  • See which system gets the best score
  • Compare different models and pipelines side by side
  • Choose the best system for your app, research, or product
  • Download all results for deeper analysis

🦾

3mo ago

Public

(Updated July 8, 2026)
This page presents a comparative demonstration of multiple LLM and speech-to-text systems combinations in Hausa β†’ English translation pipelines, updated with the latest available Gooey model endpoints for Gemini 3.5 Flash and GPT-Realtime 2.1. Results

🦾

3mo ago

Public

πŸ’¬

Changed ASR model to Omni ASR 1B (mms_1b_all).

3mo ago

523 runs

Public

(Updated July 8, 2026)
This page presents a comparative demonstration of multiple LLM and speech-to-text systems combinations in Hausa β†’ English translation pipelines, updated with the latest available Gooey model endpoints for Gemini 3.5 Flash and GPT-Realtime 2.1. Results

🦾

Saved updated benchmark model links: replaced the draft/unsaved realtime model runs with published GPT-Realtime 2.1 agent links, confirmed Gem3.5Flash published agent link, and updated the workflow title/description to reflect the newer models.

3mo ago

Public

Hausa audio-to-English agent using Gemini 3.5 Flash (gemini_3_5_flash).

πŸ’¬

3mo ago

152 runs

Public

Hausa audio-to-English agent using Intron ASR plus the newer GPT-Realtime model endpoint (gpt_realtime_2).

πŸ’¬

3mo ago

151 runs

Public

Hausa audio-to-English agent using Omnilingual ASR plus the newer GPT-Realtime model endpoint (gpt_realtime_2).

πŸ’¬

3mo ago

152 runs

Public

Hausa audio-to-English agent using the newer GPT-Realtime model endpoint (gpt_realtime_2).

πŸ’¬

3mo ago

152 runs

Public

A bulk evaluator workflow that compares AI-generated answers (copilot responses) to a set of golden reference answers. Requires input data columns: "input_prompt" (the question/task) and "reference_answer" (the ideal response). The workflow uses custom evaluation prompts to compare outputs, scoring them for accuracy and penalizing hallucinations. Aggregates results to provide an overall performance metric for your AI answers.

βš–οΈ

3mo ago

Public