Gates Foundation

gatesfoundation

A workspace for the Gates Foundation DPI, FairFoward and Gooey teams focused on evals for low-resource languages plus the home of our Agriculture advisory work e.g. https://gooey.ai/ageval

332 Public Workflows

8 Members

[GF] Compare KIKUYU Speech Recognition

Here we take an input sample of Kikuyu phrases (and their expert transcription and English translations) and compare the top Speech Reco and Translation models. As of Mar 25, 2025, we've found that Meta's MMS-Large works best for Kikuyu with Ghana NLP's Kikuyu to English translation services.

. Which AI model actually works best for your needs?
Upload your own data and evaluate any Gooey.AI workflow, LLM or AI model against any other.
Great for large data sets, AI model evaluation, task automation, parallel processing and automated testing.
To get started, paste in a Gooey.AI workflow, upload a CSV of your test data (with header names!), check the mapping of headers to workflow inputs and tap Submit.
More tips in the Details below.

Computational Mama aka Ambika

9mo ago

Public

[GF] Compare Kinyarwanda Speech Recognition (with MMS + Sunbird+Mbaza)

Compare Kinyarwanda Speech Recognition and Translation to English with this run.

Computational Mama aka Ambika

9mo ago

Public

[GF] Compare Swahili Speech Recognition (with Jacaranda+Sunbird+GPT 4o+MBaza)

Compare Swahili Speech Recognition and Translation to English with this run. We have 10 variations in this. Including the latest Seamless M4T v2, MMS, Azure, Whisper v3 and more.

Computational Mama aka Ambika

9mo ago

Public

Mbaza ASR + Google Translate: Kinyarwanda -> EN

👂🏼 Speech

Transcribe mp3, WhatsApp audio + wavs with OpenAI's Whisper or AI4Bharat / Bhashini ASR models. Optionally translate to any language too.

👂🏼

Computational Mama aka Ambika

9mo ago

Public

[GF] Compare KINYARWANDA translation with LLM

Here we take an input sample of Kikuyu phrases (and their expert transcription and English translations) and compare top LLMs as transalors. Currently Gemini 2.5 is winning...

Computational Mama aka Ambika

9mo ago

Public

[GF] Compare Swahili translation with LLM

Here we take an input sample of Kikuyu phrases (and their expert transcription and English translations) and compare top LLMs as transalors. Currently Gemini 2.5 is winning...

Computational Mama aka Ambika

9mo ago

Public

[GF] Compare KIKUYU translation with LLM

Here we take an input sample of Kikuyu phrases (and their expert transcription and English translations) and compare top LLMs as transalors. Currently Gemini 2.5 is winning...

Computational Mama aka Ambika

9mo ago

Public

Translate with o3-mini (high reasoning)

Which language model works best for your prompt? What are the biases inherent in each? Compare the latest models from Google, Deepseek, OpenAI, Mistral, Meta, OpenAI and Anthropic with more LLMs being added each month. If you are looking for local language models we now also host Sarvam and SEA-LION!

🧠

Computational Mama aka Ambika

9mo ago

248 runs

Public

Translate with o3 (high reasoning)

Which language model works best for your prompt? What are the biases inherent in each? Compare the latest models from Google, Deepseek, OpenAI, Mistral, Meta, OpenAI and Anthropic with more LLMs being added each month. If you are looking for local language models we now also host Sarvam and SEA-LION!

🧠

Computational Mama aka Ambika

9mo ago

249 runs

Public

Translate with Claude 4

Which language model works best for your prompt? What are the biases inherent in each? Compare the latest models from Google, Deepseek, OpenAI, Mistral, Meta, OpenAI and Anthropic with more LLMs being added each month. If you are looking for local language models we now also host Sarvam and SEA-LION!

🧠

Computational Mama aka Ambika

added {{ language }} variable

9mo ago

266 runs

Public

Translate with Gemini 2.5 pro

Which language model works best for your prompt? What are the biases inherent in each? Compare the latest models from Google, Deepseek, OpenAI, Mistral, Meta, OpenAI and Anthropic with more LLMs being added each month. If you are looking for local language models we now also host Sarvam and SEA-LION!

🧠

Computational Mama aka Ambika

added {{ language }} variable

9mo ago

264 runs

Public

Translate with GPT 5

Which language model works best for your prompt? What are the biases inherent in each? Compare the latest models from Google, Deepseek, OpenAI, Mistral, Meta, OpenAI and Anthropic with more LLMs being added each month. If you are looking for local language models we now also host Sarvam and SEA-LION!

🧠

Computational Mama aka Ambika

add {{ language }} variable

9mo ago

265 runs

Public

Translate with Claude 4.1

🧠

Computational Mama aka Ambika

9mo ago

263 runs

Public

Translate with GPT-4o

added a variable for language

🧠

Computational Mama aka Ambika

9mo ago

262 runs

Public

Translate with GPT 5 (high reasoning)

Which language model works best for your prompt? What are the biases inherent in each? Compare the latest models from Google, Deepseek, OpenAI, Mistral, Meta, OpenAI and Anthropic with more LLMs being added each month. If you are looking for local language models we now also host Sarvam and SEA-LION!

🧠

Computational Mama aka Ambika

9mo ago

249 runs

Public

Kikuyu->English (Google)

🗣️ Compare AI Translations

Compare translation models like Google Translate, GhanaNLP to understand which model provides the best translation, compare latency and accuracy and test for production with our Eval tool!

🗣️

Computational Mama aka Ambika

10mo ago

Public

Kikuyu->English (GhanaNLP)

🗣️ Compare AI Translations

Compare translation models like Google Translate, GhanaNLP to understand which model provides the best translation, compare latency and accuracy and test for production with our Eval tool!

🗣️

Computational Mama aka Ambika

10mo ago

Public