gatesfoundation
A workspace for the Gates Foundation DPI, FairFoward and Gooey teams focused on evals for low-resource languages plus the home of our Agriculture advisory work e.g. https://gooey.ai/ageval
1y ago
Public
GPT-realtime, GPT4o realtime, Jacaranda(ASR) + GPT5 (LLM as MT) and Jacarandra + GPT5 + Google Translate are compared.
ASR: Jacaranda; MT: Google Translate, LLM: GPT5-mini; TTS: Google Chirp-HD
88 runs
95 runs
72 runs
67 runs
51 runs