Examples: Bulk


Farmer.CHAT Bulk Evaluator (GPT4, Mixtral, Claude vs Gemini Pro 1.5)

Loading...

3 runs

Which AI model actually works best for your needs? Upload your own data and evaluate any Gooey.AI workflow, LLM or AI model against any other. Great for large data sets, AI model evaluation, task automation, parallel processing and automated testing. To get started, paste in a Gooey.AI workflow, upload a CSV of your test data (with header names!), check the mapping of headers to workflow inputs and tap Submit. More tips in the Details below.

Documents

šŸ”—https://docs.google.com/spreadsheets/d/1cLHMCxn1I4y1CderaXwj7lNwztqRxrWPZ5UmQmsGRvo/edit?usp=sharing

Compare Hindi Speech Recognition

Loading...

5 runs

Which AI model actually works best for your needs? Upload your own data and evaluate any Gooey.AI workflow, LLM or AI model against any other. Great for large data sets, AI model evaluation, task automation, parallel processing and automated testing. To get started, paste in a Gooey.AI workflow, upload a CSV of your test data (with header names!), check the mapping of headers to workflow inputs and tap Submit. More tips in the Details below.

Documents

šŸ”—https://docs.google.com/spreadsheets/d/13f-K31MWsZh2NI9M6tQsmx2CvQEz4GxfJLXVNAhO-tI/edit?usp=sharing

Compare Chichewa Speech Recognition

Loading...

15 runs

In this bulk run example, we compare Gooey.AI speech recognition + translations workflows (https://gooey.ai/speech), each of which uses a different AI speech model:

  1. MMS Large + Google Translation
  2. Seamless M4T - WINNER!
  3. Google Chirp + Google Translate

We then evaluate them at https://gooey.ai/eval/ (where you can see what works best....)

Documents

šŸ”—https://docs.google.com/spreadsheets/d/1Gvw0RpNdFfbBlKtm72Dc9goHVm88Ia9fNIly5ZTjw_c/edit#gid=0

Compare KIKUYU Speech Recognition

Loading...

21 runs

Here we take an input sample of Kikuyu phrases (and their expert transcription and English translations) and compare the top Speech Reco and Translation models. As of April 3, 2024, we've found that Meta's MMS-Large works best for Kikuyu with Ghana NLP's Kikuyu to English translation services.

. Which AI model actually works best for your needs?
Upload your own data and evaluate any Gooey.AI workflow, LLM or AI model against any other.
Great for large data sets, AI model evaluation, task automation, parallel processing and automated testing.
To get started, paste in a Gooey.AI workflow, upload a CSV of your test data (with header names!), check the mapping of headers to workflow inputs and tap Submit.
More tips in the Details below.

Documents

šŸ”—https://docs.google.com/spreadsheets/d/11DMc9RYcu5wgdZ8GUFe377q_Vh2T5lgXvzTA6uakzg0/edit#gid=0

Farmer.CHAT - Bulk Runner and Evaluator (GPT4, Mixtral Comparison)

Loading...

3 runs

Which AI model actually works best for your needs? Upload your own data and evaluate any Gooey.AI workflow, LLM or AI model against any other. Great for large data sets, AI model evaluation, task automation, parallel processing and automated testing. To get started, paste in a Gooey.AI workflow, upload a CSV of your test data (with header names!), check the mapping of headers to workflow inputs and tap Submit. More tips in the Details below.

Documents

šŸ”—https://docs.google.com/spreadsheets/d/1cLHMCxn1I4y1CderaXwj7lNwztqRxrWPZ5UmQmsGRvo/edit?usp=sharing

Compare Kannada Speech Recognition

Loading...

6 runs

In this bulk run example, we compare 3 different Gooey.AI speech recognition + translations workflows (https://gooey.ai/speech), each of which uses a different AI speech model:

Whisper v2
Google Chirp
Azure

We then evaluate them at https://gooey.ai/eval/ (where you can see what works best....)

Documents

šŸ”—https://docs.google.com/spreadsheets/d/1Z0bWFrPzHlpAhj5yLBboS_oQBq7yrBcZfgLzmfsTtEo/edit?usp=drive_web&ouid=111885746914004489729

Compare Swahili Speech Recognition

Loading...

6 runs

Which AI model actually works best for your needs?
Upload your own data and evaluate any Gooey.AI workflow, LLM or AI model against any other.
Great for large data sets, AI model evaluation, task automation, parallel processing and automated testing.
To get started, paste in a Gooey.AI workflow, upload a CSV of your test data (with header names!), check the mapping of headers to workflow inputs and tap Submit.
More tips in the Details below.

Documents

šŸ”—https://docs.google.com/spreadsheets/d/1KKTWq08nnRukTqe2vtR-kjZL5xIt27vjEIQVWvbhl6I/edit#gid=0

Karpathy Pod answers

Loading...

18 runs

In this bulk run example, we compare 6 different Gooey.AI speech recognition + translations workflows (https://gooey.ai/speech), each of which uses a different AI speech model:
Whisper Telugu Bhashini
Whisper v2
Google Chirp
Azure
Meta Seemless 4MT
AI4Bharat.org Conformer Hindi

We then evaluate them at https://gooey.ai/eval/ (where you can see what works best....)

Documents

šŸ”—karpathy-pod-eval.csv

Compare Telugu Speech Recognition

Loading...

102 runs

In this bulk run example, we compare 5 different Gooey.AI speech recognition + translations workflows (https://gooey.ai/speech), each of which uses a different AI speech model:
Whisper Telugu Bhashini
Whisper v2
Google Chirp
Azure
Meta Seemless 4MT

We then evaluate them at https://gooey.ai/eval/?example_id=lc1f4ka1 (where you can see what works best....)

Documents

šŸ”—https://docs.google.com/spreadsheets/d/1anFvMbsj5d0GOTLiWXW88DTPP4gyoUzu0_BzVoIP0jA/edit

Ulangizi Copilot Eval

Loading...

2 runs

Testing AI bots and copilots (https://gooey.ai/copilot) in practice is complex because the answer a bot will give is affected not just by the user's last question but also by the conversation history that preceded that question. Hence, this bulk example shows you how to format your CSV to include a bot/user conversation history before each question is asked. The output columns also show which knowledge documents were returned as results that the bot used in trying to formulate its answer.

Documents

šŸ”—https://docs.google.com/spreadsheets/d/1kOng5UJJ8yvWfgKbWEjk3mSNNbBUrPb6SiE2srlOLBM/edit?usp=sharing

Copilot Message History Eval

Loading...

1 runs

Testing AI bots and copilots (https://gooey.ai/copilot) in practice is complex because the answer a bot will give is affected not just by the user's last question but also by the conversation history that preceded that question. Hence, this bulk example shows you how to format your CSV to include a bot/user conversation history before each question is asked. The output columns also show which knowledge documents were returned as results that the bot used in trying to formulate its answer.

Documents

šŸ”—bulk-runner-0-3.csv

Bulk Runner for different dense embeddings weightages

Loading...

7 runs

This example takes a CSV with URLs and image descriptions and then runs our artistic QR Code maker over each of them, generating two QR codes for each URL + description pair. This is great if you want to create 100s of art QR Codes in one huge batch.

Documents

šŸ”—DENSE-weightage-copilot - Sheet1.csv

Compare Anime vs Pixar Profile Pix style

Loading...

1 runs

This bulk run compares two different AI Image editor workflows - one that takes profile pictures and renders them in an anime vs Pixar style. Swap out the CSV with your own list of profile photo URLs to test even more. Swap out the workflow URLs with different Image prompts to test out new styles.

About the Bulk Runner:
Which AI model actually works best for your needs? Upload your own data and evaluate any Gooey.AI workflow, LLM or AI model against any other. Great for large data sets, AI model evaluation, task automation, parallel processing and automated testing. To get started, paste in a Gooey.AI workflow, upload a CSV of your test data (with header names!), check the mapping of headers to workflow inputs and tap Submit. More tips in the Details below.

Documents

šŸ”—https://docs.google.com/spreadsheets/d/1vrR-QR-7i9vb-9xatdlC4k3rAR47yP5VamwA1db7jgA/edit?usp=sharing

Bulk Create Art QR codes

Loading...

10 runs

This example takes a CSV with URLs and image descriptions and then runs our artistic QR Code maker over each of them, generating two QR codes for each URL + description pair. This is great if you want to create 100s of art QR Codes in one huge batch.

Documents

šŸ”—qrcodes.csv