• Gooey.AI
  • SimpleBench Bulk Eval

    Here we run the incredible questions from the public dataset of the Simple Bench benchmark comparing the top models and how well they perform against these questions, which are pretty obvious for most humans but tend to trip up LLMs quite badly. If anyone wants to try their hand at competing in the Jan 2025 prompt engineering contest, just duplicate any of the workflows below, save it and then add your saved workflow as another workflow to compare against (it's ok to delete the others too).


    Gooey Workflows

    Provide one or more Gooey.AI workflow runs.
    You can add multiple runs from the same recipe (e.g. two versions of your copilot) and we'll run the inputs over both of them.

    Compare LLMs: GPT4o, Claude3.5 Sonnet, Gemini 1.5 Pro, LLaMA3 vs Mixtral

    o1-preview Simple Bench Runner

    Compare LLMs: GPT4o, Claude3.5 Sonnet, Gemini 1.5 Pro, LLaMA3 vs Mixtral

    GPT4o - Simple Bench Runner

    Compare LLMs: GPT4o, Claude3.5 Sonnet, Gemini 1.5 Pro, LLaMA3 vs Mixtral

    Claude3.5-Sonnet - Simple Bench Runner

    Compare LLMs: GPT4o, Claude3.5 Sonnet, Gemini 1.5 Pro, LLaMA3 vs Mixtral

    Gemini 1.5 pro- Simple Bench Runner


    Input Data Spreadsheet

    Upload or link to a CSV or google sheet that contains your sample input data.
    For example, for Copilot, this would sample questions or for Art QR Code, would would be pairs of image descriptions and URLs.
    Remember to includes header names in your CSV too.

    Loading...
    Preview: Here's what you uploaded

    Loading...

    Columns

    Please select which CSV column corresponds to your workflow's input fields.
    For the outputs, select the fields that should be included in the output CSV.
    To understand what each field represents, check out our API docs.

    Inputs
    Outputs

    Evaluation Workflows

    (optional) Add one or more Gooey.AI Evaluator Workflows to evaluate the results of your runs.

    Multiple Choice Eval


    Run cost = 1 credits

    By submitting, you agree to Gooey.AI's terms & privacy policy.