Magai

Worksheet for anyone who works with words, PDF, 8 pages

The five task chatbot test

Five prompts, a blind scoring routine and a score card, so you can find the best chatbot for your own work in one afternoon.

  • Five task prompts with the blanks marked
  • A blind scoring routine for three contenders
  • A score card and a tiebreaker for close results
  • A rerun schedule for when new models ship

Made in the tutorial Best AI Chatbot: Run Five Tasks, Keep the Winner, where every prompt in it is run to its result.

This is for the week you're deciding which chatbot gets your money, or whether the one you already pay for still deserves it. It gives you a way to decide on your own work instead of on a stranger's ranking.

Inside are five tasks: writing, research with sources, a long file, code or math, and an image or video brief. Each has a prompt with the blanks marked, a note on what to judge, and a three level score. There's a blind scoring routine, a score card to fill in, and a short list of tiebreakers for when two chatbots land together.

Paste each prompt into one Magai thread once per contender, naming the model with a slash pill. Start with Claude, ChatGPT and Gemini as families, then add the rest where the job calls for them. Save the winners to your prompt library and rerun the test when a new model ships.

A look inside

A page of the worksheet

Three pieces of it, as they are in the PDF. The rest is the same shape.

  • 1

    Answer this question and cite a source for every factual claim: [question]. After the answer, list each source as: the claim, the link, and the exact sentence on the page that supports it. If you can't find a source for a claim, say so instead of guessing.

  • 2

    Using only the attached file, answer these four questions. For each answer, quote the sentence or cell that supports it and give its page or row. 1. [a fact from page 2] 2. [a fact from the middle of the file] 3. [a fact from near the end] 4. [a fact that is not in the file] If the file doesn't say, write "not in the file".

  • 3

    Score it. 2 points if it finds all three facts and flags the fourth as missing. 1 point if it finds all three and invents the fourth. 0 points if it misses the middle fact.

The prompts are the start. Magai is where they run.

Every leading model in one chat, a workspace for your team, and your saved prompts one click away in all of it. Thirty-day money-back guarantee.