Skip to content

Self-check

Where is your team stuck with AI agents? Twelve answers tell you.

Find out where your team stands with AI coding agents and which gaps are holding it back.

  • Twelve yes or no questions
  • three minutes
  • instant result
  • free, no account

Answer for one team, and count only what it does today, not what it plans to do. Leading several teams? Answer for a typical one, then ask each team lead to take the check for their own team and send you the link to their result. Your result builds as you go, and none of it is sent to us.

About you

Optional. Four answers tailor the recommendations to your scale, and product people get four questions of their own. Like your other answers, they stay in this browser and in the link.

Your role
Product development teams in your company
Average size of a team
People in product development in total: engineering, product, design and data

Your product practice

Four questions of our own for product people, taken from our product course. They are not part of the Agentic Joel Test and don't count toward the score of 12.

Do you use agents in discovery, for example to synthesise interviews or simulate personas?
Do you test ideas as clickable prototypes before engineering starts on them?
Do your requirements include edge cases and acceptance criteria an agent can check?
Is a validated spec ready whenever your team pulls the next item?

What your agents deliver

These two follow from everything else. A no here usually traces back to the questions further down.

1. Do your coding agents implement and ship routine tickets?
2. Do you use AI across the whole software development lifecycle?

What your agents can see and run

Context, a shared harness and a running system. This is engineering work on your codebase and platform.

3. Do your agents get the context automatically?
4. Do you maintain a shared agent harness?

The harness is everything your team builds around the coding agent and keeps in the repository: instructions such as AGENTS.md, skills, tests, linters and hooks.

5. Can your agents run your system and improve it from feedback?

How your people work with agents

Specifying, reviewing, owning and learning. These habits come from practice.

6. Can you write agent-ready tasks?
7. Do you have quality and review standards for agent code?
8. Does your team own what agents produce?
9. Does the whole team experiment and share?

What leadership provides

Tools, time, guardrails and measurement. These are budget and policy decisions.

10. Does your team have the best AI tools and time to learn?

Capable coding agents, frontier models and enough token budget, plus protected time to learn. A basic licence on its own does not count.

11. Do your agents have autonomy within enforced guardrails?
12. Do you measure AI's impact?

Delivery and quality metrics such as lead time or incidents, tracked over time or compared across teams. Seat and token counts show usage, not impact.

Next steps for your product practice

  • Give an agent the notes from your last five customer interviews to synthesise, and check its summary against what you actually heard.
  • Build your next idea as a prototype with a tool such as Lovable or v0, and show it to two users before you write the ticket.
  • Add edge cases and checkable acceptance criteria to your next requirement, so an agent can verify its own result against them.
  • Refine continuously in small slices rather than in one big planning round, so the next validated spec is always waiting.
TrainingsAgentic Engineering for Product Managers and Product Owners

Your next steps

  1. 1. Pick one ticket type your team handles often and let an agent take it all the way from ticket to merged change, with a person reviewing.
  2. 2. List the steps from refinement to operations where agents never show up, and try one of them on real work.
  3. 3. Write down what a new developer needs to know about your codebase, and put it where the agent loads it at the start of every session.
  4. 4. Move the prompts, rules and tools each developer keeps privately into one repository the whole team maintains.
  5. 5. Give the agent a way to start the system, run the tests and read the logs, so it checks its own work before a person does.
  6. 6. Rewrite your next ticket so an agent could do it without coming back with questions: goal, constraints, acceptance criteria and how to verify it.
  7. 7. Agree as a team what agent code has to pass before review, and automate as much of that check as you can.
  8. 8. Whoever started the agent is responsible for its change, exactly as if they had written the code themselves.
  9. 9. Set up a short weekly slot where the team shows what worked with agents and what didn't.
  10. 10. Give the team current tools, and build learning time into the plan instead of adding it on top.
  11. 11. Decide which actions agents may take on their own, and enforce those limits technically through permissions and gates, not a policy document.
  12. 12. Pick two or three measures you already collect, such as lead time from idea to first users and rework rate, and record a baseline now.

How the score works

  1. 0 to 6

    Your team is at the start of agentic engineering

  2. 7 to 10

    Your team works with agents

  3. 11 to 12

    Agentic engineering is how your team works

Each yes scores one point, and not sure counts as no. The total is a rough guide; the individual answers tell you more.

Based on Semjon Mössinger's Agentic Joel Test (opens in a new tab), twelve yes-or-no questions on how ready a team's engineering practice is for agents, after Joel Spolsky's Joel Test. The questions are his.