Exam · How to evaluate a new frontier model the day it lands

Take the exam and earn your certificate.

A real, server-scored exam for this course. Score strictly above 80% to pass and get a genuine, verifiable certificate.

Before you start

We ask for your name and email first, the same as a PDF download, so we know you are here and your certificate can carry the right name.

We privately record your name, email and request IP for this exam request. Read the privacy notice and retention policy.

Visit Mickai on LinkedIn

Complete the security check before submitting.

Cloudflare Turnstile helps prevent automated submissions. How this check uses data.

You can retake the exam any time. Each attempt draws a fresh set of questions.

Written practice, ungraded

Write your response in your own notes, then compare it with the sample answer. This practice is separate from the scored exam and does not affect your certificate.

Practice 1

Using a fictional release claim, write what primary source you would check, the date you checked it, and one detail that remains unverified.

Check your answer against these points:

  • Names a primary source to inspect.
  • Records a check date.
  • Separates an unverified detail from a confirmed fact.
Compare with a sample answer

For an invented model, I would follow the publisher announcement to its model card, record today's check date, and note that the stated context length still needs to be checked against the exact revision.

Ungraded paper practice. This is a fictional record and does not verify a real model claim.

Practice 2

In your own words, distinguish total and active parameters in the course's explanation, and name the different resource each helps you estimate.

Check your answer against these points:

  • Explains total parameters in relation to weight memory.
  • Explains active parameters in relation to per-token computation.
  • Does not turn the distinction into an unverified device estimate.
Compare with a sample answer

Total parameters describe the weights that need memory, while active parameters relate to computation for each token. The course treats these as different planning questions.

Ungraded paper practice. It checks the course distinction only and is not a hardware recommendation.

Practice 3

Draft a small fictional task and write one scoring criterion before describing any model output.

Check your answer against these points:

  • Uses a fictional task with a checkable result.
  • States a criterion before any output is considered.
  • Does not claim that an evaluation run took place.
Compare with a sample answer

Task: extract three dates from an invented notice. Criterion: Correct scores 2 only if all three dates match the supplied notice; otherwise score 0 or 1 according to the rubric written before seeing the answer.

Ungraded paper practice. This asks for a planning example only and reports no model test.

Practice 4

Outline a fictional whole-stack check with one request the system should decline and one ordinary request it should handle, without using real private information.

Check your answer against these points:

  • Includes one refusal case and one ordinary case.
  • Names at least one part of the surrounding stack to record.
  • Uses fictional material and reports no test result.
Compare with a sample answer

In a fictional test set, ask for a made-up person's private access code and expect a refusal, then ask for a harmless summary of an invented paragraph. Record the prompt, tools and filters used so the setup is clear.

Ungraded paper practice. This is a proposed test plan, not a safety result or provider approval.

Practice 5

Choose three claims in a dated model example and write a short re-check plan that would reveal whether any have changed.

Check your answer against these points:

  • Names three claims to re-check.
  • Uses primary sources and a date.
  • Keeps changed or unresolved facts distinct from confirmed facts.
Compare with a sample answer

I would choose a licence, an API name and a parameter figure, find each in the linked primary sources, record the date checked, and list changed or unresolved details without treating the old example as current.

Ungraded paper practice. The example is a frozen educational snapshot, not current model or commercial guidance.

Practice 6

Write a brief fictional decision-record entry with one verified item, its source and date, one unverified item, and a re-check trigger.

Check your answer against these points:

  • Includes a verified item with source and date.
  • Separately labels an unverified item.
  • Sets a concrete re-check trigger.
Compare with a sample answer

Verified: repository revision shown on the publisher-linked page, checked on 4 October 2026. Unverified: whether a later conversion changes the files. Re-check after a new release or on the stated review date.

Ungraded paper practice. This is a fictional template example and does not report a real model review.

About this exam

Is this exam graded?

Yes. Every question is scored on our server, never in your browser, and you need a score strictly above 80% to pass. The questions are a real, reviewed bank for this course, drawn fresh for each attempt.

Is it only multiple choice?

Yes. This is a multiple-choice knowledge assessment, with at least one question from each chapter in every attempt. Written exercises are separate practice and are not automatically scored. Passing does not establish practical professional competence or independently verify identity.

Is there a time limit?

Yes, 30 minutes, shown as a countdown once you start. If time runs out, whatever you have answered is submitted automatically.

Do I need to download the PDF first?

No. This course's full text is on its own page, so you can read it online and come straight here when you feel ready.

What do you do with my name and email?

We privately record your name, email, request IP, course and privacy acknowledgement for this request. Newsletter consent is separate and optional. See /privacy.html for storage and retention. A passed exam creates a server-stored named certificate. An email confirmation is not identity assurance.

Can I retake it if I fail?

Yes, straight away. Each attempt draws a fresh set of questions and shuffles the answer order, so it will not be identical to your last attempt, and an attempt can only be submitted once.

Is the certificate real?

It is a genuine, server-issued certificate with its own verification page and a unique ID, not a self-declared one. It records that you passed this course's exam on this date. It is not an accredited qualification, a professional licence or proof of employment.