Exam · Hybrid search and reranking for better retrieval

Take the exam and earn your certificate.

A real, server-scored exam for this course. Score strictly above 80% to pass and get a genuine, verifiable certificate.

Before you start

We ask for your name and email first, the same as a PDF download, so we know you are here and your certificate can carry the right name.

We privately record your name, email and request IP for this exam request. Read the privacy notice and retention policy.

Visit Mickai on LinkedIn

Complete the security check before submitting.

Cloudflare Turnstile helps prevent automated submissions. How this check uses data.

You can retake the exam any time. Each attempt draws a fresh set of questions.

Written practice, ungraded

Write your response in your own notes, then compare it with the sample answer. This practice is separate from the scored exam and does not affect your certificate.

Practice 1

A finite oracle check passes for its enumerated rankings, offsets and limits. Write two sentences that state what this supports and what it does not establish.

Check your answer against these points:

  • Names the finite tested domain.
  • Avoids universal correctness and production quality claims.
  • Separates implementation evidence from user or retrieval evidence.
Compare with a sample answer

It supports agreement of the implementation with the independent formula over the documented finite test domain. It does not prove correctness for every possible input, production retrieval quality, statistical significance or user satisfaction.

Ungraded practice based on the test evidence and its stated limits.

Practice 2

In a disposable copy, a learner changes fusion to start at rank zero and reranking to sort scores ascending. Predict one observable failure for each mutation, then state the safe restoration step.

Check your answer against these points:

  • Gives the changed first contribution.
  • Connects ascending order to the reranker assertion.
  • Restores code and reruns all ten tests.
Compare with a sample answer

The first RRF contribution becomes 1/60 rather than 1/61 with offset 60, so the one-based test should fail. Ascending score order puts lower scores first, so the highest-score-first test should fail. Restore the code and rerun all ten tests before using the exercise file.

Ungraded mutation exercise. It describes expected test behaviour from the supplied course, not an additional test run.

Practice 3

A teammate says the many assertions make this in-memory ranking tool ready as a production boundary. Draft a short response naming at least two limits the course says remain.

Check your answer against these points:

  • Mentions finite-domain test limits.
  • Names at least two missing service-boundary controls.
  • Does not turn test count into production acceptance.
Compare with a sample answer

The checks cover a finite domain and the implementation is an in-memory teaching tool. It does not implement network timeouts, request cancellation, byte limits or an external service boundary. Production use needs additional design and evidence.

Ungraded practice based on the chapter implementation limits.

Practice 4

Two retrievers return passages about the same query. Propose an ID and source-reference contract, then explain what a reranker cannot repair if fusion removed a relevant ID.

Check your answer against these points:

  • Uses stable IDs across retrieval channels.
  • Preserves source references.
  • Explains the reranking boundary for omitted candidates.
Compare with a sample answer

Both retrievers should return stable shared document or chunk IDs with the source reference preserved behind each ID. If fusion removed a relevant ID from the shortlist, reranking cannot add it; an earlier retrieval step or candidate window must change.

Ungraded practice based on identity and stage-boundary guidance.

Practice 5

Draft a privacy-conscious per-query execution record that would help locate a regression or slowdown. Include at least five useful fields and say how to reference sensitive source material.

Check your answer against these points:

  • Includes corpus or judgement version.
  • Captures retrieval depths and stage settings.
  • Includes reranker or selected-context information and timings.
  • Uses hashes or references for sensitive sources.
Compare with a sample answer

Record the corpus and judgement version, each retriever configuration and depth, ordered candidate IDs, fusion offset and shortlist, reranker revision and truncation, selected context, per-query quality and observed timings. Use hashes or suitable references instead of indiscriminately copying sensitive source text.

Ungraded worksheet exercise. It does not require sending data to an analytics vendor.

Practice 6

Write a short fallback note for a reranker outage and a separate check for the composed answer. Include the permission boundary and the degraded-run record.

Check your answer against these points:

  • Does not silently label a failed stage as an empty success.
  • Keeps the same permission checks.
  • Records normal or degraded path.
  • Evaluates answer support separately from retrieval ranking.
Compare with a sample answer

A validated fused shortlist may be used as a fallback if the same permission checks still apply; otherwise fail according to the agreed policy. Record the degraded path. Separately preserve source references through context selection and check whether the answer follows from them, since relevant retrieval alone does not certify an answer.

Ungraded practice based on fallback and answer-evaluation guidance.

About this exam

Is this exam graded?

Yes. Every question is scored on our server, never in your browser, and you need a score strictly above 80% to pass. The questions are a real, reviewed bank for this course, drawn fresh for each attempt.

Is it only multiple choice?

Yes. This is a multiple-choice knowledge assessment, with at least one question from each chapter in every attempt. Written exercises are separate practice and are not automatically scored. Passing does not establish practical professional competence or independently verify identity.

Is there a time limit?

Yes, 30 minutes, shown as a countdown once you start. If time runs out, whatever you have answered is submitted automatically.

Do I need to download the PDF first?

No. This course's full text is on its own page, so you can read it online and come straight here when you feel ready.

What do you do with my name and email?

We privately record your name, email, request IP, course and privacy acknowledgement for this request. Newsletter consent is separate and optional. See /privacy.html for storage and retention. A passed exam creates a server-stored named certificate. An email confirmation is not identity assurance.

Can I retake it if I fail?

Yes, straight away. Each attempt draws a fresh set of questions and shuffles the answer order, so it will not be identical to your last attempt, and an attempt can only be submitted once.

Is the certificate real?

It is a genuine, server-issued certificate with its own verification page and a unique ID, not a self-declared one. It records that you passed this course's exam on this date. It is not an accredited qualification, a professional licence or proof of employment.