Write your response in your own notes, then compare it with the sample answer. This practice is separate from the scored exam and does not affect your certificate.
Practice 1
A finite oracle check passes for its enumerated rankings, offsets and limits. Write two sentences that state what this supports and what it does not establish.
Check your answer against these points:
- Names the finite tested domain.
- Avoids universal correctness and production quality claims.
- Separates implementation evidence from user or retrieval evidence.
Compare with a sample answer
It supports agreement of the implementation with the independent formula over the documented finite test domain. It does not prove correctness for every possible input, production retrieval quality, statistical significance or user satisfaction.
Ungraded practice based on the test evidence and its stated limits.
Practice 2
In a disposable copy, a learner changes fusion to start at rank zero and reranking to sort scores ascending. Predict one observable failure for each mutation, then state the safe restoration step.
Check your answer against these points:
- Gives the changed first contribution.
- Connects ascending order to the reranker assertion.
- Restores code and reruns all ten tests.
Compare with a sample answer
The first RRF contribution becomes 1/60 rather than 1/61 with offset 60, so the one-based test should fail. Ascending score order puts lower scores first, so the highest-score-first test should fail. Restore the code and rerun all ten tests before using the exercise file.
Ungraded mutation exercise. It describes expected test behaviour from the supplied course, not an additional test run.
Practice 3
A teammate says the many assertions make this in-memory ranking tool ready as a production boundary. Draft a short response naming at least two limits the course says remain.
Check your answer against these points:
- Mentions finite-domain test limits.
- Names at least two missing service-boundary controls.
- Does not turn test count into production acceptance.
Compare with a sample answer
The checks cover a finite domain and the implementation is an in-memory teaching tool. It does not implement network timeouts, request cancellation, byte limits or an external service boundary. Production use needs additional design and evidence.
Ungraded practice based on the chapter implementation limits.
Practice 4
Two retrievers return passages about the same query. Propose an ID and source-reference contract, then explain what a reranker cannot repair if fusion removed a relevant ID.
Check your answer against these points:
- Uses stable IDs across retrieval channels.
- Preserves source references.
- Explains the reranking boundary for omitted candidates.
Compare with a sample answer
Both retrievers should return stable shared document or chunk IDs with the source reference preserved behind each ID. If fusion removed a relevant ID from the shortlist, reranking cannot add it; an earlier retrieval step or candidate window must change.
Ungraded practice based on identity and stage-boundary guidance.
Practice 5
Draft a privacy-conscious per-query execution record that would help locate a regression or slowdown. Include at least five useful fields and say how to reference sensitive source material.
Check your answer against these points:
- Includes corpus or judgement version.
- Captures retrieval depths and stage settings.
- Includes reranker or selected-context information and timings.
- Uses hashes or references for sensitive sources.
Compare with a sample answer
Record the corpus and judgement version, each retriever configuration and depth, ordered candidate IDs, fusion offset and shortlist, reranker revision and truncation, selected context, per-query quality and observed timings. Use hashes or suitable references instead of indiscriminately copying sensitive source text.
Ungraded worksheet exercise. It does not require sending data to an analytics vendor.
Practice 6
Write a short fallback note for a reranker outage and a separate check for the composed answer. Include the permission boundary and the degraded-run record.
Check your answer against these points:
- Does not silently label a failed stage as an empty success.
- Keeps the same permission checks.
- Records normal or degraded path.
- Evaluates answer support separately from retrieval ranking.
Compare with a sample answer
A validated fused shortlist may be used as a fallback if the same permission checks still apply; otherwise fail according to the agreed policy. Record the degraded path. Separately preserve source references through context selection and check whether the answer follows from them, since relevant retrieval alone does not certify an answer.
Ungraded practice based on fallback and answer-evaluation guidance.