retrieval · Level 3
Source-grounded literature reviews with AI
A MICKAI registered Training Academy research workbook for verifiable references, reproducible methods and accountable synthesis.

Your next step
Start this course online
Register your start, then work through the lessons and exercises at your own pace. You can download the PDF separately. Where a scored exam is available, you will find it after the lessons.
Register or resume your course
Start with the essentials
The short answer
Use AI for bounded permitted research tasks, then verify source identity, version, passage support and calculations yourself. Preserve search limits, disagreements and missing evidence. A real reference or matching hash cannot independently establish that a conclusion follows from a source.
What you will learn
- Justify a review approach and write an explicit question, eligibility criteria and amendment process.
- Classify source permissions and confidentiality requirements in the selected institutional, funder and jurisdiction context.
- Document a reproducible search and explain the limits of its sources, queries and retrieval coverage.
- Verify citation candidates, identify duplicates and link source documents, corrections and study identities.
- Extract passage-linked findings, reproduce calculations and distinguish results, derived values and unsupported inference.
- Deliver an auditable critical review with screening reasons, uncertainty, correction history and appropriate AI-use disclosure.
Who it is for
Adult university researchers, postgraduate students, research librarians and research-support teams. Not an unsupervised child or school-student tutor.
Before you start
- Experience reading an academic or technical report. No programming or paid AI subscription is required.
- Use only the supplied fictional collection unless your institution has approved the actual material and processing activity.
Jurisdiction and study scope
These are selected reference pathways. Choose the relevant pathway before applying the exercises. This does not determine applicable law or provide worldwide coverage.
All pathway limits
- United Kingdom: select institution and funder: Check the actual university, research activity, funder, publisher and applicable privacy and source-rights requirements. Oxford is one institutional example. UKRI application and assessment rules have their stated scope; they are not universal rules for all university literature reviews.
- European Union: specify Member State and institution: The October 2026 fourth-edition ERA guidelines are nonbinding research guidance. Identify the actual Member State, institution, funder, contractual conditions and legal requirements. This course provides no exhaustive legal determination.
- United States: specify institution, state and funder: The NIH notice applies to its specified scientific peer-review activity. It is not a general prohibition on every university AI use. Check the actual research, institution, funder, source rights and applicable law.
- Another jurisdiction or cross-border research: Select the research locations and relevant institutional, funder, journal, privacy, source-rights and confidentiality rules with appropriate local leads. The selected references do not establish worldwide legal coverage.
Run the synthetic exercise
Download the exercise source, tests and instructions (ZIP)
No real records, external service or model is used by this exercise. Read the supplied synthetic records and README. Run the optional Python standard-library auditor or use the same records and questions on paper. No network or model is needed.
AI-assisted preparation of this newly commissioned owner course. The campus collection, source passages, measurements and review scenarios are original fictional teaching material, not published campus research or client performance.
Learn in your browser · Chapter 01 of 08
Define the question, review type and research contract
A defensible review begins with a question and a declared method, not a fluent summary. Decide what you are trying to learn, which evidence could answer it and what the available collection cannot establish. AI assistance must operate within those decisions rather than quietly making them.
The recurring case is an explicitly fictional campus-energy collection. Adult researchers are preparing a structured critical narrative review of observed energy changes following interventions in university settings. The twelve supplied records contain duplicates, a correction, unsuitable populations, unavailable material and an unverified reference. These are original teaching fixtures, not real publications or evidence about actual universities. No live database search or classroom validation is implied by completing the exercise.
Frame the question neutrally: what observed energy changes are reported after interventions in university settings, and what limits their interpretation? The wording permits increases, decreases and uncertain findings. Asking which technologies successfully reduce campus energy would encourage looking only for favourable results and narrow the intervention types prematurely. Record the population, intervention range, outcomes and eligible evidence before deciding which findings seem persuasive.
Choose a review method deliberately
Purpose determines the method. A closed supplied collection cannot establish comprehensive coverage.
Scroll the diagram sideways, or read every step and relationship below. Keyboard: focus the diagram, then use the Left and Right arrow keys.
- Research purpose: Specify what the reader needs to understand.
- Critical narrative: Explain and evaluate a bounded body of evidence.
- Scoping review: Map evidence characteristics with explicit methods.
- Systematic review: Use an appropriate prespecified and reproducible methodology.
- Research purpose to Critical narrative: Interpret a bounded question
- Research purpose to Scoping review: Map a field
- Research purpose to Systematic review: Answer a defined synthesis question
The question determines the review purpose. A narrative review can critically organise selected literature while explaining its selection and limits. A scoping review maps the extent and characteristics of evidence around a defined area using explicit methods. A systematic review needs a method appropriate to its question, including an explicit strategy for identifying and evaluating relevant evidence. Applying a checklist to a supplied folder does not turn the folder into a comprehensive search.
PRISMA 2020 supports transparent reporting of systematic reviews. It is not a certificate of methodological quality or a complete conduct manual. PRISMA-ScR provides reporting guidance for scoping reviews. Our closed fixture borrows useful reporting distinctions but remains a structured critical narrative teaching exercise. The title, abstract and methods must state that boundary even if the final document contains a flow diagram and detailed extraction tables.
Write a short review contract. Specify the question, university-only population, observed-outcome requirement, permitted source collection, extraction fields and decision process. Include who resolves uncertain cases, how changes are recorded and which outputs require source verification. Define how you will distinguish reported observations from causal claims. A contract makes departures visible; it does not establish that the method is sufficient for every research purpose.
Consider R01, the uncontrolled LED example. Consumption changes from 120 to 90 MWh, a reduction of 30 MWh or 25 percent relative to the initial value. Those calculations describe the supplied observation. Without a control group or another justified causal design, they do not establish that lighting caused the whole change. A useful contract preserves this distinction instead of letting an attractive percentage become an unsupported effectiveness claim.
An average prompt asks for a comprehensive review showing that campus interventions save energy. An elite prompt defines the role as a research assistant, supplies only permitted records, states the neutral question and requires a claim, source ID, passage locator and limitation for each proposed finding. It forbids new references and requires an unresolved label where support is missing. The researcher still checks each proposed connection; a well-structured answer can contain a well-structured error.
Keep methodological amendments separate from editorial improvements. Including simulations later changes the observed-outcome criterion and affects R06. Record the reason and revisit relevant decisions consistently. Do not broaden the rule only to admit a favourable result. Equally, do not call a missing report an exclusion merely to make the final count tidy. The research record should reveal what remains unanswered.
Try it yourself · Activity 01
35 minutesWrite the campus-energy review contract
Prepare a one-page contract another researcher could use to understand the review purpose and limits.
- Write a neutral question covering the university population and observed energy outcomes.
- Name the review type and state that the collection is a closed synthetic fixture.
- Specify the observed-outcome criterion and treatment of uncertain or unavailable material.
- Define the minimum fields needed to support a proposed claim.
- Rewrite the claim that the LED intervention caused a 25 percent saving.
- State how a later eligibility amendment will be recorded and applied.
Which phrase prevents a polished draft from claiming more than the method supports?
Worked answer
A successful contract identifies a structured critical narrative review, accepts relevant observed outcomes without requiring benefit, keeps unavailable material unresolved and requires source IDs, locators and interpretation limits. R01 supports an observed fall from 120 to 90 MWh, or 25 percent, in an uncontrolled example. It does not establish causal contribution. Amendments need a dated reason and consistent reconsideration.
Try it yourself · Activity 02
20 minutesChapter 1 review questions
Answer in your own words before checking the worked explanations.
- Why permit unfavourable findings?
- Why is the fixture unsuitable for comprehensive-search claims?
- How does a scoping purpose differ?
- What does a PRISMA checklist fail to establish?
- Which R01 statements are arithmetic rather than causal?
- How should eligibility expand to simulations?
Which distinction would most change the way you review a real source?
Worked answer
1. Otherwise selection can favour a desired conclusion. 2. Records were supplied for teaching, not retrieved through demonstrated coverage. 3. Scoping maps an evidence field; this exercise interprets a bounded collection. 4. A checklist does not certify completeness or sound conduct. 5. The 30 MWh and 25 percent reductions describe values, not causal attribution. 6. Record an amendment and reconsider affected records consistently.
Apply what you learned · Practice
Explanation and answer
A structured critical narrative review of a supplied fictional collection. The limited supplied collection and actual methods determine the description.
Practice only. This does not count towards your exam or certificate.
Learn in your browser · Chapter 02 of 08
Establish permission before processing research material
Being able to read a document does not automatically authorise uploading it to an AI service. Permission depends on the material, role, institution, funder, publication and actual tool arrangement. Check those boundaries before preparing a model input.
Separate discovery from ingestion. A catalogue record may contain public bibliographic details while its associated report is licensed, confidential or unavailable. Record those states independently. R08 is a confidential unpublished observational study report, represented by metadata only; eligibility is not yet assessed and its content is withheld. Its existence can remain in an appropriately limited internal register. Withholding it is not a judgement that the unseen findings are irrelevant.
Prepare a permission record for each proposed input: identifier, source, access basis, proposed operation, approved environment, restrictions and review date. A library subscription does not necessarily permit transfer of full text to a third-party processor. Ask the institution library, research support or information-governance team where terms are unclear. Keep the question specific: summarising a published passage and evaluating a confidential funding application are different activities.
Permission is specific to an operation
Reading, reusing and exporting are separate activities. Confidentiality can prevent an otherwise technically possible upload.
Scroll the diagram sideways, or read every step and relationship below. Keyboard: focus the diagram, then use the Left and Right arrow keys.
- Identify material: Public metadata, licensed text or confidential record?
- Check applicable rules: Institution, funder, journal, contract and jurisdiction.
- Approve the operation: Distinguish local reading from external model processing.
- Withhold if unresolved: Do not export R08; seek an authorised decision.
- Identify material to Check applicable rules: Do not infer rights from access
- Check applicable rules to Approve the operation: Record the decision
- Approve the operation to Withhold if unresolved: Unresolved or disallowed processing
Open licensing answers some questions but not every question. CC BY 4.0 permits sharing and adaptation subject to its terms, including appropriate attribution and identification of changes. Other rights may matter. A licence on an article does not establish that every separately credited image or disclosed personal detail can be reused in any manner. Verify the material actually covered and the proposed operation.
Institutional rules are examples, not universal permissions. Oxford research policy version 1.1, dated 7 September 2026, addresses responsibility, intellectual property, information security and disclosure within its stated scope. It distinguishes governed arrangements from personal accounts. Researchers elsewhere must check their own requirements. An enterprise label alone does not prove approval for a dataset, connector or activity.
Funder rules depend on role. UKRI permits a narrow language-refinement exception for assessors, without entering application content or personal information, or using AI to understand, summarise or evaluate the application. Applicant responsibilities are separately stated. Relabelling an assessment prompt as editing does not change the actual processing activity.
NIH Notice NOT-OD-23-149 prohibits specified generative-AI analysis and critique preparation in NIH scientific peer review. It also describes prior approval for possible accessibility exceptions. Its scope is particular peer-review activity, not every use of AI in United States university research. An exception from another funder cannot be transferred to this process.
Elsevier journal policy, updated June 2026, permits specified supportive reviewer uses only with private AI tools as defined by that policy and verified from their terms, while preserving responsibility and confidentiality. It prohibits uploading submitted manuscripts or their information, including to tools described as private. A background literature search must avoid disclosing confidential manuscript information. Check the actual journal and role rather than relying on remembered guidance.
The European Commission fourth-edition research guidelines, published on 15 October 2026, are nonbinding guidance. They do not displace applicable institutional, funder, journal or legal requirements. Select the jurisdiction and setting explicitly. Where obligations conflict or permission remains unclear, retain the ordinary research workflow and obtain an authorised interpretation before transferring material.
An average approach uploads every file and asks the tool to ignore confidential parts. An elite process removes unauthorised material before any transfer, records the permitted subset and requests only the necessary operation. A local model changes where processing occurs but does not remove source rights, confidentiality or disclosure obligations. Logs, indexes and generated outputs also need reviewed access boundaries. Do not leak withheld content through a filename, summary or retrieval cache.
Try it yourself · Activity 03
35 minutesPrepare a permitted input packet
You have public metadata, a CC BY article, licensed full text and metadata for confidential R08. Plan a drafting task without transferring restricted content.
- Create separate access and model-ingestion fields.
- Identify the precise task and researcher role before selecting a policy.
- Keep R08 content outside the input and record its permission-held status.
- List unresolved licence or institutional questions.
- Specify the limited authorised input and output-verification task.
- Define a pre-transfer check of the actual packet, not only its prompt.
Which assumption about access or an enterprise account could cause an unauthorised transfer?
Worked answer
The packet passes only when every included item has a basis for the proposed operation. Public metadata and full text are separate. CC BY conditions do not erase other rights. Licensed text remains out when transfer permission is unresolved. R08 contains only approved minimal status metadata. The reviewer inspects what would actually be sent.
Try it yourself · Activity 04
20 minutesChapter 2 review questions
Answer in your own words before checking the worked explanations.
- Why separate reading and uploading?
- What does CC BY not settle?
- Can an Oxford arrangement authorise another institution?
- Can UKRI assessors summarise applications under language refinement?
- Does the NIH notice ban all university AI research?
- Does local hosting resolve R08?
Which distinction would most change the way you review a real source?
Worked answer
1. Access and processing may have different conditions. 2. Other rights, material coverage and operation-specific restrictions remain relevant. 3. No; the arrangement has institutional scope. 4. No; the exception excludes application content and its understanding or evaluation. 5. No; the notice has specified peer-review scope. 6. No; changing processing location does not supply permission.
Apply what you learned · Practice
Explanation and answer
No confidential report content; use only approved material. Technical access and tool branding do not establish permission.
Practice only. This does not count towards your exam or certificate.
Learn in your browser · Chapter 03 of 08
Make searches reproducible and their limits visible
Retrieving plausible references is not the same as searching an evidence field defensibly. A useful record explains what was attempted, retrieved and potentially missed. AI can propose search ideas, but it must not invent a search history.
Begin with concepts from the question. One concerns university settings and another concerns energy interventions or consumption. Candidate terms include university, campus and higher education alongside electricity, energy use, lighting, occupancy sensors and heating. These are starting points, not a validated strategy. Check terminology with subject expertise and the platform actual indexing.
Combine synonyms within concepts and connect concepts deliberately. A draft query is (university OR campus OR higher education) AND (energy OR electricity OR lighting OR heating). Each platform has its own syntax, fields and phrase handling, so translate and test it before use. A mandatory saving term could miss R05, whose total energy increases. Do not make beneficial outcome language a hidden eligibility criterion.
Search coverage has boundaries
A search result is a retrieved set, not proof that no relevant evidence exists elsewhere.
Scroll the diagram sideways, or read every step and relationship below. Keyboard: focus the diagram, then use the Left and Right arrow keys.
- Selected sources: Record databases, versions and access dates.
- Exact query: Keep concepts, syntax, filters and amendments.
- Retrieved candidates: Save IDs and counts without assuming relevance.
- Possible missed evidence: Track uncovered sources, terms and inaccessible reports.
- Selected sources to Exact query: Adapt syntax to source
- Exact query to Retrieved candidates: Run and record
- Retrieved candidates to Possible missed evidence: Investigate gaps
Distinguish the question from the string. A university-only review may retrieve R07, a school report, through broad education terms. Screening can then exclude the wrong population. Retrieval of an ineligible record does not itself show a defective search. Conversely, a tidy list of relevant-looking results does not prove that important eligible work has been found.
Choose sources for the discipline and question. Energy research may span engineering publications and institutional repositories selected with an information specialist. Cochrane chapter 4, updated March 2025, discusses documented searching in its health-intervention context. Do not copy that context-specific database recipe into campus-energy research. Adopt justified source selection and traceable execution while adapting to the actual discipline.
For each executed search, retain platform, database or collection, exact query, fields, filters, date, operator and exported records. Preserve the original export before deduplication. Record revisions and their reasons. A later rerun can differ because indexing and web content change. A search-engine estimate is not the count of records actually exported or screened. Separate these quantities so the methods can be checked.
Do not invent execution dates or pretend the twelve supplied records were retrieved by your proposed query. This activity is a search-design rehearsal. A local test can check whether terms retrieve selected fixture descriptions. Finding them all establishes only that bounded behaviour. It cannot estimate missed real-world literature because that wider evidence denominator is not known.
An average request asks for every important paper and a final bibliography. An elite request asks for concept synonyms, platform-specific candidates and likely omissions, with proposed searches distinguished from executed searches and unknown fields left unknown. The researcher executes authorised searches and checks the exports. A generated citation is a lead until its identity and support are established.
Language, date, document type, access and screening capacity can remove evidence from view. State and justify restrictions rather than hiding tool defaults. R09 is unresolved because the full report is unavailable, while R06 conflicts with the observed-outcome criterion. These are different reasons. Citation chasing can reveal additional leads, but finding more references still does not certify complete coverage.
Agree the stopping and update decision before fatigue determines it. For the exercise, stop after evaluating the supplied collection and report its boundaries. For real work, plan the question-appropriate searches and updates with the team. Retain negative searches and unresolved leads. If a deadline limits screening, state how far the process progressed rather than reporting all retrieved material as examined.
Try it yourself · Activity 05
40 minutesAudit a proposed search log
A draft states only: AI searched campus energy savings; twelve results; comprehensive review completed. Repair the record without inventing activity.
- Identify claims without execution evidence.
- Draft neutral concept groups.
- List platform-specific details needed for reproduction.
- Distinguish supplied, exported and screened records.
- Explain R06 exclusion and R09 unresolved status separately.
- Write the closed-collection limitation.
Which default filter could conceal contrary evidence in your discipline?
Worked answer
The repaired record labels a proposed search strategy and twelve supplied teaching records. It makes no live-execution or comprehensive-coverage claim. A future executed search needs platform, query, fields, filters, dates and exports. R06 is an observed-outcome scope mismatch; R09 is an access gap. Every action is evidenced or labelled proposed.
Try it yourself · Activity 06
20 minutesChapter 3 review questions
Answer in your own words before checking the worked explanations.
- How could saving distort a query?
- Can retrieving R07 still be useful?
- What makes an execution log inspectable?
- Why is fixture recall not comprehensive recall?
- How do access failure and scope exclusion differ?
- How should a revised query be recorded?
Which distinction would most change the way you review a real source?
Worked answer
1. It may miss unfavourable or neutral findings. 2. Broad retrieval can be followed by valid population screening. 3. Preserve source, exact query, fields, filters, date, operator and export. 4. The fixture does not identify all relevant real literature. 5. One is missing information; the other applies an evidenced criterion. 6. Keep the original execution and record the amendment, reason and new results.
Apply what you learned · Practice
Explanation and answer
The actual source, query, date, filters and amendments. Record the operational search details and limits; retrieval relevance is not complete coverage.
Practice only. This does not count towards your exam or certificate.
Learn in your browser · Chapter 04 of 08
Resolve reference identity, versions and provenance
A real reference can fail to support a claim, and several references can describe the same study. Establish identity, relationships and version status before treating a collection as independent evidence. Preserve corrections and uncertainty instead of simplifying them away.
A citation record is a catalogue or search entry; a source document is an inspectable report or separate correction; a study is the underlying investigation. One study can have multiple documents and one document can have multiple catalogue entries. These entity distinctions prevent a long bibliography from masquerading as a large independent evidence base. The fixture uses R identifiers and records their relationships explicitly.
R02 duplicates the R01 LED report entry, and R12 duplicates R04 HVAC metadata. Removing these catalogue duplicates leaves ten unique citation candidates from twelve incoming records. Preserve links to the removed entries and original search routes. Similar titles are not enough to merge records: verify that they identify the same source document.
Records, documents and studies
Two duplicate catalogue records are removed. A separate correction is linked to its study, not counted as another experiment.
Scroll the diagram sideways, or read every step and relationship below. Keyboard: focus the diagram, then use the Left and Right arrow keys.
- R02 catalogue record: Duplicate of the R01 document.
- R01 LED report: One document about the LED study.
- R03 sensor report: Original estimate superseded.
- R11 correction: Current corrected sensor result.
- One sensor study: Read the linked documents together.
- R02 catalogue record to R01 LED report: Duplicate identity
- R03 sensor report to One sensor study: Original report
- R11 correction to One sensor study: Correction to the same investigation
R03 and R11 need different treatment. R11 is a separate correction document about the sensor study reported in R03. Keep both documents linked to one study ID. The current estimate is 4 percent with an interval from -2 to 10 percent; the original 12 percent result is superseded. Unchanged methods can remain contextual material read alongside the correction. No interval type or confidence level should be invented when the fixture does not state it.
The ten candidates partition into five retained source documents, two scope exclusions and three other dispositions. Retained documents are R01, R03, R04, R05 and R11, representing LED, sensor, HVAC and behaviour studies. R06 is the excluded simulation and R07 the excluded school-population report. R08 is permission-held, R09 has no retrieved full report and R10 has an unverified reference. These are not ten verified publications or three identical holds.
Compare title, authors, venue, date, identifier and source location when checking identity. A genuinely available DOI can help; never invent a plausible DOI to fill a blank. Crossref exposes deposited scholarly metadata and some update relationships. A match aids identification but does not establish that a passage supports a claim. A missing match does not prove fabrication because coverage and matching have limits.
The instructor key deliberately identifies R10 as an invented reference. A learner encountering the metadata should record the unverified state and seek the missing publication, not manufacture a convincing abstract. R09 is different: the fixture provides candidate metadata but no full report. Outside this exercise, one failed lookup establishes neither existence nor fabrication. Record the enquiries performed and the remaining uncertainty.
Provenance connects a statement to the actual material reviewed. Record source ID, version, retrieval details, passage locator and permitted transformation. Keep authorised original bytes separate from extracted text. A file hash can detect a byte change against a recorded reference, but cannot establish authorship, truth or semantic support. A valid locator still requires reading the passage and comparing it with the claim.
R04 illustrates distinctions inside a document: energy falls from 80 to 68 MWh, while the weather-adjusted estimate is 2 percent with interval -3 to 7 percent. Raw and adjusted values answer different questions, not two independent studies. Preserve labels so extraction does not choose the larger value merely because it sounds impressive.
An average cleaning prompt asks to remove duplicates and keep strongest results. An elite prompt proposes record-to-document and document-to-study links, distinguishes duplicates from corrections, identifies current result status and exposes uncertain matches. A researcher approves the links using source evidence. Log old wording, replacement and affected outputs when a correction changes a claim.
Try it yourself · Activity 07
40 minutesReconcile the twelve-record collection
Build a relationship map and count reconciliation before synthesis.
- Link R02 to R01 and R12 to R04 as catalogue duplicates.
- Link R03 and R11 to one sensor study with distinct result status.
- List five retained documents and four included study IDs.
- Separate two scope exclusions and the three other dispositions.
- Write the corrected sensor statement without inventing interval type.
- State what metadata and hash matches cannot prove.
Where could a reference manager hide a correction or inflate the study count?
Worked answer
The account is 12 incoming records, 10 unique citation candidates, five retained documents representing four studies, two scope exclusions and one each permission-held, full-report-not-retrieved and reference-unverified. Use corrected sensor 4 percent with interval -2 to 10; retain 12 percent only as superseded history. Identity and integrity do not establish claim support.
Try it yourself · Activity 08
20 minutesChapter 4 review questions
Answer in your own words before checking the worked explanations.
- Why remove R02 and R12?
- Why retain R03 and R11 together?
- How can five documents mean four studies?
- How do R09 and R10 differ?
- Why can a valid DOI fail to support a number?
- What happens to a draft using the old sensor result?
Which distinction would most change the way you review a real source?
Worked answer
1. They duplicate catalogue entries. 2. The correction and original concern one investigation. 3. One sensor study has two documents. 4. R09 lacks full-text access; R10 is unverified to the learner and deliberately invented in the instructor key. 5. Identity does not establish the passage or reasoning. 6. Recheck affected claims, use the correction and preserve the revision history.
Apply what you learned · Practice
Explanation and answer
Two documents linked to one sensor study, with the corrected result used. A correction is a distinct source document about the same underlying investigation.
Practice only. This does not count towards your exam or certificate.
Learn in your browser · Chapter 05 of 08
Screen consistently and preserve unresolved evidence
Screening applies the review question to candidate evidence. It should not reward favourable results, familiar authors or fluent summaries. An unresolved candidate remains visible until a documented decision can be made.
Scope requires a university setting, an energy intervention and observed rather than solely simulated outcomes. Inclusion in the inspectable synthesis also requires sufficient permitted source material. Missing access or permission leaves a candidate unresolved; it does not establish an out-of-scope study. The review question concerns what these supplied reports show and what they cannot establish. It does not ask which technology should be purchased. Register these conditions before seeing whether the reported change is attractive.
Do not silently turn missing information into a negative answer. R09 has metadata but no supplied full report. That is not the same as an inspected report outside scope. R10 is an invented reference in the exercise, with no supplied publication. In real research, failure to find a reference through one service would not prove fabrication. Record the searches and request the source before judging its status. Here the fixture explicitly supplies its invented status.
Disposition of the supplied fictional collection
12 incoming records minus 2 duplicate catalogue entries leaves 10 candidates: 5 retained documents, 2 scope exclusions and 3 other dispositions. Retained documents represent 4 studies.
Scroll the diagram sideways, or read every step and relationship below. Keyboard: focus the diagram, then use the Left and Right arrow keys.
- 12 incoming records: R01 through R12.
- 10 citation candidates: Remove R02 and R12 as duplicates.
- 5 retained documents: R01, R03, R04, R05, R11; 4 study IDs.
- 2 scope exclusions: R06 simulation and R07 school population.
- 3 other dispositions: R08 permission-held; R09 not retrieved; R10 unverified.
- 12 incoming records to 10 citation candidates: Remove 2 duplicates
- 10 citation candidates to 5 retained documents: Retain with version links
- 10 citation candidates to 2 scope exclusions: Apply declared criteria
- 10 citation candidates to 3 other dispositions: Preserve unresolved status
Use a staged decision record: candidate ID, stage, applicable criterion, evidence locator, proposed outcome, reviewer, date and unresolved question. Titles can support a provisional decision, but an abstract may not reveal the denominator, setting or design needed for final inclusion. A model can propose a classification from permitted text. A researcher checks the actual passage and records the decision. The model must be allowed to say that the available text is insufficient.
Scroll sideways to see every column.
| Candidate or linked version | Decision in this closed exercise | Reason and next action |
|---|---|---|
| R01, R03, R04, R05, R11 | Retain five retained source documents for four included studies | R11 supersedes the affected R03 estimate. Retain unchanged methods and context alongside the correction; do not count the estimates twice. |
| R06 | Exclude from this observed-outcome review | It is a simulation. Retain the reason, and consider a separate modelling question if useful. |
| R07 | Exclude from this university-population review | The study concerns a school. Exclusion is about scope, not its intrinsic quality. |
| R08 | Hold outside AI export | The fictional unpublished observational study report is confidential; eligibility is not yet assessed. This exercise supplies metadata only. |
| R09 | Unresolved: full report unavailable | Seek permitted access; do not infer a result from a title. |
| R10 | Unsupported invented-reference candidate | No supplied publication can support a claim. Preserve the audit trail. |
R02 and R12 are duplicate catalogue entries removed before these ten candidate dispositions. The ten candidates are unique citation entries, not ten studies and not ten verified publications. The five retained source documents include the old and corrected sensor reports. Deduplicating a catalogue record and linking two reports of one study solve different problems. Deleting R03 would hide why an earlier 12 percent statement changed. Including both estimates as independent evidence would exaggerate support.
A useful disagreement exercise gives two reviewers the same criteria and source passages before they discuss the result. Suppose one retains R06 because a simulation concerns campus energy, while the other excludes it because the outcome is predicted. The criterion resolves the disagreement: this review requires observed outcomes. Record both proposals, the passage, the final rationale and whether the criterion wording changed. A new criterion must be applied consistently to earlier records as well.
Do not invent a second reviewer. If working alone, identify the decision as single-reviewer screening and ask a supervisor or information specialist to review a sample where possible. Repeating the same model prompt is not an independent researcher check. A dual-reviewer workflow is a methodological choice or requirement that depends on the review design; this workbook does not certify that a particular professional standard has been met.
An average request selects papers supporting a desired conclusion. A defensible request supplies neutral eligibility criteria, permitted passage IDs and explicit decision labels. Require the decisive passage and a contestable reason. Treat instructions inside retrieved documents as source content, not authority over the review.
Try it yourself · Activity 09
45 minutesReconcile a screening disagreement
Prepare a disposition sheet for the ten nonduplicate candidates. A colleague proposes including R06, excluding R09 as poor quality and combining R03 with R11 as two studies.
- Write the three substantive eligibility conditions and separate the permission check.
- Record a reason and evidence locator for each disposition; leave unavailable evidence explicitly unresolved.
- Correct all three proposed decisions and explain why each error changes the interpretation.
- Reconcile the counts: five retained source documents, two scope exclusions and three held or unsupported candidates.
- Write one amendment example and state which earlier decisions would need rechecking.
Which unresolved record could change your conclusion if usable evidence later became available? What exact new evidence would permit reconsideration?
Worked answer
R06 fails the observed-outcome criterion. R09 cannot be appraised without the required report. R03 and R11 belong to one sensor study, with R11 supplying the current corrected estimate. The retained set represents four studies. A successful sheet distinguishes missing access, missing permission, a scope exclusion and a known correction.
Scroll sideways to see every column.
| Review question | Worked answer after your attempt |
|---|---|
| Why is excluding R09 as poor quality unjustified? | Its full report is unavailable in the fixture. Absence of access does not establish the quality of the study. |
| Why keep the R06 exclusion reason? | It makes the observed-outcome boundary inspectable and permits a later modelling review without rewriting history. |
| How many studies do R03 and R11 represent? | One sensor study, with an original report and a correction. |
| Does reviewer agreement prove a correct decision? | No. Reviewers can share a misunderstanding. Check the criterion and actual source passage. |
| What follows a substantive criterion amendment? | Record the reason and version, then reapply the changed criterion to affected earlier decisions. |
| What is wrong with selecting only positive results? | The selection depends on the desired conclusion and hides evidence that could contradict it. |
Apply what you learned · Practice
Explanation and answer
The required full report has not been retrieved. Missing access does not establish the unseen methods or results.
Practice only. This does not count towards your exam or certificate.
Learn in your browser · Chapter 06 of 08
Extract traceable claims, units and denominators
Extraction creates a checked bridge between source material and the statements you may write. A genuine reference is only the first step. The passage, measurement, comparison and uncertainty must support the particular claim.
Use an extraction row for one result, not an entire paper summary. Record study ID, report version, source locator, the relevant text, population, intervention, comparison, outcome, unit, time window, denominator, estimate, uncertainty and limitations. Keep direct source values separate from calculations you perform. A missing field stays missing. A model that fills an absent confidence interval or study date has invented evidence even if the rest of the row looks plausible.
For R01, the supplied fictional report records 120 MWh before and 90 MWh after a library LED change. The arithmetic difference is 30 MWh and the relative reduction is (120 - 90) / 120 = 25 percent. This is a before-and-after observation without a control group. Write that energy use was lower in the observed after period. Do not write that the LEDs caused a 25 percent reduction across universities. A correct calculation does not repair a weak comparison design.
From passage to reviewed claim
Each transition needs a different check. Byte integrity is not semantic support.
Scroll the diagram sideways, or read every step and relationship below. Keyboard: focus the diagram, then use the Left and Right arrow keys.
- Source passage: Verify identity, version and permitted access.
- Extracted value: Preserve unit, denominator and uncertainty.
- Derived calculation: Show the formula and rounding.
- Reviewed claim: Check inference and record human judgement.
- Source passage to Extracted value: Match the actual passage
- Extracted value to Derived calculation: Recompute independently
- Derived calculation to Reviewed claim: Do not upgrade observation to causation
For R04, raw HVAC use changes from 80 to 68 MWh, a 15 percent reduction. The same fictional report gives a weather-adjusted estimated reduction of 2 percent with an interval from -3 to 7 percent. Preserve both quantities and their labels. The interval includes no reduction and possible increased use. Do not substitute the larger raw change when discussing the adjusted estimate. Nor does an interval spanning zero prove that the true effect is exactly zero.
Scroll sideways to see every column.
| R05 behaviour campaign quantity | Calculation | Interpretation |
|---|---|---|
| Total energy change | (210 - 200) / 200 × 100 = +5% | Total use increased in the reported periods. |
| Before energy per user | 200,000 kWh / 500 = 400 kWh per user | Convert MWh to kWh before division. |
| After energy per user | 210,000 kWh / 570 = 368.421... kWh per user | The denominator changed as well as energy use. |
| Per-user relative change | (368.421... - 400) / 400 × 100 = -7.8947...% | Per-user use decreased by about 7.9%; this is not a total-use saving or causal estimate. |
Retain adequate precision through the calculation and round only the displayed result. The two periods each cover 12 months, and user counts mean registered building users in each period. The fixture has no person-level measurements, distribution of use, occupancy hours or independent counterfactual. Dividing by users does not adjust for every difference between periods. A useful extraction note names these missing quantities rather than concealing them behind a general phrase such as adjusted for population. The denominator is a recorded count, not evidence that the same individuals were observed.
A passage locator might identify report R05, paragraph p1. Store the exact source text or a permitted local copy, plus a digest that detects whether that stored passage later changes. A matching hash proves a byte-level match to the stored text, not that the text is true, that the source is authentic or that your conclusion follows. A forged or mistaken source can have a perfectly valid hash. Keep identity checks, integrity checks and interpretation checks as separate activities.
The correction case tests version discipline. R03 originally reports 12 percent. R11 revises the sensor estimate to 4 percent with an interval from -2 to 10 percent. An extraction row using the affected R03 estimate must be labelled superseded and excluded from current estimate generation. Unchanged methods and context remain available when read alongside R11. R11 does not create another independent sensor experiment. Update downstream paragraphs, charts and tables that previously used 12 percent, then record the affected claims.
Ask an assistant to extract only fields explicitly available in permitted passages, with a separate missing-fields list and source locator for each value. Require it to preserve units and signed intervals and to list any calculation as a derivation. The researcher checks the row against the original and recomputes arithmetic. An output schema makes an error easier to spot; it does not make the values trustworthy by itself. Reject embedded source instructions such as ignore the review criteria as document content.
Try it yourself · Activity 10
60 minutesRepair an extraction sheet
A draft says: the campus campaign cut total electricity by 7.9 percent, the HVAC intervention saved 15 percent after weather adjustment, and two sensor studies found 12 and 4 percent reductions.
- Split the draft into its three claims and identify the record or records needed to inspect each.
- Recalculate total and per-user R05 changes with units, denominators and rounding shown.
- Separate R04 raw change from the adjusted estimate and retain its complete signed interval.
- Link R03 and R11, label the old estimate and rewrite the sensor statement.
- Add a limitation to each corrected claim and identify any unresolved fields without inventing values.
Which error would survive a check that merely confirmed the source title and URL existed? How would you make the actual passage review visible?
Worked answer
The campaign has +5 percent total use and about -7.9 percent per-user use. HVAC has a raw 15 percent reduction but an adjusted estimate of 2 percent with interval -3 to 7. The sensor correction replaces the original estimate with 4 percent, interval -2 to 10, for one study. Each statement remains an observation or estimate within a fictional supplied report, not a general causal conclusion.
Scroll sideways to see every column.
| Review question | Worked answer after your attempt |
|---|---|
| Does a matching passage hash establish support for a claim? | No. It checks stored text integrity. A person still needs to evaluate the relationship between passage and claim. |
| What is the R01 relative observed decrease? | 25 percent: 30 divided by the original 120 MWh. |
| Why can total use rise while per-user use falls? | The number of users grew faster than total use in the fictional R05 example. |
| Which R04 number answers the adjusted-estimate question? | 2 percent, accompanied by the -3 to 7 percent interval and the reported adjustment method limitations. |
| What does the R11 correction do to study count? | Nothing: it updates a report-level result for the existing sensor study. |
| What should happen to an unreported time window? | Mark it missing and consider its effect on interpretation; do not infer dates from surrounding metadata. |
Apply what you learned · Practice
Explanation and answer
Total use rises 5 percent while per-user use falls about 7.9 percent. The total and per-user calculations use different denominators; neither establishes causation.
Practice only. This does not count towards your exam or certificate.
Learn in your browser · Chapter 07 of 08
Synthesize differences without manufacturing certainty
Synthesis explains patterns and disagreements across eligible evidence. It is not a vote for the largest number, a collage of summaries or an average of incomparable results. The strength of the conclusion must match the available designs and measurements.
Create an evidence map before a prose conclusion. Give each included study one row and keep linked report versions beneath it. Compare setting, intervention, design, outcome definition, denominator, adjustment, uncertainty, access limitations and plausible alternative explanations. An evidence map is not automatically a risk-of-bias assessment. If your actual review requires a design-specific appraisal tool, use its current instructions and obtain appropriate methodological support. Do not invent a universal confidence score.
The four included fictional studies concern LED lighting, sensors, HVAC and a behaviour campaign. Their numeric outputs address different quantities. A mean of 25, 4, 2 and 7.9 percent would mix a raw before-and-after change, corrected and adjusted estimates, and a per-user calculation. It would also conceal the campaign total-use increase. The arithmetic mean can be computed, but it has no justified common interpretation in this exercise. A polished chart would not solve that problem.
R05 totals and per-user quantities
Two comparable 12-month periods use registered building-user counts. Users need not be the same individuals in both periods.
Scroll the diagram sideways, or read every step and relationship below. Keyboard: focus the diagram, then use the Left and Right arrow keys.
- Before: 200 MWh and 500 users.
- After: 210 MWh and 570 users.
- Total use: Rises 5 percent.
- Use per user: Falls from 400 to 368.42 kWh, about 7.9 percent.
- Before to Total use: Compare total energy
- After to Total use: Compare total energy
- Before to Use per user: Convert and divide
- After to Use per user: Convert and divide
Scroll sideways to see every column.
| Synthesis layer | Defensible observation | Unsupported upgrade |
|---|---|---|
| Study-specific observation | The fictional library report records lower use after an LED change. | LEDs will save every university 25 percent. |
| Corrected estimate | The sensor estimate is 4 percent with an interval spanning no change. | Sensors definitely save 4 percent. |
| Contrasting outcome definitions | The campaign total rose while per-user use fell. | The campaign was a success because one chosen metric improved. |
| Review-level conclusion | These supplied reports illustrate heterogeneous observations and important uncertainties. | All campus energy interventions work and should be procured. |
Distinguish absence of evidence from evidence of absence. R09 contributes no inspectable full report here, so it cannot settle the question. R11 supplies an uncertain estimate; its interval crosses no change but is not a proof of zero effect. R06 is an excluded prediction under this question, not evidence that simulations are useless. R07 concerns another population. Each difference deserves a precise description. Calling all four cases negative findings would erase their meanings.
A contradiction register makes uncertainty actionable. For each apparent disagreement, ask whether the population, intervention, comparator, outcome, time window or analysis differs. The R05 total and per-user directions are not a logical contradiction: their denominators differ. R03 and R11 are not competing independent experiments: one is corrected. R04 raw and adjusted changes answer different statistical questions. Resolve the relationship before proposing a causal explanation.
A research assistant can propose a synthesis matrix or identify sentences that need support. Give it the checked extraction rows, not a heap of unreviewed documents, and ask it to preserve disagreements, missing fields and version status. Require claim IDs and study IDs in its output. A researcher must check whether the generated comparison silently drops an unfavourable outcome or converts may into will. Record that a fluent unsupported sentence was removed rather than repairing it with an unrelated citation.
The offline exercise deliberately allows a dangerous example: a claim that LED changes caused the observed reduction is attached to the correct R01 passage with a matching hash. Its links can pass structural checks while the causal interpretation remains unsupported. The program must continue to require human semantic review. Even a recorded approval is a record of somebody saying yes, not independent proof that they read or understood the evidence. Approval records support accountability; they do not replace judgement.
For a real decision, separate the evidence conclusion from the decision recommendation. A facilities manager may choose to commission a small monitored pilot despite uncertainty. That recommendation needs local costs, operational requirements, permissions, risk, measurement plans and stop conditions outside this literature exercise. State which evidence gaps the pilot would address and which it would not. Do not sell a sovereign deployment, a particular model or a Mickai service as proof of correct scientific interpretation.
Try it yourself · Activity 11
60 minutesWrite a defensible synthesis
Produce a 300-word structured conclusion for the fictional campus collection and a separate decision note. The sponsor asks for a single headline savings percentage.
- Make a four-study matrix that includes every reported outcome needed to explain the apparent disagreements.
- Write one supported sentence for each study, naming the comparison and its principal limitation.
- Explain why a pooled headline percentage is not justified by this collection.
- List R08, R09 and R10 as held or unsupported candidates without treating them as negative results.
- Propose one bounded next research action with a measurement plan; distinguish it from a procurement recommendation.
Which wording in your conclusion carries the greatest certainty? Point to the design and measurement that justify that wording, or revise it.
Worked answer
A successful synthesis retains R05 total and per-user directions, uses corrected R11 rather than double counting R03, distinguishes raw and adjusted R04 results, and limits R01 to its uncontrolled observation. It makes no claim of a complete literature search. The decision note explains what additional local evidence would be needed.
Scroll sideways to see every column.
| Review question | Worked answer after your attempt |
|---|---|
| Why not average the four percentage figures? | They represent different outcomes, denominators and analyses, so the proposed average lacks a justified common interpretation. |
| Are R05 total and per-user changes contradictory? | No. The denominator changes; both calculations can be correct at the same time. |
| What is the difference between a report correction and replication? | A correction updates the same underlying study. Replication is a distinct investigation with its own methods and evidence. |
| Can a structurally valid citation support an invalid conclusion? | Yes. A genuine correctly located passage may not support the attached causal or generalised claim. |
| Does an interval spanning zero prove no effect? | No. It expresses uncertainty compatible with multiple effects under the analysis, including no change. |
| Why separate a pilot proposal from the review conclusion? | The proposal adds local aims, constraints and decisions that are not established by the supplied literature alone. |
Apply what you learned · Practice
Explanation and answer
Human interpretation is still required and the causal claim needs revision. Structural linkage checks do not establish whether the passage supports the inference.
Practice only. This does not count towards your exam or certificate.
Learn in your browser · Chapter 08 of 08
Deliver an auditable review and defend its limits
Your final product is an inspectable reasoning chain from question to conclusion. The capstone rewards honest limitations, correction handling and reproducibility. It does not reward confident wording, a high reference count or the mere presence of AI.
Assemble the review contract, permission decisions, search log, deduplication map, screening register, linked report versions, checked extraction rows, evidence map, claim ledger, correction log and final narrative. A reader should be able to start at one important sentence and find the permitted source, relevant passage, comparison and reviewer decision. Keep confidential material outside a shareable package. Include a manifest of file names, versions and hashes where appropriate, with the meaning of those hashes clearly limited.
A claim ledger contains the claim as written, its type, study and report IDs, exact locator, source version, derivation if any, inference limit, reviewer decision and date. Label background context separately from results and recommendations. If a sentence contains three substantive claims, one citation at its end may not support all three. Split the sentence or map each claim explicitly. A register is useful only if its entries describe actual checks rather than a copied statement that everything was verified.
Propagate a correction
A changed source prompts a review of dependent claims. Preserve the history instead of silently overwriting it.
Scroll the diagram sideways, or read every step and relationship below. Keyboard: focus the diagram, then use the Left and Right arrow keys.
- New source version: Authenticate the correction and its scope.
- Affected claims: Locate extraction rows, charts and narrative.
- Revised synthesis: Recalculate and update dependent statements.
- Recorded review: Check the revision and disclose material changes.
- New source version to Affected claims: Trace dependencies
- Affected claims to Revised synthesis: Repair the actual claims
- Revised synthesis to Recorded review: Record what was checked
Write a methods section that names the review type and the closed fictional collection. State that this is a structured critical narrative exercise, not a comprehensive search of the campus-energy literature. Describe the eligibility decisions, candidate counts and correction linkage using their actual units. Report whether screening and extraction were checked by one person or more. State what the optional program checks and what it cannot evaluate. Do not convert a software test result into a methodological-quality rating.
Disclose substantive AI assistance according to the actual institution, journal and funder requirements. A useful teaching disclosure says which tool and version were available, when it was used, the bounded tasks it assisted, the permitted inputs, and how its outputs were checked and changed. If you used no model, say so. Do not invent a model transcript, tool version or independent review. The responsible named author remains accountable for the work; a tool cannot accept authorship responsibilities.
Sovereignty concerns practical control over sources, access, processing, retention and decisions. In a research workspace, separate private source storage from the shareable review, restrict retrieval by project permission, record exports and allow correction or withdrawal to propagate. Locally hosted AI may change data movement but does not automatically grant copyright permissions or remove confidentiality obligations. Mickai can help design controlled knowledge workflows and digitisation processes; the review still needs qualified human interpretation and an institution-specific approval route.
Scroll sideways to see every column.
| Capstone component | Evidence required | Reason to revise |
|---|---|---|
| Question and scope | Explicit review type, eligibility and closed-collection limit | Claiming a complete systematic search without performing one |
| Source handling | Permission register, duplicate map and R03/R11 linkage | Uploading R08 or counting the correction as another study |
| Extraction and synthesis | Correct units, four-study map, signed intervals and R05 calculations | Cherry-picking outcomes or presenting an unjustified pooled percentage |
| Traceability | Claim-level locators and actual review decisions | Treating matching hashes or self-declared approvals as semantic proof |
| Delivery | Methods, limitations, disclosure, correction procedure and accessible text | Hiding missing reports or publishing real confidential material |
Test a correction drill before delivery. Imagine that a second fictional correction changes a permitted source passage. Do not overwrite the old passage silently. Register the new version, identify affected extraction rows and claims, recalculate relevant figures, revise the narrative and record who approved the change. A hash mismatch helps locate a changed input. It does not decide whether the new version is authoritative. That judgement requires source and version verification.
The optional code route and paper route use the same synthetic records. The program provides structural feedback and arithmetic checks without contacting a model or external service. The paper route asks you to trace the same records, compare versions and explain each disposition. Neither route certifies semantic correctness. Submit a short oral or written defence explaining one unsupported claim you removed, one uncertainty you retained and one limitation that additional searching might address.
Separate the knowledge exam from the capstone. The planned scored sitting draws 20 questions from a reviewed 40-question bank. Passing requires strictly above 80 percent: 16 correct is 80 percent and fails, while 17 correct is 85 percent and passes. Written chapter questions and the capstone are practice, not automatically assessed research competence. A named Mickai certificate records a passing knowledge result through the protected issuance system. It is not accreditation, a university award, professional registration or identity assurance.
Try it yourself · Activity 12
180 minutesComplete and challenge the review package
Prepare the complete fictional review package, a 1,200 to 1,600-word narrative, a claim ledger and a 10-minute defence. Work alone if necessary, but label the review arrangement honestly.
- Assemble the required registers and confirm the ten candidate dispositions and four included studies.
- Trace five substantive narrative claims to exact permitted passages; deliberately test one unsupported causal claim.
- Complete the R05 arithmetic and sensor correction drill without counting old and new estimates independently.
- Run the offline exercise or its paper equivalent and explain why a structural pass is insufficient.
- Apply the capstone criteria, record actual feedback and revise the most material weakness.
- Write the disclosure and limitations, then keep the draft private until source rights, artwork and publication checks are complete.
If a reader challenged your most important conclusion, could you reproduce its source, calculation and scope without asking the model to generate the answer again?
Worked answer
Completion requires a coherent auditable package, not a claim that every criterion has been professionally assessed. The narrative must retain the four distinct study contexts, corrected version, uncertain estimates, unresolved candidates and closed-search limitation. Record missing external review as a limitation. Do not manufacture reviewer names or approval evidence.
Scroll sideways to see every column.
| Review question | Worked answer after your attempt |
|---|---|
| What must a useful claim ledger connect? | The exact claim to its source version and passage, derivation, inference limits and an actual recorded review decision. |
| Why preserve an old version after a correction? | It documents the change and helps identify previously issued claims needing revision. |
| What should a single-author disclosure say about review? | State the checks actually performed and that there was no independent reviewer when none participated. |
| Does local model hosting settle permission to process a paper? | No. Source rights, confidentiality, institutional rules and the particular processing operation still need review. |
| Is 16 out of 20 sufficient for the knowledge certificate? | No. Exactly 80 percent fails; strictly above 80 percent is required. |
| Does the certificate establish research competence or accreditation? | No. It records the course knowledge result and named issuance, with no such broader assurance. |
Apply what you learned · Practice
Explanation and answer
The stated knowledge result, not accreditation or research competence. Recorded named issuance and the broader assurances are separate.
Practice only. This does not count towards your exam or certificate.
Keep learning
The complete workbook
Eight substantial chapters develop an auditable critical narrative review. Practise search documentation, source permissions, citation identity, screening, extraction, synthesis and correction handling. Eight diagrams, chapter exercises, answered review questions and an offline synthetic evidence auditor support browser and paper learning. A mapped knowledge exam is separate from the ungraded research capstone.
- 01Define the question, review type and research contractRead here · 2 exercises
A defensible review begins with a question and a declared method, not a fluent summary. Decide what you are trying to learn, which evidence could answer it and what the available collection cannot establish. AI assistance must operate within those decisions rather than quietly making them.
- 02Establish permission before processing research materialRead here · 2 exercises
Being able to read a document does not automatically authorise uploading it to an AI service. Permission depends on the material, role, institution, funder, publication and actual tool arrangement. Check those boundaries before preparing a model input.
- 03Make searches reproducible and their limits visibleRead here · 2 exercises
Retrieving plausible references is not the same as searching an evidence field defensibly. A useful record explains what was attempted, retrieved and potentially missed. AI can propose search ideas, but it must not invent a search history.
- 04Resolve reference identity, versions and provenanceRead here · 2 exercises
A real reference can fail to support a claim, and several references can describe the same study. Establish identity, relationships and version status before treating a collection as independent evidence. Preserve corrections and uncertainty instead of simplifying them away.
- 05Screen consistently and preserve unresolved evidenceRead here · 1 exercise
Screening applies the review question to candidate evidence. It should not reward favourable results, familiar authors or fluent summaries. An unresolved candidate remains visible until a documented decision can be made.
- 06Extract traceable claims, units and denominatorsRead here · 1 exercise
Extraction creates a checked bridge between source material and the statements you may write. A genuine reference is only the first step. The passage, measurement, comparison and uncertainty must support the particular claim.
- 07Synthesize differences without manufacturing certaintyRead here · 1 exercise
Synthesis explains patterns and disagreements across eligible evidence. It is not a vote for the largest number, a collage of summaries or an average of incomparable results. The strength of the conclusion must match the available designs and measurements.
- 08Deliver an auditable review and defend its limitsRead here · 1 exercise
Your final product is an inspectable reasoning chain from question to conclusion. The capstone rewards honest limitations, correction handling and reproducibility. It does not reward confident wording, a high reference count or the mere presence of AI.
Also inside: a 10-point checklist, a glossary of 12 terms and 12 questions and answers to test yourself. 12 hands-on exercises, each with a worked answer at the back where the workbook gives one.
The PDF is free. We ask for your name and email before downloading. Read the privacy notice at the download form. Free to download and use for personal learning, study groups and inside your own team. Please do not resell the workbooks or republish them as your own. Link people to trust-agent.ai instead.
Get your free PDF workbook
Enter your name and email, then download the complete workbook. This form also works without JavaScript.
Test yourself
Questions and answers
Can AI help write my literature review?
It can assist permitted tasks such as proposing search concepts or structuring checked extraction rows. You remain responsible for the sources, interpretation, originality and disclosure. This course uses a fictional collection and does not replace supervision.
Is this a systematic review course?
It teaches important review distinctions and traceability methods. The capstone is a structured critical narrative review of a supplied collection, not a comprehensive systematic search. Real systematic and scoping reviews need methods appropriate to their question and discipline.
Does retrieval-augmented generation make a search systematic?
No. Relevant retrieved passages do not establish complete source coverage, reproducible queries, defensible eligibility or appraisal. Record what was searched and what may have been missed.
Does a real DOI mean an AI claim is correct?
No. Confirm identity and version, then read the relevant passage and check whether its methods and results support the particular statement. A metadata match is not semantic validation.
What should I do if a cited paper cannot be found?
Record the searches, inspect alternative metadata and request the source. Keep it unresolved rather than inventing a publication or treating a failed lookup as proof of fabrication.
Should corrected papers be discarded?
Inspect what changed and link the correction to the original. Supersede affected results and repair dependent claims while retaining useful provenance and valid contextual material.
Can I fill missing full-text details from a summary?
Do not reconstruct unseen methods or results. Identify the limited source, preserve missing fields and keep full-text retrieval gaps visible.
May I upload any open-access paper to an AI service?
Check the actual licence and the specific operation, plus institutional rules, confidentiality, contracts and tool terms. Read access and an open-access label alone do not settle every processing permission.
Do UKRI and NIH rules govern every university literature review?
No. The cited policies have specific application, assessment and peer-review scopes. Select the applicable institution, funder, journal, jurisdiction and activity rather than treating one policy as universal law.
How can energy use rise while use per person falls?
The denominator can increase faster than the total. In the fictional example, 200 to 210 MWh is a 5 percent total rise while 500 to 570 registered users produces about a 7.9 percent per-user decrease. Neither proves causation.
Why are there five retained documents but only four studies?
The original sensor report and its separate correction concern one investigation. Link them and use the corrected result without inflating the independent study count.
What does the audit script or certificate verify?
The script checks only its declared structural and numerical rules. The named certificate records a passing knowledge exam requiring strictly above 80 percent. Neither establishes semantic truth, research competence, identity assurance, ethics approval or accreditation.
Write as you go
My notes
Use this scratchpad for your own notes, working or answers as you read. Notes are saved in this browser on this device. Downloading makes a local copy; it does not send your notes to Mickai.
Learn → Practise → Demonstrate
Ready to put it into practice?
Take the scored exam when you feel ready. You do not need to download the workbook first. A score strictly above 80% earns a named, dated Mickai certificate with a verification page.
Take the official examYour name and email are collected at exam start. Certificates record an assessment result, not an accredited qualification or verified identity.
Learn the language
Key terms
- Citation record
- A catalogue or search entry describing a source, potentially duplicating another entry.
- Source document
- An inspectable report or separate correction, distinct from its catalogue records.
- Study
- An underlying investigation that may have several associated documents.
- Eligibility criterion
- A prespecified condition used to decide whether evidence belongs in the review.
- Provenance
- The recorded origin, version and handling of information.
- Correction
- A source update whose effect on earlier claims must be inspected.
6 of the workbook's 12 terms. The complete glossary is in the workbook.
Follow the evidence
Sources and checks
Facts last checked: .
These workbooks use AI assistance. See how the workbooks are made.
- The PRISMA 2020 statementPage and colleagues, PLOS Medicine
- PRISMA extension for scoping reviewsPRISMA
- Cochrane Handbook, chapter 4: searching and selecting studiesCochrane
- Fabrication and errors in the bibliographic citations generated by ChatGPTWalters and Wilder, Scientific Reports
- REST API metadata documentationCrossref
- Living guidelines on responsible use of generative AI in research, fourth edition, October 2026European Commission and ERA Forum
- Generative AI application preparation and assessment policyUK Research and Innovation
- Use of generative AI in the NIH peer review processNational Institutes of Health
- Attribution 4.0 International licence summaryCreative Commons
- Policy for using generative AI in researchUniversity of Oxford
- Generative AI policies for journalsElsevier
Created by Micky Irons with the Mickai team. Published by Mickai LTD. Last updated 26 October 2026.
NextKeep going
Where to go next

Recommended for you
RAG and knowledge bases, step by step
Build a knowledge base a model can answer from: collect, clean, chunk, embed, retrieve, cite and evaluate, with security basics and a hands-on exercise using five short documents.

Recommended for you
Human-in-the-loop vs human-in-time: oversight before impact
Design AI oversight that acts before impact: distinguish presence from approval, bind decisions to actions, test safe stops and build a proportionate evidence dossier.

Recommended for you
AI governance: risk registers, evidence and human accountability
Govern an AI system without being an engineer: map hazards, score and evidence them, name owners and stop rights, make oversight real, and check the register with tested code.