Practice 1
Using the source Model B example, explain why adapters reduce training state and name one memory term they do not automatically remove.
Compare with a sample answer
The base weights are frozen, so they need no gradients or optimiser state. The adapters add far fewer trainable parameters, but activations still matter because gradients flow through the frozen layers. Checkpointing trades extra time for lower activation memory.
The source separates state savings from activation memory and describes checkpointing as a trade-off.