Infrastructure & Agents

What Is Activation Checkpointing?

Activation checkpointing is a technique that keeps only some activations in memory during training and recomputes the rest during backpropagation. It lowers memory use at the cost of extra computation.