Language & LLMs

What Is BERT?

BERT, short for Bidirectional Encoder Representations from Transformers, is a language model that reads text in both directions to build deep contextual understanding. It is pretrained using masked language modeling and next-sentence prediction, then fine-tuned for tasks like classification and question answering. BERT is an encoder-only architecture.