xbe.at

Topics / NLP and transformers

BERT and language models

32 notes.

Page 2 of 2

  1. Understanding Perplexity in Language Models with Python9 min

    Perplexity is a crucial metric in evaluating language models, measuring how well a model predicts a sample of text. Lower perplexity indicates better...

  2. Unified Multimodal Transformer Model in Python11 min

    The concept of a single transformer model capable of unifying multimodal understanding and generation has gained significant attention in recent years. This...