Which Loss Function Do LLMs use?
Exploring Cross-Entropy Loss in Large Language Models.
Posts with the tag llm
All TagsPost List
- $What do GPT-OSS and Gemma 3 really offer?What do GPT-OSS and Gemma 3 really offer?GPT-OSS and Gemma 3: two new small-but-powerful language models pushing the boundaries.
- $What are Positional Embeddings?What are Positional Embeddings?The mathematical technique that teaches AI models where each word sits in a sequence.
- $Words, Tokens and EmbeddingsWords, Tokens and EmbeddingsHow language models convert token IDs into meaningful vector representations that capture semantic relationships.
- $Subword Tokenization AlgorithmsSubword Tokenization AlgorithmsUnderstanding the algorithms behind tokenization in Large Language Models.
- $What is LLM Inference?What is LLM Inference?Understanding how Large Language Models generate text through the inference process.
