Understanding ML Numerical Formats
Understanding INT4, INT8, FP16, BF16, and TF32 formats in machine learning - their precision, speed, and memory trade-offs for training and inference.
Technical
RSS feedPosts in 2025
- $What do GPT-OSS and Gemma 3 really offer?What do GPT-OSS and Gemma 3 really offer?GPT-OSS and Gemma 3: two new small-but-powerful language models pushing the boundaries.
- $What are Positional Embeddings?What are Positional Embeddings?The mathematical technique that teaches AI models where each word sits in a sequence.
- $Words, Tokens and EmbeddingsWords, Tokens and EmbeddingsHow language models convert token IDs into meaningful vector representations that capture semantic relationships.
- $Subword Tokenization AlgorithmsSubword Tokenization AlgorithmsUnderstanding the algorithms behind tokenization in Large Language Models.
- $What is LLM Inference?What is LLM Inference?Understanding how Large Language Models generate text through the inference process.
- $CUDA Programming: An IntroductionCUDA Programming: An IntroductionGetting started with CUDA programming: Hello Threads
- $A Tale of Software RotA Tale of Software RotA fictional story about systematically eliminating duplication to prevent software rot in a growing engineering organization.
- $OAuth 2.0 Flows, Security and Best PracticesOAuth 2.0 Flows, Security and Best PracticesComprehensive OAuth 2.0 reference covering authorization flows, PKCE, token security, SPA patterns, and implementation best practices with detailed diagrams.
