Menu

Official website

//Our blog

Lunatech’s
engineer blog

Latest articles - attention mechanisms

Our most recent posts

author image

Luke Woodcock

26 May 2025

A Quest to Tame Large Language Models

llm ai attention mechanisms vector embeddings machine learning probabilistic text generation tokenization ai architecture natural language processing transformers bigram self-attention neural networks en nlp fundamentals context windows language understanding transformer architecture statistical language models language models n-gram

All blog posts - attention mechanisms

Our different categories

fr en java scala kotlin