AI Glossary
What is Attention?
Attention computes, for every token being generated, a weighted relevance score against every token in the context. This lets models connect a pronoun to its noun ten paragraphs back or a bug to a function defined in another file. It is the core operation of the transformer and its main computational cost.
News momentum
Mentions in recent AI news titles and summaries, refreshed from the ingestion stream.
109
-43 vs prior 7d
- I honestly haven't had time to pay attention to the Anthropic IPO today, because I still have to work hard at multiple jobs crafting words …
bluesky-ai · 8h
- Measured attention kernels vs. AMD's own on MI350X, with every loss published
hn-ai · 13h
- lmao so it's been brought to my attention that the aella internet defense force are gutless cowards in not mentioning me by name
no proble…
bluesky-ai · 15h
- A month after my investigation first detailed ChatGPT’s role in the massacre, OpenAI announced new safeguards to restrict content on mass s…
bluesky-ai · 16h