Attention

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Bharath Kadaluri

Apr 8

TurboQuant: How a Simple Spin Saves Gigabytes of GPU Memory

#turboquant #attention #transformers #llm

6 min read

Guatu

Apr 7

Attention Residuals: How Kimi Is Rethinking Transformer Depth

#ai #transformers #llmarchitecture #attention

3 min read

Valeria Solovyova

Apr 1

Replacing Dot-Product Attention with RBF-Attention: Technical and Computational Challenges and Solutions

#attention #rbf #memory #optimization

20 min read

Vedang Vatsa FRSA

Mar 27

Attention Refinery

#attention #socialmedia #psychology #tech

8 min read

Valeria Solovyova

Mar 5

Anonymous User Claims Proof of d^2 Complexity for Attention Mechanisms, Challenging Transformer Optimization

#transformers #attention #optimization #complexity

10 min read

Michael Kraft

Mar 3

Loot Systems and the Illusion of Progress

#gaming #psychology #neuroscience #attention

4 min read

Philip Hern

Apr 3

brain defrag: time away from screens (and from "one more" with ai)

#commentary #attention #rest #wellbeing

4 min read

Aditya Gupta

Mar 21

Identifying Early Warning Signs of Attention Mechanism Instability

#llm #warning #signs #attention

5 min read

Aditya Gupta

Mar 21

The Intricate Dance of Self-Attention: What Can Go Wrong?

#wrong #llm #attention #dance

5 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.

DEV Community

# attention

TurboQuant: How a Simple Spin Saves Gigabytes of GPU Memory

Attention Residuals: How Kimi Is Rethinking Transformer Depth

Replacing Dot-Product Attention with RBF-Attention: Technical and Computational Challenges and Solutions

Attention Refinery

Anonymous User Claims Proof of d^2 Complexity for Attention Mechanisms, Challenging Transformer Optimization

Loot Systems and the Illusion of Progress

brain defrag: time away from screens (and from "one more" with ai)

Identifying Early Warning Signs of Attention Mechanism Instability

The Intricate Dance of Self-Attention: What Can Go Wrong?