DEV Community

mayankpallai profile picture

mayankpallai

software engineer, ntusg graduate

Deep Dive into Mixture of Experts: From 1991 to DeepSeek-V3

Deep Dive into Mixture of Experts: From 1991 to DeepSeek-V3

Comments 1
11 min read
How LLMs Learned to Reason: SFT --> RLHF --> RLVR

How LLMs Learned to Reason: SFT --> RLHF --> RLVR

1
Comments 1
8 min read
Is Speculative Decoding's Speedup a Hardware Problem or a Model Problem?

Is Speculative Decoding's Speedup a Hardware Problem or a Model Problem?

Comments
9 min read
Building a Terminal Based LLM Inference Internals Explorer - Part 3: Speculative Decoding

Building a Terminal Based LLM Inference Internals Explorer - Part 3: Speculative Decoding

Comments
10 min read
Building a Terminal Based LLM Inference Internals Explorer - Part 2: Attention Sinks

Building a Terminal Based LLM Inference Internals Explorer - Part 2: Attention Sinks

1
Comments 1
8 min read
loading...