Pytorch

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Muhammad Tayyab

Nov 6

nanochat: Train Your Own GPT-2 Grade ChatGPT in About Two Hours

#opensource #llmtraining #machinelearning #pytorch

9 min read

Viswaretas Kotra

Nov 5

How many GPUs do you need to train an AI model?

#gpu #machinelearning #ai #pytorch

8 min read

b1ackjack12

Nov 4

Warmup Did Nothing for My Learning Rate — Then It Fully Rescued the Wrong One

#pytorch #machinelearning #deeplearning #hyperparameters

4 min read

b1ackjack12

Nov 4

My Gradient Clipping Was Never Clipping. It Was Secretly Multiplying My Weight Decay

#pytorch #machinelearning #deeplearning #hyperparameters

4 min read

Wesam Khallaf — Author of PyTorch From Ground Up

Nov 4

Saving and Loading Models in PyTorch: state_dict, Checkpoints and Resuming Training

#deeplearning #pytorch #beginners #machinelearning

13 min read

b1ackjack12

Nov 3

Weight Decay 0.05: Catastrophe in Adam, Optimum in AdamW

#pytorch #machinelearning #deeplearning #hyperparameters

4 min read

Distil

Nov 2

Distillation didn't help our small model until we took the labels away

#machinelearning #pytorch #nlp #tutorial

3 min read

Joinal Ahmed

Nov 1

Running Captum on Cloud TPUs with TorchTPU: a work log

#pytorch #tpu #machinelearning #performance

19 min read

xbill for Google Developer Experts

Nov 2

Gemma 4 in Rust on TorchTPU: Hands On With Colab

#rust #pytorch #tpu #gemma

9 min read

Shreya Boyane

Oct 29

TorchTitan's October update is out. I fixed 2 bugs in its quick-start script

#pytorch #python #opensource #machinelearning

6 min read

Georgii Kharlampiiev

Oct 28

Model soups failed until we fixed one line: our 26M grammar tagger from 11% to 1.9% false fixes

#machinelearning #nlp #ios #pytorch

3 min read

Soham Sharma

Oct 28

PyTorch Custom Dataset and DataLoader: getitem, len, collate_fn, and num_workers

#pytorch #python #deeplearning #datascience

9 min read

Dhruv Agrawal

Oct 28

How PyTorch Became the Socket Every AI Chip Plugs Into

#machinelearning #pytorch #python #performance

4 min read

Ivan Zdravkov

Oct 28

LoRA on a 16 GB card: what fits and what does not

#ai #pytorch #deeplearning #opensource

5 min read

Ivan Zdravkov

Oct 28

Blackwell quantisation on my own card

#ai #pytorch #deeplearning #research

5 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.