Porting nanochat to a TPU: what carries over from PyTorch, and what breaks

2 comments

• sciences44 11 minutes ago
  Nice work. Regarding your first insight, that's a sneaky one ^^. I experiment a similar issue with fine-tuning a small model with MLX. It was very hard to find out.
• contentpulse 33 minutes ago
  [flagged]