📚 The Ilya 30u30 Deep Learning Compendium
A free comprehensive book based on the 30 papers and resources recommended by Ilya Sutskever for mastering Artificial Intelligence.
About This Book
This book transforms Ilya Sutskever’s legendary “30u30” reading list into an accessible, structured learning journey. Each chapter distills complex research papers into clear explanations with visual Mermaid diagrams.
Source: Based on Ilya’s 30u30 Reading List and Primers • Ilya Sutskever’s Top 30
What You’ll Find
Each chapter includes:
- 📖 Accessible explanations - Complex concepts made simple
- 📊 Mermaid diagrams - Visual representations of key ideas
- 🔢 Key equations - Essential formulas with intuitive explanations
- 🔗 Connections - Links between related papers and concepts
- 💡 Modern applications - How ideas are used today
- 📚 References - Original papers and further reading
Book Structure
| Part | Focus | Chapters |
|---|---|---|
| Part I | Foundations of Learning and Complexity | 1-5 |
| Part II | Convolutional Neural Networks | 6-10 |
| Part III | Sequence Models and Recurrent Networks | 11-14 |
| Part IV | Attention and Transformers | 15-17 |
| Part V | Advanced Architectures | 18-23 |
| Part VI | Scaling and Efficiency | 24-26 |
| Part VII | The Future of Intelligence | 27 |
Suggested Reading Paths
🎯 Standard Path (Recommended)
Read chapters 1-27 in order for a complete journey from theory to practice.
⚡ Practitioner’s Path
If you want to build things quickly:
- Chapter 6 (AlexNet) → Chapter 8 (ResNet)
- Chapter 11-12 (RNNs/LSTMs)
- Chapter 15-17 (Attention/Transformers)
- Chapter 25 (Scaling Laws)
🧠 Theorist’s Path
If you love theory and foundations:
- Chapters 1-5 (Full Part I)
- Chapter 27 (Superintelligence)
- Then practical chapters as needed
🔬 Researcher’s Path
For cutting-edge architectures:
- Chapters 16-17 (Transformers)
- Chapters 18-23 (Advanced Architectures)
- Chapters 25-26 (Scaling)
License
Educational content based on public research papers. All original papers are cited with links to their sources.
Support This Project
If you find this book useful, please consider ⭐ starring the GitHub repository to help others discover it!