Abdullah Şamil Güser

ML References

Various Topics

• The Annotated Transformer
• Precision & Recall
• Activation Functions in Neural Networks
• Understanding LSTM Networks - Colah’s Blog
• Fundamentals of Deep Learning – Introduction to Recurrent Neural Networks
• Attention? Attention! - Lil’Log Blog
• The Best Guide to Regularization in Machine Learning

Backpropagation

At the heart of backpropagation is an expression for the partial derivative ∂C/∂w of the cost function C with respect to any weight w (or bias b) in the network. The expression tells us how quickly the cost changes when we change the weights and biases.

• How the backpropagation algorithm works
• Backpropagation calculus : Chapter 4, Deep learning

Courses

• OpenAI Spinning Up
• HuggingFace DeepRL (and others)

Coding

• V0 : Frontend
• Replit : For deployment

Updates

• HuggingFace Posts

LLM

System Design

• Real-world ML and LLM systems

Leaderboards

• Chatbot Arena LLM Leaderboard
• Huggingface OpenLLM Leaderboard
• HELM

GPU

• [Mini Project: How to program a GPU?

  CUDA C/C++](https://youtu.be/GetaI7KhbzM) : there are links to blogs that explains matrix multiplication optimization in GPU

• CUDA Matrix Multiplication Optimization : another blog which is referenced by above tutorial