Tag: pytorch

Attention is all you need - Part 1

The title tells it all and transformers are here to stay. If you want to join the trend of shaping the future of NLP, this is the place to start.

Deep Learning Parameters Initialization

Training and tuning a deep learning model is a complex process. This post will cover the basics of how to initialize the parameters of a deep learning model.

Understanding Activation Functions in Neural Networks

As key components of neural networks, activation functions are responsible for transforming the input data into the desired output. In this article, we will discuss the most common activation functions and their applications.

Full Stack Deep Learning with PyTorch

A guide to building a full stack deep learning application with PyTorch in a small scale, from data collection to model saving without deploying to production.