PyTorch is a deep learning framework that significantly simplifies the process of writing and training deep neural networks. It supports a wide range of architectures, from shallow ones to deep ones like transformers. I mean, any neural network architecture you can think of. On the other hand, tensors are fundamental data structures in PyTorch; they…
Category: Linear Algebra
Mathematical concepts behind Norms in Linear algebra
This article is a beginner guide to norms from linear algebra. The commonly used norms: L1 norm, L2 norm, max-norm and Frobenius norm are also discussed.
Basic Operations on Tensors
In this article, we’ll see the basic operations (Addition, Broadcasting, Multiplication, Transpose, Inverse) that can be performed on tensors.
Scalars, Vectors, Matrices and Tensors
This article discusses the fundamentals of linear algebra: scalars, vector, matrices and tensors. The real-world use case of tensors is briefly introduced.