AIFLX

Library / Artificial Intelligence

Master Deep Learning and Generative AI with PyTorch in Hindi

On Udemy

About this course

you will learn all these Topics and lot more 1. Core Concepts1. Perceptron2. MLP and its Notation3. Forward Propagation4. Backpropagation5. Chain Rule of Derivative in Backpropagation6. Vanishing Gradient Problem7. Exploding Gradient

Activation Functions

List of Activation Functions1. Linear Function2. Binary Step Function3. Sigmoid Function (Logistic Function)4. Tanh (Hyperbolic Tangent Function)5. ReLU (Rectified Linear Unit)6. Leaky ReLU7. Parametric ReLU (PReLU)8. Exponential Linear Unit (ELU)9. Scaled Exponential Linear Unit (SELU)10. Softmax11. Swish.12. SoftPlus13. Mish14. Maxout15. GELU (Gaussian Error Linear Unit)16. SiLU (Sigmoid Linear Unit)17. Gated Linear Unit (GLU)18. SwiGLU19. Mish Activation Function

Derivative of Activation Functions

Properties of Activation Functions1. Saturating vs Non-Saturating2. Smooth vs Non-Smooth3. Generalized vs Specialized4. Underflow and Overflow5. Undefined and Defined6. Computationally Expensive vs Inexpensive.7. 0-Centered and Non-0-Centered8. Differentiable vs Non-Differentiable9. Bounded and Unbounded10. Monotonicity11. Linear Vs Non LinearIdeal Activation Function Characteristics1. Non-Linearity2. Differentiability3. Computational Efficiency4. Avoids Saturation5. Non-Sparse (Dense) Gradients6. Centered Output (0-Centered)7. Prevents Exploding Gradients8. Monotonicity (Optional)9. Sparse Activations (Optional)1

Ready to start? Continue on Udemy to enroll.

Start learning on Udemy (opens in a new tab)

Prices, discounts and availability are set by Udemy. We may earn a commission when you purchase through links on this site.