xbe.at

Topics / Deep learning

Activation functions and loss

45 notes.

Page 2 of 2

  1. Regression and Classification Loss Functions8 min

    Mean Bias Error (MBE) captures the average bias in predictions. It's rarely used for training as positive and negative errors can cancel each other out...

  2. Regression and Classification Loss Functions Cheat Sheet10 min

    Mean Bias Error provides insights into the systematic over or underestimation in regression models by calculating the average difference between predicted...

  3. Response:8 min

    Neural networks transform input data through layers of interconnected nodes, with activation functions determining the output of each neuron. These...

  4. Sigmoid Activation Function in Python7 min

    The sigmoid activation function is a fundamental component in neural networks and machine learning. It maps input values to an output range between 0 and 1...

  5. Softmax Activation Function in Neural Networks with Python10 min

    The Softmax activation function is a crucial component in neural networks, particularly for multi-class classification problems. It transforms a vector of...

  6. Softmax and Categorical Cross-Entropy Using Python10 min

    Softmax and Categorical Cross-Entropy are fundamental concepts in machine learning, particularly in classification tasks. Softmax transforms raw model...

  7. Softmax and Sharp Decision-Making in AI Systems7 min

    The softmax function is a crucial component in modern AI systems, enabling differentiable query-key lookups and sharp decision-making. This presentation...

  8. Softmax Function Explained Transforming Logits to Probabilities7 min

    The Softmax function transforms a vector of real numbers into a probability distribution, ensuring all values are between 0 and 1 and sum to 1. It's commonly...

  9. Softmax in Machine Learning with Python9 min

    Softmax is a crucial function in machine learning, particularly in multi-class classification problems. It transforms a vector of real numbers into a...

  10. Stable Minima in Univariate ReLU Networks9 min

    Stable minima play a crucial role in the generalization capabilities of neural networks. In this presentation, we'll explore how stable minima cannot overfit...

  11. Types of Activation Functions10 min

    The sigmoid function transforms input values into outputs between 0 and 1, making it useful for binary classification problems and probability outputs. It...

  12. Understanding Activation Functions in Neural Networks10 min

    Neural networks require non-linear activation functions to model complex patterns. We'll implement the classical sigmoid and tanh functions from scratch...

  13. Understanding AI Through ReLU Activation Function in Python7 min

    Introduction to Activation Functions in Neural Networks

  14. Understanding the Role of ReLU Activation in Neural Networks5 min

    The Rectified Linear Unit (ReLU) activation function transforms input by outputting zero for negative values and maintaining positive values unchanged. This...

  15. Why ReLU Function is Not Differentiable at x=07 min

    The Rectified Linear Unit (ReLU) function is a crucial activation function in neural networks. It's defined as f(x) = max(0, x), which means it outputs x if...