Activation Function Gradient Computation - Visualizer | OneNoughtOne
Loading content...
Machine Learning Patterns
0/347 completed
Linear algebra
0/1
0/30
0/1
Vectors and Vector Spaces: The Language of Machine Learning
5
Coordinate Transformation Between Bases
Coordinate Transformation Between Bases
Closed-Form Linear Model Fitting
Column Compressed Sparse Matrix Format
Component-wise Vector Addition
Linear Kernel Computation (Dot Product Similarity)
Linear Transformation of a Vector
Square Matrix Determinant and Trace Evaluator
Matrix Dimension Restructuring
Computing the Multiplicative Inverse of a 2×2 Matrix
Matrix Row-Column Interchange
Scaling a Matrix by a Constant Factor
Polynomial Kernel Similarity Computation
Hyperplane Separation Width for Linear Classifiers
Three-Dimensional Vector Cross Product
Vector Inner Product Computation
Vector Projection onto a Line
Construct Diagonal Matrix from Vector
Column Space Basis Extraction
Doubly Stochastic Stream Mixing Forward Pass
Gauss-Seidel Linear System Solver
Gaussian Kernel Similarity Matrix
Hyperdimensional Row Encoding Using Bind-Bundle Operations
Low-Rank Adaptation Forward Computation
Pairwise Matrix Product Computation
Surprise-Driven Neural Memory Update with Momentum
Two-Dimensional Orthonormal Basis Generator
Row Reduced Canonical Form
Similarity Matrix Transformation
Spatial Translation Transformation in 2D
Spectral Analysis of a Square Matrix
Probability and statistics
0/1
0/31
0/1
Calculus and optimization
0/1
0/65
0/1
Differential Calculus Review
5
Activation Function Gradient Computation
Activation Function Gradient Computation
Adamax Gradient Optimizer Update Step
Adaptive Gradient Parameter Updater
Binary Classification Loss
Bounded Gradient Constraint for Training Stabilization
Sparse Matrix Compression: Row-Based Storage Transformation
Epoch-Based Learning Rate Decay Scheduler
Exponential Decay Learning Rate Scheduler
Optimizing Linear Model Coefficients via Gradient Descent
Gradient Vector Analysis for Optimization
Gradient Descent with L2 Regularization Penalty
Margin Penalty Loss Computation for Binary Classifiers
Momentum-Based Parameter Updater
Nesterov Accelerated Momentum Optimizer
Piecewise Linear Sigmoid Approximation
Polynomial Series Function Estimation
Polynomial Term Rate of Change
Sequential Function Chain Evaluator
Training Convergence Halt Detector
Training Halt Monitor: Validation Stagnation Detector
Adaptive Delta Gradient Optimizer
Adaptive Gradient Scaling Optimizer
Adaptive Moment Estimation Optimizer Step
Adaptive Moment Estimation Optimizer
Segmented 8-Bit Floating Point Tensor Compression
Composite Function Differentiation via Chain Rule
Constrained Quadratic Optimizer with Dual Variables
Cosine Decay Learning Rate Scheduler
Curvature-Based Optimization Step
Decoupled Weight Decay Parameter Update
Determinant-Based Linear System Solver
Exhaustive Hyperparameter Search
Direct Linear System Solver Using Row Reduction
Global Norm Gradient Rescaling
Glorot/Xavier Weight Initialization
Gradient Field Matrix Computation
Gradient Vector Computation for Scalar Fields
Gradient Verification via Finite Difference Approximation
Hessian-Based Critical Point Classification
Hybrid Precision Computation for Deep Learning
Hybrid Regularized Linear Optimizer
Iterative Linear System Solver
Momentum-Based Orthogonal Optimizer with Iterative Matrix Conditioning
Muon Optimizer Update with Newton-Schulz Preconditioning
Parameter Optimization Using Gradient-Based Algorithms
Polynomial Global Minimum Finder
Derivative of Polynomial Ratio Using Division Rule
Quantized Low-Rank Adaptation Forward Pass
Robust Hybrid Regression Loss
Second-Order Curvature Matrix Computation
Masked Gradient Descent for Localized Knowledge Editing
Training a Single Neuron with Gradient Descent
Gradient of Softmax Cross-Entropy Loss
Jacobian Matrix of the Softmax Transformation
Sparse Regression Optimizer with L1 Penalty
Dynamic Temperature Scheduling for Stochastic Neural Networks
Warmup Cosine Annealing Learning Rate Scheduler
Binary Classifier Gradient Optimizer
Iterative Solution of Symmetric Positive-Definite Linear Systems Using Conjugate Gradients
Computing the Determinant of a 4×4 Matrix via Cofactor Expansion
Two-by-Two Matrix Decomposition via Jacobi Rotation
Kernel-Based Support Vector Classifier Training
Orthogonal-Triangular Matrix Factorization
Decomposing a 2×2 Matrix via Singular Value Factorization
Softmax Classifier Optimization via Gradient Descent
Feature preparation
0/1
0/13
0/1
Classical machine learning
0/1
0/16
0/1
Neural networks and efficient training
0/1
0/22
0/1
Convolution and computer vision
0/1
0/22
0/1
Sequence models
0/1
0/3
0/1
Attention and transformers
0/1
0/16
0/1
Generative models
0/1
0/5
0/1
Reinforcement learning
0/1
0/27
0/1
ML serving and evaluation
0/1
0/57
0/1
Text and information retrieval
0/1
0/5
0/1
Financial time series
0/1
0/4
0/1
Additional numerical and ML techniques
0/1
0/1
0/1
Course overview & roadmap
Toggle Sidebar
101
OneNoughtOne
0/347
Share
Loading the visualizer…