AI Glossary/Hyperparameter
Machine Learning

Hyperparameter

Configuration settings set before training that control the learning process, not learned from data.

In-depth explanation

Hyperparameters are external configurations that affect how a model learns. Unlike model parameters (learned during training), hyperparameters are set by the practitioner. Examples include learning rate, number of layers, regularization strength, and batch size. Hyperparameter tuning-finding optimal values-significantly impacts model performance.

Examples

Learning rate = 0.001
Number of trees = 100
Dropout rate = 0.5

Master Hyperparameter.

Learn how to apply this concept with hands-on projects in our comprehensive AI programs.