🤖 Machine Learning / AI
Beginner
What is feature scaling and why is it important?
Answer
Feature scaling is the process of normalizing the range of independent variables. Many ML algorithms are sensitive to the scale of features — algorithms that use distance metrics (KNN, SVM, K-Means) or gradient descent (neural networks, linear regression) perform poorly when features have very different scales. Min-Max Normalization scales features to [0, 1]; Standardization (Z-score) transforms features to have mean 0 and standard deviation 1. Tree-based models (Random Forest, XGBoost) are generally scale-invariant.
Previous
What is a Support Vector Machine (SVM)?
Next
What is the difference between parameters and hyperparameters?