A-Z of Machine Learning and Computer Vision Terms

  • This is some text inside of a div block.
  • This is some text inside of a div block.
  • This is some text inside of a div block.
  • This is some text inside of a div block.
  • This is some text inside of a div block.
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Ghost Frames
Ghost Frames
Gradient Descent
Gradient Descent
Greyscale
Greyscale
Ground Truth
Ground Truth
H
H
Hierarchical Clustering
Hierarchical Clustering
Histogram of Oriented Gradients (HOG)
Histogram of Oriented Gradients (HOG)
Human Pose Estimation
Human Pose Estimation
Human in the Loop (HITL)
Human in the Loop (HITL)
Hyperparameter Tuning
Hyperparameter Tuning
Hyperparameters
Hyperparameters
I
I
Image Annotation
Image Annotation
Image Augmentation
Image Augmentation
Image Captioning
Image Captioning
Image Classification
Image Classification
Image Degradation
Image Degradation
Image Generation
Image Generation
Image Processing
Image Processing
Image Recognition
Image Recognition
Image Restoration
Image Restoration
Image Segmentation
Image Segmentation
Imbalanced Data
Imbalanced Data
Imbalanced Dataset
Imbalanced Dataset
In-Context Learning
In-Context Learning
Instance Segmentation
Instance Segmentation
Instance Segmentation
Instance Segmentation
Interpolation
Interpolation
Interpretability
Interpretability
Intersection over Union (IoU)
Intersection over Union (IoU)
J
J
Jaccard Index
Jaccard Index
Jupyter Notebooks
Jupyter Notebooks
K
K
K-Means Clustering
K-Means Clustering
Keypoints
Keypoints
Knowledge Graphs
Knowledge Graphs
L
L
LIDAR
LIDAR
Label
Label
Label Errors
Label Errors
Large Language Model (LLM)
Large Language Model (LLM)
Latent Dirichlet Allocation (LDA)
Latent Dirichlet Allocation (LDA)
Latent Space
Latent Space
Learning Rate
Learning Rate
Linear Discriminant Analysis (LDA)
Linear Discriminant Analysis (LDA)
Linear Regression
Linear Regression
Logistic Regression
Logistic Regression
Long Short-Term Memory (LSTM)
Long Short-Term Memory (LSTM)
Loss Function
Loss Function
M
M
Machine Learning (ML)
Machine Learning (ML)
Manifold Learning
Manifold Learning
Markov Chains
Markov Chains
Mean Average Precision (mAP)
Mean Average Precision (mAP)
Mean Squared Error (MSE)
Mean Squared Error (MSE)
Medical Image Segmentation
Medical Image Segmentation
Micro-Models
Micro-Models
Model Accuracy
Model Accuracy
Model Parameters
Model Parameters
Model Validation
Model Validation
Motion Detection
Motion Detection
Motion Estimation
Motion Estimation
Multi-Task Learning
Multi-Task Learning
N
N
NIfTI
NIfTI
Natural Language Processing (NLP)
Natural Language Processing (NLP)
Neural Architecture Search
Neural Architecture Search
Neural Networks
Neural Networks
Neural Style Transfer
Neural Style Transfer
Noise
Noise
Normalization
Normalization
O
O
Object Detection
Object Detection
Object Localization
Object Localization
Object Recognition
Object Recognition
Object Tracking
Object Tracking
One-Shot Learning
One-Shot Learning
Optical Character Recognition (OCR)
Optical Character Recognition (OCR)
Optimization Algorithms
Optimization Algorithms
Outlier Detection
Outlier Detection
Overfitting
Overfitting
P
P
PACS (Picture Archiving and Communication System)
PACS (Picture Archiving and Communication System)
PR AUC
PR AUC
Pandas and NumPy
Pandas and NumPy
Panoptic Segmentation
Panoptic Segmentation
Parameter-Efficient Fine-Tuning (Prefix-Tuning)
Parameter-Efficient Fine-Tuning (Prefix-Tuning)
Pattern Recognition
Pattern Recognition
Perceptron
Perceptron
Pixel
Pixel
Pool-Based Sampling
Pool-Based Sampling
Pooling
Pooling
Pose Estimation
Pose Estimation
Precision
Precision
Predictive Model Validation
Predictive Model Validation
Principal Component Analysis
Principal Component Analysis
Prompt Chaining
Prompt Chaining
Prompt Engineering
Prompt Engineering
Prompt Injection
Prompt Injection
O

Overfitting

Overfitting occurs when a machine learning model learns the training data too well, including its noise and idiosyncrasies, to the point that it performs poorly on new, unseen data. In essence, the model has memorized the training data rather than capturing the underlying general patterns. Overfitting is characterized by the training error being much lower than the test/validation error. It is often the result of a model being too complex relative to the amount of training data (e.g., too many parameters or not enough regularization). Symptoms might include: weird fluctuations in learned function between training points, very high variance in predictions. To combat overfitting, one can simplify the model (reduce complexity, number of parameters), use more training data, apply regularization (L1/L2, dropout, early stopping, etc.), or use cross-validation to detect it early. A classic example: high-degree polynomial fitting through points ends up oscillating wildly between points. In deep learning, models often have capacity to overfit but techniques like dropout, augmentation and large datasets keep it in check.

Explore Our Products

Lightly One

Data Selection & Data Viewer

Get data insights and find the perfect selection strategy

Learn More

Lightly Train

Self-Supervised Pretraining

Leverage self-supervised learning to pretrain models

Learn More

Lightly Edge

Smart Data Capturing on Device

Find only the most valuable data directly on devide

Learn More

Ready to Get Started?

Experience the power of automated data curation with Lightly

Learn More