Learn Before
Purpose of a Test Set
A test set is a held-out data split used after model, feature, and hyperparameter choices are fixed to estimate the final system's performance on unseen data. Using test results to make those choices compromises the independence of the final evaluation.
0
1
Tags
D2L
Dive into Deep Learning @ D2L
Machine Learning
Deep Learning
Supervised Learning
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Representational Learning
Supervised Learning
Kaggle Platform
Predictive Analytics for Accelerated Decision-Making
Development Set
Combining Metrics With a Threshold and an Objective
An Iterative Machine Learning Workflow
Bias and Variance as Two Major Sources of Error
What End-to-End Learning Can Predict
When a Pipeline Is Missing Information
Text Polarity Detection
Machine Learning Strategy
Two Forces Behind Recent Deep Learning Gains
Purpose of a Test Set
Learn After
Dev and Test Splits Should Be Smaller for Very Large Datasets
A Test Set Large Enough for a Reliable Final Check
Test Set Size Should Enable Reliable Evaluation
Which use of a test set matches its intended role?
A final test set can measure performance without being used to choose model settings.
The held-out test set is used to _____ the final model’s performance on unseen data.
Match each holdout-set concept with its proper role.
Order the steps for deciding how a test set may be used.
What a test set is for, and what it is not for
Using the Right Evaluation Set for Model Selection
Test Set Purpose and Limits
Using the final holdout set appropriately
The test set should be used to choose the model you deploy.