Essay

Analyzing Data Requirements for End-to-End Systems

Question: Why is a pure end-to-end approach particularly difficult to train for autonomous driving, as opposed to tasks where paired data is more naturally available?

Sample answer: A pure end-to-end approach for autonomous driving requires a massive dataset of paired (Image, Steering Direction) data. Gathering this specific type of data is highly time-consuming and expensive because it cannot be easily scraped or synthesized. Instead, it requires deploying a fleet of specially-instrumented cars and having people drive them extensively to capture a sufficiently wide range of possible driving scenarios.

Key points:

  • Requires large datasets of (Image, Steering Direction) pairs
  • Data collection is highly time-consuming and expensive
  • Requires a fleet of specially-instrumented cars
  • Requires immense amounts of driving to cover diverse scenarios

Rubric: 1 point for identifying the need for (Image, Steering Direction) pairs. 1 point for stating data collection is time-consuming and expensive. 1 point for mentioning the requirement of specially-instrumented cars. 1 point for noting the huge amount of driving required to cover various scenarios.

0

1

Updated 2026-05-27

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI