EDA and the Data Summary Deliverable
Track 1 - Foundations · Module 1.4
Fresh analyst
Course home
Learning ObjectivesModule 1.4 · ~25 min
Explain why EDA is a formal gate in this program, not just good hygiene.
Run the program's EDA recipe: anomaly and duplicate checks, correlation scans, per-channel ASSR, and variable-type metric tagging.
Write a data_summary one-liner in the program's style: blocker, owner, expected receipt window, granularity caveat.
Why EDA is a gate, not hygiene

In most analytics work, EDA is a private warm-up. Here it is a contract with the client and the foundation of the model itself, for three reasons:

  • The client signs off on the EDA's outputs. Data Validation Reports (DVRs) are presented to the client to lock alignment on the datasets used for modelling; only on client approval do the individual reports consolidate into the final Analytical Data Set (ADS). A dispute about data quality after modelling starts is a dispute you already lost.
  • The bounds are set from the EDA. Modules 1.6 and 1.7 will show you that every coefficient bound starts from numbers computed at this stage - base-variable correlations and per-channel ASSR. A wrong EDA does not just embarrass you; it quietly poisons every bound downstream.
  • The 8-week Build clock is running. An anomaly caught in EDA costs an email. The same anomaly caught in model iteration costs re-runs inside a committed window.

What the program's EDA covers, per the pipeline's first stage: process data to business specifications; clean and flag anomalies - missing values, duplicates, outliers; generate validation reports with visualisations and summary statistics; and run correlation analysis across channels to assess media impact against sales. In practice the checks from module 1.2 run here too: hierarchy sum-consistency, time-frame alignment across sources, the TDP decomposition identity, and a diff against the previous raw file when one exists.

The Data EDA method: type the variable, tag the metric

The methodology workbook's Data EDA sheet demonstrates the working pattern on a ~36-month example ADS slice (revenue, price, distribution, spend, CPI, competitor TV spend). Two moves matter:

Move 1 - every variable gets typed, and each type gets its own validation metric. You do not stare at 25 columns with the same lens; you ask each one the question appropriate to its role:

Type of variableMetric used to validate it
Media
ASSR, ROI
Distribution, Price, CPI
Correlation with sales, % contribution
Competitor
Based on the own analogous variable
Halo
% contribution
Promo
% contribution

Move 2 - compute per-channel ASSR before any model exists. ASSR (ad spend to sales ratio) is each channel's spend divided by total revenue. It needs no model, only the ADS - which is exactly why it is the program's earliest sanity read. It ranks channels by weight, exposes a channel whose spend share is wildly out of line with its claimed importance, and becomes the benchmark that media contributions are later set against (module 1.7). Alongside it, the base-variable correlations (distribution vs sales, price vs sales, CPI vs sales) anchor the base-side contribution expectations (module 1.6).

The sheet closes with three standard visual checks - Spend vs Revenue, Distribution vs Revenue, Price vs Revenue line charts - the plots you eyeball before believing any correlation number. And when reading a decline, follow the KT order: volume vs price first; if that does not explain it, distribution; then promo; then media last - media typically explains only ~12-20% of volume, so it is rarely the headline of a sales story.

Writing the data_summary one-liner

Every cell's Data sheet carries a data_summary field - one narrative line that tells a reader (often a delivery lead scanning 80 cells) where this cell's data actually stands. The program style packs four things into one line: what is resolved, what is being chased, who owes it and by when, and any granularity caveat. Compare (all synthetic):

ExampleVerdict
"12/14 Validated; bgs brand-level only (Granularity Issue logged, caveat agreed with client); ecomm_media access with retailer, DM chasing, ETA w/c 27-Jul."Good - status, blocker, caveat, owner, date
"Data looks mostly fine, a few gaps remain."Bad - no feed named, no owner, no date; unusable at portfolio scale
"All feeds Validated except promotion: promo/non-promo TDP split does not reconcile for 11 weeks of 2025, raised with Nielsen 10-Jul, revised file expected in 5 working days."Good - names the exact validation failure and the receipt window
The test for a good one-liner: could someone who has never seen this cell decide, from this line alone, whether the Data sign-off is at risk and who to ping? If yes, it is doing its job.
Check Yourself
Which statement best captures why EDA is a formal gate here?
Why: the gate is both contractual (client approval of the DVRs locks the ADS) and technical (bound setting in modules 1.6/1.7 consumes EDA outputs directly). Hygiene is a side benefit.
You are validating a competitor price series. Which metric does the program's EDA key say to use?
Why: the variable-type key routes Competitor to "based on own analogous variable". The KT sessions flag the aggregated competitor correlation as a named pitfall - many competitors summed into one series produces a number you must not read literally.
Pick the best data_summary line (all synthetic):
Why: the middle line names the feed, the exact gap, the chase action, the owner-side and the window - in one sentence. The first is vague; the third is long yet says nothing a status column doesn't already say.
Sources
Authored from:
  • UL_Rapid ROI_Pre-Read_Document 1.pptx slide 14, stage 1 "Data Preprocessing & Exploratory Data Analysis" (cleaning, anomaly flags, missing/duplicates/outliers, correlation analysis)
  • MathCo Methodology Understanding_UL.xlsx sheet Data EDA for Modelling (monthly worked-example structure, per-channel ASSR block, base-variable correlations, variable-type to metric key, three standard charts) and sheet Process steps 1-5 (DVRs, client approval, ADS consolidation)
  • UL - KT.docx (2 Jun session): order of reading a sales decline, media's ~12-20% contribution ceiling
  • Root MASTER_SCHEMA.md: Data sheet data_summary field
All example one-liners and quiz options are synthetic.