data_summary one-liner in the program's style: blocker, owner, expected receipt window, granularity caveat.In most analytics work, EDA is a private warm-up. Here it is a contract with the client and the foundation of the model itself, for three reasons:
- The client signs off on the EDA's outputs. Data Validation Reports (DVRs) are presented to the client to lock alignment on the datasets used for modelling; only on client approval do the individual reports consolidate into the final Analytical Data Set (ADS). A dispute about data quality after modelling starts is a dispute you already lost.
- The bounds are set from the EDA. Modules 1.6 and 1.7 will show you that every coefficient bound starts from numbers computed at this stage - base-variable correlations and per-channel ASSR. A wrong EDA does not just embarrass you; it quietly poisons every bound downstream.
- The 8-week Build clock is running. An anomaly caught in EDA costs an email. The same anomaly caught in model iteration costs re-runs inside a committed window.
What the program's EDA covers, per the pipeline's first stage: process data to business specifications; clean and flag anomalies - missing values, duplicates, outliers; generate validation reports with visualisations and summary statistics; and run correlation analysis across channels to assess media impact against sales. In practice the checks from module 1.2 run here too: hierarchy sum-consistency, time-frame alignment across sources, the TDP decomposition identity, and a diff against the previous raw file when one exists.
The methodology workbook's Data EDA sheet demonstrates the working pattern on a ~36-month example ADS slice (revenue, price, distribution, spend, CPI, competitor TV spend). Two moves matter:
Move 1 - every variable gets typed, and each type gets its own validation metric. You do not stare at 25 columns with the same lens; you ask each one the question appropriate to its role:
| Type of variable | Metric used to validate it |
|---|---|
Media | ASSR, ROI |
Distribution, Price, CPI | Correlation with sales, % contribution |
Competitor | Based on the own analogous variable |
Halo | % contribution |
Promo | % contribution |
Move 2 - compute per-channel ASSR before any model exists. ASSR (ad spend to sales ratio) is each channel's spend divided by total revenue. It needs no model, only the ADS - which is exactly why it is the program's earliest sanity read. It ranks channels by weight, exposes a channel whose spend share is wildly out of line with its claimed importance, and becomes the benchmark that media contributions are later set against (module 1.7). Alongside it, the base-variable correlations (distribution vs sales, price vs sales, CPI vs sales) anchor the base-side contribution expectations (module 1.6).
The sheet closes with three standard visual checks - Spend vs Revenue, Distribution vs Revenue, Price vs Revenue line charts - the plots you eyeball before believing any correlation number. And when reading a decline, follow the KT order: volume vs price first; if that does not explain it, distribution; then promo; then media last - media typically explains only ~12-20% of volume, so it is rarely the headline of a sales story.
Every cell's Data sheet carries a data_summary field - one narrative line that tells a reader (often a delivery lead scanning 80 cells) where this cell's data actually stands. The program style packs four things into one line: what is resolved, what is being chased, who owes it and by when, and any granularity caveat. Compare (all synthetic):
| Example | Verdict |
|---|---|
| "12/14 Validated; bgs brand-level only (Granularity Issue logged, caveat agreed with client); ecomm_media access with retailer, DM chasing, ETA w/c 27-Jul." | Good - status, blocker, caveat, owner, date |
| "Data looks mostly fine, a few gaps remain." | Bad - no feed named, no owner, no date; unusable at portfolio scale |
| "All feeds Validated except promotion: promo/non-promo TDP split does not reconcile for 11 weeks of 2025, raised with Nielsen 10-Jul, revised file expected in 5 working days." | Good - names the exact validation failure and the receipt window |
data_summary line (all synthetic):UL_Rapid ROI_Pre-Read_Document 1.pptxslide 14, stage 1 "Data Preprocessing & Exploratory Data Analysis" (cleaning, anomaly flags, missing/duplicates/outliers, correlation analysis)MathCo Methodology Understanding_UL.xlsxsheetData EDA for Modelling(monthly worked-example structure, per-channel ASSR block, base-variable correlations, variable-type to metric key, three standard charts) and sheetProcesssteps 1-5 (DVRs, client approval, ADS consolidation)UL - KT.docx(2 Jun session): order of reading a sales decline, media's ~12-20% contribution ceiling- Root
MASTER_SCHEMA.md:Datasheetdata_summaryfield