DATA 510: Data Science Capstone
June 22, 2026
By the end of this lecture, you will be able to:
Course Connection: This supports the Visualization and Communication pillar and the Data Engineering pillar. Tonight is the bridge between your M2 data summary (this week) and your M3 poster (week 10).
The data summary is the first time your peer POs and I see what your data actually is, not what you hoped it would be in M1. Everything downstream (poster, write-up, defense) builds on how clearly you tell this story now.
A quick reminder of what you are actually submitting this week.
From the Data Summary assignment:
Your submission must include all eight sections:
| Criterion | Points |
|---|---|
| Completeness vs research question | 25 |
| Organization and schema | 20 |
| Pipelines or stable ingestion | 20 |
| Quality and profiling | 15 |
| Reproducibility | 10 |
| Ethics and freeze | 10 |
Tonight is about communicating these eight sections well, in the write-up and at the poster, so they read as command and not as a checklist.
The data is the project. Everything else is commentary.
A data summary answers four questions for a reader who was not in the room:
If a reader finishes your summary unable to answer those four, the summary failed, no matter how pretty the charts are.
A data summary is not:
df.head() and no narrative.The reader does not care that you ran code. They care what the data is, whether they can trust it, and what it took to get there.
You will tell this same story on two very different surfaces:
| Surface | Milestone | Reader behavior |
|---|---|---|
| Write-up | M2, then M4/M5 | Reads alone, can re-read, no one to ask |
| Poster | M3, poster session | Skims in 10 seconds, you are standing there |
The content is the same four things. The packaging is completely different. Most of tonight is about packaging.
Which of these is not one of the four things a data summary must convey?
A. The data (sources, volume, trust)
B. The process (raw to analysis-ready)
C. The integrity (validation, completeness)
D. The marketing (why your topic is trendy)
D. Trendiness is not integrity. A reader needs data, process, integrity, and reproducibility. “This topic matters” belongs in your introduction, not your data summary.
At the poster session, in one hour, the people who stop at your poster include:
You cannot write four posters. You write one that lets each of them enter at their level.
Structure every artifact like an inverted pyramid: the widest, simplest layer reaches everyone, and each layer down adds detail for a smaller, more technical audience.
The funder reads the top. The data scientist reads to the bottom. Nobody is forced to read more (or less) than they want.
“Command” means you can zoom in and out on demand:
The tell of someone who does not have command: they answer every question at the same altitude. Either drowning a board member in GROUP BY details, or hand-waving a fellow engineer with “it just works.”
Before you write anything, finish this sentence:
“We integrated [these sources] into [this dataset] so that [this stakeholder] can [make this decision].”
If you cannot say it cleanly, your reader cannot either. This sentence becomes your poster headline and your abstract’s first line.
A nonprofit board member at your poster asks, “So can you predict who comes back?” The best first response is:
A. A walkthrough of your random forest hyperparameters
B. "Roughly. We can flag higher-likelihood cases; here's the catch." then offer detail
C. "It depends on the confusion matrix and class imbalance"
D. "Let me show you the code"
B. Lead with the honest one-liner at their altitude, signal the caveat, and let them pull you deeper. That is command.
Give a source inventory, not prose. For each source:
| Source | Volume | Coverage | Access |
|---|---|---|---|
| Intake system export | ~300 clients/yr | 2024-2025 | Approved, one-time pull |
| Case management export | ~300 clients/yr | 2024-2025 | Approved |
| Web application form | ~8,000 records | 2024-2025 | Approved |
A table like this tells a reader more in ten seconds than three paragraphs.
Show the path from raw to analysis-ready as stages, not a wall of script names:
Name the transforms on the edges. That is where the engineering judgment lives.
Integrity is numbers, not adjectives. “Clean data” means nothing. Show your validation:
| Check | Result |
|---|---|
| Duplicate records | 0 |
| Missing predictor values | 0 |
| Unmatched rows after join | 4.1% (held out, documented) |
| Date range validated | 1956-04 to 2026-01 |
A validation table is the single most credibility-building element in a data summary. It says “I looked,” not “trust me.”
Reproducibility is the difference between a result and a reusable asset. Show:
The test: could a new analyst clone the repo and regenerate processed/ without texting you? If not, document until they can.
The four pillars map directly onto both surfaces:
| Pillar | Write-up section | Poster panel |
|---|---|---|
| Data | Data sources | Source inventory box |
| Process | Data engineering | Architecture diagram |
| Integrity | Data quality | “By the numbers” callout |
| Reproducibility | Reproducibility | Repo link + lineage note |
You are not inventing structure. You are filling a known frame.
A good diagram answers “where did this come from” before the reader finishes asking.
On a poster, the architecture diagram is usually the most-read element after the title. It lets a reader reconstruct your whole pipeline at a glance and it signals, instantly, that you understand your own system.
A paragraph describing a pipeline is forgettable. A clean left-to-right diagram is the thing people photograph.
A private-data project where automation is not possible, so the manual, documented process is the contribution:
Notice the PII removal and person-matching are on the edges. That is the hard part, so it gets labeled. The flow ends at the stakeholder, not at the model.
A near-real-time pipeline where the engineering is the headline:
The reconciliation step (the join across systems on a common date) is the engineering risk, so it is the labeled edge.
A forecasting project that integrates many public series into one analytical panel:
Frequency alignment is the silent killer in multi-source time data, so it is the first labeled edge.
Bad
File names, no transforms, no stakeholder. Reader learns nothing.
Good
Stages, transforms, and the decision it feeds.
Whatever you use, export a high-resolution PNG or SVG for the poster. A blurry diagram undoes all the clarity.
Your architecture diagram has 22 boxes, every box is a Python file, and the arrows are unlabeled. The problem is:
A. Too few boxes
B. It is a dependency graph, not a data story; collapse to stages and label transforms
C. It needs more colors
D. Nothing, detail is always better
B. Collapse files into raw/interim/processed stages, label the transforms on the edges, and end at the stakeholder. Aim for under ten nodes.
Open the data section with what the data is and why it answers your question, not with your tech stack.
Tooling is a detail of the process pillar, not the headline.
Two tables do the heavy lifting in any data summary:
A reader scanning your write-up should be able to read just those two tables and trust your data.
If your data shifted since the proposal (a source fell through, a join did not work, scope narrowed), say so in a short Changes since M1 note.
Honesty reads as maturity. A silent rewrite that contradicts your proposal reads as either careless or evasive. Reviewers always notice.
A write-up reads like a report. A folder of screenshots named chart_final3.png reads like a panic.
These are real anti-patterns that cost credibility:
Which sentence belongs in a strong data summary?
A. "Our pipeline achieves zero orphan transactions."
B. "The model is 90% accurate."
C. "4.1% of POS rows did not match an accounting entry; we hold these out and flag them for manual review."
D. "We used cutting-edge tools."
C. It gives a real number, an honest gap, and a handling plan. A, B, and D are unverifiable or unrealistic.
The poster’s job is to start a conversation, not to be read end-to-end. Design for a reader who gives you ten seconds before deciding to stop.
Have these rehearsed and ready to deploy based on who stopped:
| Version | Length | For whom |
|---|---|---|
| The hook | ~30 seconds | Anyone walking by |
| The walkthrough | ~2 minutes | Genuinely interested |
| The deep dive | ~10 minutes | Expert or evaluator |
The hook is the one-sentence test from Part 2. Each longer version adds a layer of the pyramid.
A visitor glances at your poster for ten seconds and walks on. The most likely design failure is:
A. Not enough equations
B. No single dominant takeaway; the eye had nowhere to land
C. The font was too large
D. Too few authors listed
B. If there is no clear visual hierarchy and headline takeaway, a skimming reader finds no reason to stop. Lead the eye to one big idea.
Many projects have a model. The thing that separates a capstone is whether the data engineering story is told well. That is where your judgment shows.
Anyone can call .fit(). Far fewer can explain how three messy systems became one trustworthy dataset.
When you present, surface the moments that show command:
These are the stories that make a reader trust everything else.
Frame your reproducibility around a concrete person:
“Could a new analyst clone this repo and rebuild
processed/without asking me a single question?”
If yes, say so and show the one command. If no, that is your next PBI. This framing is more persuasive than the word “reproducible.”
| Blends in | Stands out |
|---|---|
| “We cleaned the data.” | “We dropped 312 duplicate dates from a frequency mismatch.” |
| “We used several sources.” | A labeled architecture diagram ending at the stakeholder. |
| “The data is reliable.” | A validation table with real counts. |
| “It is reproducible.” | “Clone, run make data, get the identical panel.” |
Specificity is command. Vagueness is forgettable.
We will now do a paired activity using realistic project scenarios.
Pair with your neighbor and get ready to count off.