Create your free BvLogic ID to continue this course and save your progress.
Data Cleaning 5 lessons
  1. 1 Why the file is always dirty
  2. 2 Cleaning in Excel sign in to open
  3. 3 Cleaning in Python sign in to open
  4. 4 Deciding what to do with what is wrong sign in to open
  5. 5 Proving the file is clean sign in to open
Course overview
Data: video · change

This lesson: 122KB

Data Cleaning · Lesson 1 of 5

Why the file is always dirty

Know what you are looking for before you open it.

Every real dataset arrives broken, and it is broken in predictable ways. Knowing the list turns cleaning from a search into a checklist.

Humans typed it. "Lahore", "lahore", "LHR", "Lahor", " Lahore" are five values and one city. Any column a person typed by hand will have this.

Dates are the worst column in every file. 03/04/2026 is two different days depending on who typed it. Excel silently converts anything that looks like a date, which is how product codes become dates and never come back.

Numbers stored as text. Because someone typed "1,200" or "Rs 1200" or "1200 " with a trailing space. They look right, they sum to zero.

Missing data pretending to be present. Empty cells, "N/A", "-", "0", "unknown", "NULL" as text, and a space. Each means something different and a zero in a price column will quietly move your average.

Duplicates that are not identical. The same customer twice with a different spelling, so no exact match finds them.

Merged cells and headers in row seven, because the file was made to be looked at rather than processed.

Trailing spaces, invisible and responsible for more wasted hours than anything else on this list.

Before you change a single cell, do two things. Copy the raw file and never touch the copy. And write down the row count. Every step afterwards, check that number. Cleaning that silently deletes forty rows is worse than not cleaning at all.

Lab — try it yourself

Open any real spreadsheet you have. Go through the seven problems above and note which are present. Most files have at least four.

Check what you learned

Create your free BvLogic ID to take the quiz and record your score.

Create your BvLogic ID
Continue to lesson 2 Up next 2. Cleaning in Excel