Portfolio Sample

Messy DataClean Data

Automated pipeline that standardizes, deduplicates, and validates 247 customer records in seconds.

Raw Data (Before)

customer_export_RAW.csv — 10 rows shown
Date Name Phone Email State Revenue
3/15/2024 john smith 5551234567 john@ California $4,200
March 15, 2024 JANE DOE (555) 123 4567 jane.doe@gmail calif. N/A
2024-03-15 Robert jones 555.123.4567 robert.jones@outlook.com CA $8,750
15-Mar-24 sarah WILLIAMS 555-123-4567 not-an-email Ca $3,100
4/2/2024 Michael Brown 5559876543 m.brown@yahoo.com New York $6,400
4/2/2024DUP Michael Brown 5559876543 m.brown@yahoo.com New York $6,400
05/20/2024 LISA CHEN - lisa.chen@company.com texas $12,300
null David Kim (555) 222-3344 d.kim@proton.me Florida
05/20/2024DUP LISA CHEN - lisa.chen@company.com texas $12,300
June 1 2024 AMY GARCIA 555 444 5566 amy.garcia@ IL $5,900

Clean Data (After)

customer_cleaned.csv — 8 unique records
Date Name Phone Email State Revenue
2024-03-15 John Smith (555) 123-4567 john.smith@mail.com CA $4,200
2024-03-15 Jane Doe (555) 123-4567 jane.doe@gmail.com CA $5,680
2024-03-15 Robert Jones (555) 123-4567 robert.jones@outlook.com CA $8,750
2024-03-15 Sarah Williams (555) 123-4567 s.williams@mail.com CA $3,100
2024-04-02 Michael Brown (555) 987-6543 m.brown@yahoo.com NY $6,400
2024-05-20 Lisa Chen (555) 333-7788 lisa.chen@company.com TX $12,300
2024-05-28 David Kim (555) 222-3344 d.kim@proton.me FL $7,250
2024-06-01 Amy Garcia (555) 444-5566 amy.garcia@inbox.com IL $5,900
0
Records Processed
0
Issues Found
0
Issues Fixed
0
Data Quality Score
Overall Data Quality 98.2%

Transformation Log

Seven automated operations applied to the raw dataset

📅

Standardized Date Format

Parsed 4 inconsistent date formats and normalized all entries to ISO 8601.

3/15/20242024-03-15
👤

Normalized Names to Title Case

Converted ALL CAPS, lowercase, and mixed-case names to consistent Title Case.

sarah WILLIAMSSarah Williams
🗑

Removed 2 Duplicate Records

Identified and removed exact-match duplicate rows for Michael Brown and Lisa Chen.

10 rows8 unique rows
🔍

Filled 3 Missing Values

Resolved N/A, null, empty, and placeholder entries via CRM lookup and median imputation.

N/A · null · –$5,680 · 2024-05-28 · (555) 333-7788

Standardized Phone Format

Reformatted 5 non-standard phone numbers to the (XXX) XXX-XXXX pattern.

555.123.4567(555) 123-4567

Validated & Corrected Emails

Flagged 3 invalid emails (missing domain/TLD) and resolved via customer lookup.

john@john.smith@mail.com
📍

Standardized State Abbreviations

Mapped full names, partial abbreviations, and casing variants to 2-letter USPS codes.

California · calif. · CaCA