mbilal.works
Available · September 2026
Talk
← Back to Portfolio
Data Engineering & Triage Infrastructure
Personal Cloud Infrastructure · Mar 2026 → Present

Terabyte-Scale Google Drive to Notion Database Migrator

Google Drive → Notion byte-integrity migrator designed for unattended cloud deployment on lightweight VM infrastructure, executing 6-pass deterministic triage, property-based testing, and chunked uploads.

01. Problem & Context

The Operating Challenge

Migrating 1.52 TB of unstructured cloud drive data containing 355k+ files into Notion resulted in duplicate folders, broken API payloads (>5 GB file limits), and phantom sync errors.

02. Architecture & Solution

Technical Implementation

Engineered a 6-pass deterministic triage pipeline (phantom recovery, exact folder dedup, near-duplicate merge, cross-folder file dedup, content-conservation invariant enforcement) with strict mypy typing, Hypothesis property tests, and a chunked Notion block uploader.

03. Measurable Impact

Results & Verification

Detected 164,403 phantom rows with zero data loss; passed row-count and content-conservation invariants across 100% of processed data.

04. Technology Stack
Python 3.14SQLiteNotion APIGoogle Drive APIHypothesismypy --strict
mbilal.works · personal hub at bilalm.me · Impressum · PrivacyBuilt to a DESIGN.md spec · Bricolage Grotesque + JetBrains Mono · MMXXVI