TIME BACK FOR ENGINEERS
BEFORE
1 day
AFTER
2 min
DATA / AUTOMATION
20 tables.
Two minutes.
I built a reusable metadata workflow in Microsoft Fabric and Python, so engineers can prepare new source tables without repeating detailed manual configuration.
ResultUp to a full developer day for two large tables. The workflow now generates metadata for 20 tables in two minutes.
Read the story
- What needed to change
- For some large tables, preparing metadata for just two could take an entire developer day. Engineers had to repeat detailed configuration work for every table.
- What I built
- I developed reusable metadata-generation workflows and API templates that produce the configuration needed to onboard source tables.
- Why this approach
- I made the preparation reusable across tables, so the same workflow could handle repeated setup. The value is the engineering time returned as more tables are added.
- What changed
- The workflow now generates metadata for 20 tables in two minutes. That timing covers metadata preparation; it is one part of the wider ingestion process.
Microsoft Fabric · Python · Metadata automation