Fabric Copy Activity Deep Dive: Every Tab, Every Setting, Fault Tolerance, Staging, Logging, Intelligent Throughput, Parallelism, and Production Patterns Every Data Engineer Must Know
Complete Fabric Copy Activity deep dive covering every tab and setting. Moving company analogy for understanding Source, Destination, Mapping, and Settings tabs. How the Copy activity works under the hood (4-step process). General tab (naming conventions, timeout best practices with restaurant analogy, retry and retry interval, secure input/output). Source tab (table vs query vs stored procedure with room analogy, partition options with None/Physical/Dynamic Range comparison table and performance benchmarks, additional columns for audit lineage, query timeout and isolation level). Destination tab (Lakehouse vs Warehouse differences table, table action Append/Overwrite/Upsert with bookshelf analogy, key columns for upsert, pre-copy script for idempotent reloads, destination partitioning, max rows per file). Mapping tab (auto vs manual mapping, import schemas, type conversion two-stage flow, schema drift handling). Settings tab (ITO with truck-size analogy and cost impact benchmarks, Degree of Copy Parallelism with tuning guidance, how ITO and parallelism compound, fault tolerance with postal service analogy and when/when-not to enable, enable staging with loading dock analogy and Workspace vs External options, session logging with file path structure, data consistency verification, preserve metadata). Monitoring output (11-field table, reading throughput, identifying bottlenecks across queue/pre-copy/transfer/post-copy phases). Five production patterns: standard SQL-to-Lakehouse, large table with Dynamic Range partitioned read, SQL-to-Warehouse with required staging, fault-tolerant load with quarantine session logging and Teams alerts, metadata-driven copy with per-table ITO and fault tolerance settings from config table. Six cost optimization tips. Eight common mistakes. Eight interview Q&As.