Initial commit

This commit is contained in:
Zhongwei Li
2025-11-30 08:28:47 +08:00
commit 1458762357
9 changed files with 3659 additions and 0 deletions

3
README.md Normal file
View File

@@ -0,0 +1,3 @@
# adf-master
Complete Azure Data Factory expertise system with STRICT validation enforcement and Microsoft Fabric integration (2025). PROACTIVELY activate for: (1) ANY Azure Data Factory task (pipelines/datasets/triggers/linked services) WITH automatic validation, (2) Microsoft Fabric integration (ADF mounting, cross-workspace orchestration, OneLake connectivity), (3) Activity nesting validation (ForEach/If/Switch/Until limitations), (4) Linked service configuration validation (Blob Storage accountKind, SQL Database auth), (5) CI/CD setup and automation (GitHub Actions/Azure DevOps with Node.js 20.x), (6) ARM template generation and deployment, (7) Pipeline debugging and troubleshooting, (8) Modern npm-based deployments (@microsoft/azure-data-factory-utilities), (9) Performance optimization and best practices, (10) Invoke Pipeline cross-platform orchestration (Fabric/ADF/Synapse), (11) Variable Libraries for multi-environment CI/CD. Provides: comprehensive ADF knowledge with validation enforcement, activity nesting rules (REJECTS prohibited combinations), linked service requirements (Azure Blob, SQL, ADLS, Fabric Lakehouse/Warehouse), resource limit checks (80 activities per pipeline), Execute Pipeline workarounds, common pitfall prevention, CI/CD patterns with 2025 updates, Fabric mounting guidance, Airflow deprecation notices, troubleshooting guides, and production-ready VALIDATED solutions. Ensures ONLY valid, compliant, optimized ADF pipelines with modern Fabric integration capabilities.