Azure Data Engineer
Requirements
• Azure Data Factory (ADF), Azure Synapse Analytics, Azure SQL, ADLS, and Microsoft Fabric.
• Strong experience with ETL/ELT processes and data integration.
• Advanced SQL/T-SQL development and database optimization.
• Enterprise Data Warehouse (EDW) concepts and implementation.
• Data modelling including fact/dimension structures and source-to-target mapping.
• Azure DevOps, Git, CI/CD, and release management.
• Pipeline orchestration, monitoring, troubleshooting, and production support.
• Power BI data models and reporting knowledge.
• Strong communication, analytical, and documentation skills.
Preferred Qualifications
• Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
• Microsoft Azure certifications such as DP-203 or Microsoft Fabric certifications
Key Responsibilities
• Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF), Azure Synapse Analytics, Microsoft Fabric, Azure SQL Database, and Azure Data Lake Storage (ADLS).
• Build and orchestrate ADF pipelines to ingest data from multiple enterprise systems into the Enterprise Data Warehouse (EDW).
• Develop and optimize ETL/ELT processes for reliable data movement and transformation.
• Create complex SQL/T-SQL queries, stored procedures, views, and data transformation logic.
• Integrate data from diverse sources including databases, APIs, cloud applications, and files.
• Monitor, troubleshoot, and optimize pipelines and production workloads.
• Participate in requirements gathering, design, development, testing, deployment, and support activities.
• Implement CI/CD processes using Azure DevOps and Git.
• Utilize Azure Key Vault, Logic Apps, Azure Functions, and Storage services.
• Support Power BI reporting and analytics requirements.
