We are seeking a skilled Azure Data Engineer to design, develop, and maintain scalable cloud-based data solutions on the Microsoft Azure platform. The ideal candidate will have expertise in data integration, ETL/ELT pipelines, big data technologies, and cloud data warehousing to support analytics and business intelligence initiatives.
Key Responsibilities
- Design and implement scalable data pipelines using Azure services.
- Develop and maintain ETL/ELT workflows for structured and unstructured data.
- Build and optimize data solutions using Azure cloud technologies.
- Integrate data from multiple sources including APIs, databases, flat files, and streaming platforms.
- Create and manage data lakes, data warehouses, and medallion architectures.
- Ensure data quality, governance, security, and compliance standards.
- Monitor and troubleshoot production data workflows and performance issues.
- Collaborate with data analysts, DevOps, and business stakeholders.
- Implement CI/CD pipelines and infrastructure automation for data platforms.
- Optimize SQL queries and improve overall data processing performance.
- Requirements Technical Skills Strong experience with: Azure Data Factory (ADF) Azure Databricks Azure Synapse Analytics Azure Data Lake Storage (ADLS) Azure SQL Database Azure Functions Azure Event Hub / Service Bus Proficiency in: SQL Python / PySpark Scala (optional) Experience with: ETL/ELT pipeline development Data modeling and warehousing concepts Spark-based distributed processing REST APIs and data integration Git, CI/CD, and DevOps practices Benefits Standard Company Benefits
