Sr. Data Engineer - Azure

<div><span dir="ltr"><span><div><strong>Job Title: </strong>Senior Data Engineer (Azure)<br><strong>Location: </strong>Ahmedabad, Gujarat</div><div><strong>Experience: </strong>4+ years<br><strong>Job Type:</strong> Full Time<br><strong>Department: </strong>Data Engineering<br><br></div><div><p style="margin-bottom:0px;margin-top:0px;"><span style="font-size:inherit;"><strong>About Simform:</strong></span></p><p style="margin-bottom:0px;margin-top:0px;"><span style="font-size:inherit;">Simform is a premier digital engineering company specializing in Cloud, Data, AI/ML, and Experience Engineering to create seamless digital experiences and scalable products.

Simform is a strong partner for Microsoft, Google Cloud, and Databricks. With a presence in 5+ countries, Simform primarily serves North America, the UK, and the Northern European market. </span><span style="font-size:inherit;">Simform takes pride in being one of the most reputed employers in the region, having created a thriving work culture with a high work-life balance that gives a sense of freedom and opportunity to grow.  </span></p></div><div> </div><p style="margin-left: 0px;"><strong>Role

Overview:

</strong></p><div>We are looking for a Senior Data Engineer (Azure) who is passionate about managing large-scale data, eager to take on challenges, and committed to delivering exceptional results. This role requires expertise in Azure data services, ETL pipelines, and database management. If you are a proactive problem solver with a strong technical background and a team player with a positive attitude, we want to hear from you.</div><div> </div><p style="margin-left: 0px;"><strong>Key Responsibilities</strong></p><span><ul><li>Design, develop, monitor, and maintain end-to-end data pipelines on Microsoft Fabric.</li><li>Work with <strong>Microsoft Fabric services </strong>such as<ul><li>Fabric Pipelines (ETL/ELT)</li><li>Fabric Dataflows Gen2</li><li>Fabric Lakehouse (Bronze/Silver/Gold architecture)</li><li>Fabric Warehouse (SQL analytics engine)</li><li>OneLake (unified storage)</li><li>Fabric Notebooks (PySpark / Spark SQL)</li><li>Direct Lake mode for Power BI</li><li>Fabric KQL Database / Eventstream / Real-Time Hub</li><li>Fabric Shortcuts (cross‑workspace & multi-cloud virtualization)</li><li>Semantic Models</li><li>Data Activator (alerting / action triggers)<br>For ingestion, transformation, modeling, analytics, and real-time processing.</li></ul></li><li>Develop and optimize data ingestion, transformation, and analytical workflows for structured and unstructured data.</li><li>Design efficient data models to ensure optimal performance in data processing and storage.</li><li>Implement large-scale data ingestion pipelines capable of handling TBs of data.</li><li>Build distributed batch or real-time data solutions using <strong>Apache Kafka, Apache Airflow, Databricks</strong>, or Fabric Real-Time Hub components.</li><li>Build and maintain ETL/ELT pipelines for data integration and migration.</li><li>Work extensively with relational databases (PostgreSQL, MySQL, SQL Server) and NoSQL databases (MongoDB, CosmosDB, Cassandra, GraphDB).</li><li>Optimize SQL queries, performance tuning, indexing, partitioning, and denormalization strategies.</li><li>Collaborate with cross-functional teams, including data scientists and software engineers, to integrate data solutions into production environments.</li><li>Ensure data quality, integrity, governance, lineage, and compliance with security best practices.</li><li>Participate in client interactions and stakeholder meetings to gather requirements and provide technical insights.</li></ul></span> <strong>Required Skills & Qualifications</strong><span><ul><li>Bachelor’s/Master’s degree in Computer Science, Data Engineering, or a related field.</li><li><strong>4+ years of hands-on experience</strong> in data engineering, ETL development, and data pipeline implementation.</li><li><strong>Proficiency in Python and SQL</strong> for data processing and analysis.</li><li><strong>Strong expertise in Microsoft Fabric</strong> (Pipelines, Dataflows Gen2, Lakehouse, Warehouse, OneLake, Notebooks, Direct Lake, KQL Database, Real-Time Hub, Eventstream, Shortcuts, Semantic Models).</li><li>Experience with big data frameworks like <strong>Spark, Kafka, and Airflow</strong>.</li><li>Working knowledge of cloud data warehouse solutions such as Synapse, Snowflake, Redshift, or BigQuery.</li><li>Experience with NoSQL databases (MongoDB, CosmosDB, Cassandra, GraphDB) and relational databases.</li><li>Strong analytical and problem-solving skills.</li><li>Ability to work independently, mentor peers, and meet tight deadlines.</li><li>Excellent interpersonal and communication skills.</li><li>Experience with cloud-based data architecture and security best practices.</li><li><strong>Fabric certifications</strong> are a plus (DP‑600, DP‑700, Fabric Analytics/Data Engineer Associate).</li></ul></span> <strong>Preferred Qualifications (Nice to Have)</strong><ul><li><span style="font-size: inherit;">Experience with data lake architectures.</span></li><li><span style="font-size: inherit;">Knowledge of machine learning model deployment and data processing for AI applications.</span></li><li><span style="font-size: inherit;">Prior experience in automated data pipeline deployment using CI/CD workflows.</span></li></ul></span></span><span dir="ltr"><div style="border: 0px; font-style: inherit; font-variant: inherit; font-weight: inherit; font-stretch: inherit; font-size: 12pt; line-height: inherit; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size-adjust: inherit; font-kerning: inherit; font-feature-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: rgb(0, 0, 0); text-align: left; text-indent: 0px;"><span style="border: 0px; font-style: inherit; font-variant: inherit; font-weight: 700; font-stretch: inherit; font-size: inherit; line-height: inherit; font-family: inherit; font-size-adjust: inherit; font-kerning: inherit; font-feature-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: inherit;">Why Join Us:</span></div><ul><li style="border: 0px; font-style: inherit; font-variant: inherit; font-weight: inherit; font-stretch: inherit; font-size: 12pt; line-height: inherit; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size-adjust: inherit; font-kerning: inherit; font-feature-settings: inherit; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; padding: 0px; vertical-align: baseline; color: rgb(0, 0, 0); text-align: left; text-indent: 0px;">Young Team, Thriving Culture</li><li style="border: 0px; font-style: inherit; font-variant: inherit; font-weight: inherit; font-stretch: inherit; font-size: 12pt; line-height: inherit; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size-adjust: inherit; font-kerning: inherit; font-feature-settings: inherit; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; padding: 0px; vertical-align: baseline; color: rgb(0, 0, 0); text-align: left; text-indent: 0px;">Flat-hierarchical, friendly, engineering-oriented, and growth-focused culture.</li><li style="border: 0px; font-style: inherit; font-variant: inherit; font-weight: inherit; font-stretch: inherit; font-size: 12pt; line-height: inherit; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size-adjust: inherit; font-kerning: inherit; font-feature-settings: inherit; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; padding: 0px; vertical-align: baseline; color: rgb(0, 0, 0); text-align: left; text-indent: 0px;">Well-balanced learning and growth opportunities</li><li style="border: 0px; font-style: inherit; font-variant: inherit; font-weight: inherit; font-stretch: inherit; font-size: 12pt; line-height: inherit; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size-adjust: inherit; font-kerning: inherit; font-feature-settings: inherit; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; padding: 0px; vertical-align: baseline; color: rgb(0, 0, 0); text-align: left; text-indent: 0px;">Free health insurance.</li><li style="border: 0px; font-style: inherit; font-variant: inherit; font-weight: inherit; font-stretch: inherit; font-size: 12pt; line-height: inherit; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size-adjust: inherit; font-kerning: inherit; font-feature-settings: inherit; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; padding: 0px; vertical-align: baseline; color: rgb(0, 0, 0); text-align: left; text-indent: 0px;">Office facilities with a game zone, in-office kitchen with affordable lunch service, and free snacks.</li><li style="border: 0px; font-style: inherit; font-variant: inherit; font-weight: inherit; font-stretch: inherit; font-size: 12pt; line-height: inherit; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size-adjust: inherit; font-kerning: inherit; font-feature-settings: inherit; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; padding: 0px; vertical-align: baseline; color: rgb(0, 0, 0); text-align: left; text-indent: 0px;">Sponsorship for certifications/events and library service.</li><li style="border: 0px; font-style: inherit; font-variant: inherit; font-weight: inherit; font-stretch: inherit; font-size: 12pt; line-height: inherit; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size-adjust: inherit; font-kerning: inherit; font-feature-settings: inherit; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; padding: 0px; vertical-align: baseline; color: rgb(0, 0, 0); text-align: left; text-indent: 0px;">Flexible work timing, leaves for life events, WFH and hybrid options.</li></ul></span></div>