Data Engineer

<h3><strong>Job Title:</strong> Data Engineer</h3><p><strong>Experience:</strong> 5–10 Years.<br><strong>Location:</strong> Pan India<br><strong>Joining Time:</strong> Immediate to 15 Days Maximum</p><hr><h3><strong>About

the Role:

</strong></h3><p>Indus Net Technologies is looking for an experienced <strong>Data Engineer</strong> to design, build, and maintain robust data pipelines leveraging <strong>Databricks</strong> and <strong>Azure Cloud Services</strong>. The ideal candidate will have hands-on expertise in processing large-scale <strong>IoT sensor data</strong> from manufacturing equipment, ensuring data quality, integrity, and high performance across multi-plant operations.</p><hr><h3><strong>Key

Responsibilities:

</strong></h3><p>Design and implement <strong>ETL/ELT pipelines</strong> using <strong>Databricks</strong> and <strong>PySpark</strong>.</p><p>Process and transform <strong>real-time IoT sensor data</strong> from multiple manufacturing plants.</p><p>Manage <strong>data storage, versioning, and optimization</strong> using <strong>Delta Lake</strong>.</p><p>Integrate data from diverse sources (SQL Server, JSON, CSV, APIs, etc.).</p><p>Write and optimize complex <strong>SQL queries</strong> and stored procedures for performance.</p><p>Implement <strong>data quality monitoring</strong>, testing, and <strong>CI/CD pipelines</strong> using <strong>Azure DevOps</strong>.</p><p>Collaborate closely with manufacturing and analytics teams to deliver actionable IoT data insights.</p><hr><h3><strong>Top 4 Mandatory

Skills:

</strong></h3><p><strong>Databricks & Apache Spark (PySpark)</strong> – Minimum 3 years of hands-on experience</p><p><strong>Azure Cloud Services</strong> – Experience with ADF, Blob Storage, and DevOps</p><p><strong>Python</strong> – Advanced proficiency with OOP concepts, pandas, and robust error handling</p><p><strong>Delta Lake</strong> – Strong knowledge of data versioning, time travel, and optimization</p><hr><h3><strong>Good-to-Have

Skills:

</strong></h3><p>Advanced <strong>SQL</strong> and stored procedure development</p><p>Experience in <strong>JSON data processing</strong> and schema handling</p><p><strong>Git-based version control</strong> and CI/CD integration using <strong>Azure DevOps</strong></p><p>Exposure to <strong>manufacturing or industrial IoT data patterns</strong></p><hr><h3><strong>Preferred Domain Knowledge:</strong></h3><p><strong>Industrial IoT</strong> and time-series data management</p><p><strong>Machine data</strong> and equipment performance monitoring</p><p><strong>Multi-plant data integration</strong> and central data architecture</p><p><strong>Data quality frameworks</strong>, downtime, and defect analytics</p><hr><h3><strong>Qualifications:</strong></h3><p>Bachelor’s degree in <strong>Computer Science</strong>, <strong>Engineering</strong>, or a related field</p><p>4–6 years of proven experience in Data Engineering</p><p>2+ years of strong exposure to <strong>Databricks/Spark ecosystem</strong></p><p><strong>Azure Data Engineer Associate</strong> or <strong>Databricks certification</strong> is preferred</p><hr><h3><strong>Soft

Skills:

</strong></h3><p>Excellent communication skills in English (written and verbal)</p><p>Strong analytical and problem-solving mindset</p><p>Collaborative and proactive approach with cross-functional teams</p><p>High attention to detail and commitment to data accuracy</p>