Company Description
Overview
We're seeking a
Senior Data Engineer to design, build, and maintain data pipelines that enable reliable data movement and transformation across enterprise platforms. In this role, you will work with
Python, Snowflake, and Azure Synapse Analytics to extract, transform, integrate, and deliver data to downstream systems. You'll collaborate with data analysts, business stakeholders, and technology teams to ensure scalable, secure, and high-quality data solutions that support business objectives.
Responsibilities
Your Impact
- Design, develop, and maintain robust data pipelines using Python to extract data from Snowflake and Azure Synapse Analytics and transform it for target systems.
- Implement efficient ETL processes, ensuring accurate, reliable, and scalable data movement across platforms.
- Collaborate with stakeholders to understand source systems, target systems, and business requirements, translating them into effective data pipeline solutions.
- Write clean, optimized, and scalable code capable of processing large data volumes while maintaining performance and reliability.
- Monitor, troubleshoot, and optimize data pipeline performance, resolving bottlenecks, failures, and data quality issues.
- Define and implement data transformation logic, including cleansing, filtering, aggregation, normalization, and standardization of data.
- Develop data mapping and schema conversion processes to ensure consistency and compatibility between systems.
- Establish and maintain connectivity with Snowflake and Azure Synapse Analytics through APIs, database connectors, and other integration methods.
- Integrate and synchronize data from multiple sources while maintaining consistency, accuracy, and data integrity.
- Partner with IT and platform teams to implement secure data transfer mechanisms aligned with governance and compliance requirements.
- Develop error handling and exception management processes to ensure resilience and reliability across data integrations.
- Document pipeline architecture, transformation rules, source specifications, and target system requirements.
- Collaborate with cross-functional teams including data analysts, data scientists, and business stakeholders to support data-driven initiatives.
- Participate in planning discussions and technical reviews to align data engineering activities with business goals.
- Stay current with emerging technologies, tools, and best practices in data engineering and recommend process improvements where appropriate.
Qualifications
Skills & Experience
- Strong proficiency in Python programming.
- Experience building and maintaining data pipelines and ETL processes.
- Hands-on experience with Snowflake and Azure Synapse Analytics, including data extraction methods such as APIs and database connectors.
- Knowledge of data transformation techniques and tools.
- Experience using Python data processing libraries and frameworks, including Pandas, NumPy, and/or PySpark.
- Strong understanding of database systems and SQL querying.
- Experience with data integration and synchronization across multiple systems.
- Familiarity with data governance and compliance principles.
- Strong analytical and problem-solving skills.
- Excellent collaboration and communication abilities.
- High attention to detail and experience working with large-scale datasets.
Set Yourself Apart With
- Experience optimizing high-volume data processing workflows and pipeline performance.
- Expertise in designing scalable data transformation frameworks.
- Strong understanding of schema mapping, data validation, and data quality controls.
- Experience implementing secure and compliant enterprise data transfer solutions.
- Ability to collaborate effectively across engineering, analytics, and business teams.
- Passion for continuous improvement and adoption of modern data engineering best practices.
Additional Information
- An inclusive workplace that promotes diversity and collaboration.
- Access to ongoing learning and development opportunities.
- Competitive compensation and benefits package.
- Flexibility to support work-life balance.
- Comprehensive health benefits for you and your family.
- Generous paid leave and holidays.
- Wellness program and employee assistance.
As part of our dedication to an inclusive and diverse workforce, Publicis Sapient is committed to Equal Employment Opportunity without regard for race, color, national origin, ethnicity, gender, protected veteran status, disability, sexual orientation, gender identity, or religion. We are also committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, you may contact us at [email protected]
