- Design, develop, and maintain efficient data pipelines to process data from multiple sources, supporting real-time and batch data requirements
- Implement ETL/ELT processes for data ingestion, transformation, and storage that align with the business unit needs / requirements as well as Corporate IT standards
- Help integrate data from various sources, including third-party systems and ERP data, ensuring seamless flow between the business unit and Corporate IT infrastructure
- Assist in implementing data validation and monitoring tools to maintain data accuracy, consistency, and reliability across the platform
- Support the Senior Data Architect in implementing scalable data models and optimizing pipeline performance
- Create and update documentation for data flows, transformations, and processes to ensure transparency and compliance with corporate standards
- Identify opportunities to enhance pipeline efficiency and reduce latency, especially for real-time data applications
- Perform data analysis and reporting to assist in operational decision-making and performance optimization
- Ensure data processes and pipelines comply with Corporate IT’s data governance, security, and compliance standards
- Stay updated with industry trends and implement new technologies to enhance data infrastructure
Provide mentorship and support to Junior Data Engineers
