Principal Engineer (Data Platform)

As Principal Engineer, Data Platform you will be responsible for leading the hands-on engineering for real time and batch data pipelines. Data software engineering includes designing, building, testing data pipelines; specifying configuration and infrastructure, automating deployment, implementing monitoring, and ensuring production reliability. As a Staff Engineer you are expected to provide proven expertise in the big data domain, and provide technical leadership for data software engineering team. Additionally, you will be responsible for mentoring more junior engineers and aid in facilitating daily stand-ups.

Responsibilities

• Design real time and batch pipeline according to business data requirements and service level objectives
• Specify data platform components and configurations required for data pipeline implementation
• Baseline pipeline performance to achieve scalability
• Implement data pipeline metrics to monitor performance, accuracy
• Identify, prioritize, and execute pipeline improvements
• Partner with feature team engineering, data science, and external data partners to enable business deliverables
• Lead engineering for standardized data services layer
• Partner with Release automation engineering for deployment pipelines
• Partner with QA automation engineering to validate pipelines
• Troubleshoot systemic issues and lead improvements

• Bachelor or Masters in Computer Science or relevant field
• 8+ years' experience, including team leadership
• Excellent understanding of real time and batch pipelines, big data, data pipelines, and/or data lakes
• An analytical mindset with problem-solving skills
• Excellent communication and collaboration skills
• Ability to understand business domain and translate to data platform services

Position Reports to: Director, Data Platform Engineering

http://vimeo.com/100316082

Contact: 

Scott Schoenberger