Senior Databricks Engineer
This position offers you the opportunity to join a fast-growing technology organization that is redefining productivity paradigms in the software engineering industry. Thanks to our flexible, distributed model of global operation and the high caliber of our experts, we have enjoyed triple digit growth over the past five years, creating amazing career opportunities for our people. If you want to accelerate your career working with like-minded subject matter experts, solving interesting problems and building the products of tomorrow, this opportunity is for you.
Position Overview
We are seeking an experienced Sr Databricks Engineer to join our growing data engineering team. This role will be instrumental in designing, developing, and maintaining our enterprise-level data platform using Databricks to support critical banking operations and analytics initiatives.
Key Responsibilities
- Design, develop, and optimize data pipelines using Databricks and Apache Spark
- Build scalable ETL/ELT processes to ingest, transform, and deliver data from various banking systems
- Implement data lakehouse architecture using Delta Lake for reliable data storage and processing
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements
- Optimize Databricks cluster configurations and query performance for cost efficiency
- Develop and maintain data quality frameworks and monitoring solutions
- Implement security best practices and ensure compliance with banking regulations (PCI-DSS, SOX, GDPR)
- Create and maintain technical documentation for data workflows and processes
- Mentor junior engineers and promote best practices in data engineering
- Participate in code reviews and contribute to continuous improvement initiatives
Required Qualifications
- Bachelor's degree in Computer Science, Engineering, or related field
- 5+ years of experience in data engineering or related roles
- 3+ years of hands-on experience with Databricks platform
- Strong proficiency in Apache Spark (PySpark/Scala)
- Expert-level SQL skills and experience with large-scale data processing
- Experience with Delta Lake and data lakehouse architectures
- Solid understanding of cloud platforms (AWS, Azure, or GCP)
- Experience with banking or financial services data and regulatory requirements
- Knowledge of data modeling, data warehousing concepts, and dimensional modeling
- Strong problem-solving skills and attention to detail
Preferred Qualifications
- Databricks certification (Data Engineer Associate or Professional)
- Experience with real-time streaming data processing (Kafka, Event Hubs)
- Knowledge of MLOps and ML model deployment on Databricks
- Experience with Infrastructure as Code (Terraform, CloudFormation)
- Familiarity with CI/CD pipelines and DevOps practices
- Experience with data governance tools and frameworks
- Knowledge of Python libraries for data processing (Pandas, NumPy)
- Understanding of banking products, risk management, or fraud detection systems
Technical Skills
- Databricks Platform & Unity Catalog
- Apache Spark (PySpark, Spark SQL, Scala)
- Delta Lake & Data Lakehouse Architecture
- SQL & NoSQL Databases
- Cloud Platforms (AWS/Azure/GCP)
- Python & Scala Programming
- Git & Version Control
- Data Orchestration Tools (Airflow, Azure Data Factory)
- Data Visualization Tools (Power BI, Tableau)
What We Offer
- Competitive salary and performance-based bonuses
- Comprehensive health, dental, and vision insurance
- 401(k) with company match
- Professional development and certification opportunities
- Flexible work arrangements
- Collaborative and innovative work environment
- Opportunity to work on cutting-edge data technologies in the banking sector
About Parser
Parser is a forward-thinking banking company committed to leveraging data and technology to deliver exceptional financial services. We foster a culture of innovation, collaboration, and continuous learning, empowering our teams to drive meaningful impact in the financial industry.
Parser is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
