Key Objectives of the Job:
Developing modern Data platform
Manage deliveries for data Engineering, EDW and Data Lake platform.
Maintain robust data catalogue.
Manage Azure cloud platform for Data and Analytics
Specialized job competencies:
- Experience in developing modern Data platform, data lake
- Experience in development of large-scale enterprise data warehouse and data lake solution
- Strong written and oral communication skills
- Knowledge in BFSI domain will be added advantage.
- Design and develop batch data pipelines independently to enable faster business analysis.
- Working Experience in Microsoft Azure cloud and preferably component: Azure data lake, Azure data factory, Databricks, Delta Lake
- 2+ Exp in writing complex Pyspark jobs , SQL queries/procedures/Views/Functions and database objects
- Experience working with big data frameworks especially databricks
- Nice to have Talend/ SSIS knowledge.
- Azure admin knowledge will be added advantage.
- Proficient understanding of code versioning tools.
- Excellent analytical and organisational skill
