I am currently working in partnership with a consulting firm who are looking for a Data Engineer to work with a Banking client.
They are looking for a Data Engineer with expertise in Azure Data Factory & Databricks to develop and deliver solutions - You'll also ensure code and design quality through the execution of test plans.
Key Skills:
- Expertise in Azure Data Factory & Azure components like Data lake Store, SQL Database, Databricks
- Working knowledge of spark programming
- Strong knowledge of CICD Process w/ Experience in designing, developing, and deploying pipelines to higher environments
- Strong knowledge in SQL queries and working knowledge with GIT, SVN
- Good experience in establishing connections with sources like Hadoop, Hive, Amazon, Azure, Salesforce, SAP, HANA, API's, various Databases, etc.
- Any experience related to metadata management, data modelling, and related tools is preferable.
