We are looking for an experienced Senior Data Engineer to join our team. You will need to design, configure, develop and deploy data transformations.
Responsibilities
- Develop ETL pipelines. The data transformations will be developed in Azure Databricks using Python and on Azure SQL using T-SQL and deployed using ARM templates\
- Work in a fluid environment with changing requirements whilst maintaining absolute attention to detail.
- Build stream pipelines leverage IoT Hub, Event Hub, Databricks streaming and other Azure stream technologies.
- Build transformation pipelines into dimensions and facts and therefore a strong knowledge of standard BI concepts is mandatory
- Serve data for application and analytics through a variety of technologies such as SQL, Server Synapse, CosmosDB and TSI
- Combine and curate data in a central data lake
Requirements
- Previous experience as a data engineer or in a similar role using Data Lake, Data Modeling, Data Architecture, Azure Data Environment
- Industry related qualification