Data Engineer - (12 month contract)
Krypton Mining, South Africa

We are looking for an experienced, technology focussed Data Engineer to join our team. Data Engineer will need to design, configure, develop and deploy data transformations.You will use various methods to transform raw data into useful data systems.

• Develop ETL pipelines. The data transformations will be developed in Azure Databricks using Python and on Azure SQL using T-SQL and deployed using ARM templates
• Work in a fluid environment with changing requirements whilst maintaining absolute attention to detail.
• Build stream pipelines leverage IoT Hub, Event Hub, Databricks streaming and other Azure stream technologies.
• Build transformation pipelines into dimensions and facts and therefore a strong knowledge of standard BI concepts is mandatory
• Serve data for application and analytics through a variety of technologies such as SQL, Server Synapse, CosmosDB and TSI
• Combine and curate data in a central data lake

Requirements

• Minimum 5 years in a data-centric environment working in either SQL Data-Warehousing,
• Analytics or as a dedicated Data-Modeller.
• Above average TSQL and SQL server skills.
• Logical, and Physical Data-Modelling Expertise.
• Experience with Forward and Reverse Engineering of Existing Databases.
• Good understanding of Star Schemas, Snowflake Schemas, and Kymbal Methodology.
• Skilled at formulating Dimensions, measures and attributes and building multi-dimensional
  models.
• Experienced with metadata-modelling.
• Experience with Data-Governance principles and Data-Cleansing.
• Experienced at key-formulation: primary keys, foreign-keys, alternate-keys, surrogate-keys,
  indexes, delta-control.
• Experience of working with Data-Modelling tools. Some exposure to Cloud computing.
• Exposure to mining production and operations data would be beneficial

Job Rewards and Benefits