Data Engineer at Sanlam Group

What will you do?

Job Summary: 

• As a Data Engineer, you will lead the design and implementation of robust data pipelines and architectures. You will drive the development of data strategies, mentor junior team members, and ensure the scalability and efficiency of our data infrastructure. 

Responsibilities: 

• Lead the design and development of scalable data pipelines. 
• Architect and develop data solutions to support business requirements. 
• Ensure data governance and compliance with data policies. 
• Mentor and guide junior data engineers. 
• Stay updated with the latest industry trends and technologies. 
• Optimize and manage data storage solutions. 
• Define a structured approach to problem solving and delivery against it.
• Create role specific design standards, patterns, and principles.
• Assist and advise the planning and management of the workload of the team.
• Taking a lead in analytical and information layer design solutions and provide guidance to other data engineers in the team.
• Engage with a wide range of technical stakeholders including data scientists, data analysts, business analysts, other data engineers and solutions architects.

Qualifications: 

• Bachelor’s or Master’s degree in Computer science, Information Systems, Informatics, Statistics, Engineering, Mathematics, or a related field. 
• 5+ years of experience in data engineering or a related field. 
• Expert in SQL and advanced data warehousing techniques. 
• Extensive experience with Python or other programming languages. 
• Proficiency with big data technologies such as Hadoop, Spark, or Kafka. 
• Understanding of data warehousing principles (e.g. Kimball and Vault).
• Experience in working in an agile environment.
• Knowledge of database management system (DBMS) physical implementation, including tables, joins and SQL querying.
• Experience in Database technologies (e.g. SAP Hana and Web IDE, or similar) or Hadoop components including HDFS, Hive, Spark, Oozie and Impala preferred and highly advantageous.

What will make you successful in this role?

Knowledge and Skills

• Development of data warehousing blueprints.
• Data warehouse management
• Translates business needs into long-term architecture solutions
• Defines, designs and builds dimensional databases
• Object and data models

Personal Attributes

• Interpersonal savvy - Contributing through others
• Decision quality - Contributing through others
• Plans and aligns - Contributing through others
• Optimises work processes - Contributing through others