Senior Data Engineer at Sanlam Group

What Will You Do?
The Senior Data Engineer is responsible for sourcing, loading, and managing data across the organization. They will collaborate with analysts and developers to develop effective data solutions for business challenges. The role involves designing and developing data pipelines, ensuring data quality and consistency, and working with security and infrastructure teams to ensure secure and scalable data pipelines. Troubleshooting technical issues and providing solutions aligned with best practices are essential. Additionally, this role involves mentoring and developing a team of data engineers and understanding the strategic value of data within the organization.

This is a challenging and rewarding role for a highly motivated and skilled data engineer with a passion for building innovative data solutions.

What will make you successful in this role?

• Provide technical leadership, mentorship for junior engineers.
• Manage workload and contribute to the team's success.
• Resolve issues and provide escalation support for the team.
• Design and enhance data ingestion frameworks for reliable data loading.
• Load large, complex datasets and make them available to data engineers.
• Collaborate with subject matter experts to source data from various sources.
• Build efficient ETL infrastructure using relevant 'big data' technologies.
• Identify and implement process improvements.
• Engage with stakeholders, including data scientists and business analysts.
• Support dynamic solution requirements.
• Promote data stewardship and compliance with guidelines.
• Mentor and guide junior data engineers.

Qualification:

• Matric
• National Diploma in an IT-related discipline or bachelor’s degree in computer science, Statistics, Informatics, Information Systems, or any quantitative field (preferred).

Experience:

• Minimum of 5 years' experience as a Data Engineer in a BI environment.
• Experience with agile development methodologies.

Knowledge:

• Excellent SQL skills and experience in SQL development with procedural extensions.
• Proficiency in ETL toolsets, particularly Nifi.
• Strong background in data engineering with a focus on high-quality data staging.
• Sound knowledge of database technologies such as SAP Hana, Teradata, or similar, and experience with Hadoop components including HDFS, Hive, Spark, Oozie, and Impala.
• Proficiency in object-oriented/functional/scripting languages like Python, Unix Shell scripting, Java, Scala, etc.
• Understanding of data warehousing principles, such as Kimball and Vault.
• Familiarity with handling semi-structured data (e.g., JSON, Avro)

Personal Attributes:

• Manages complexity - Contributing through others
• Plans and aligns - Contributing through others
• Tech savvy - Contributing through others
• Nimble learning - Contributing through others
• Strategic mindset - Contributing through others
• Communicates effectively - Contributing through others
• Action orientated - Contributing through others

Core Competencies:

• Collaborates - Contributing through others
• Being resilient - Contributing through others
• Cultivates innovation - Contributing through others
• Customer focus - Contributing through others
• Drives results - Contributing through others