Machine Learning Platform Engineer at Absa Group Limited (Absa)

Job Summary

• This role provides an exciting opportunity to roll out a new strategic initiative within the Consumer Product Data space. Our ML Platform Engineers work closely with Machine Learning Engineers, Data Engineers, and Data Scientists and are responsible for creating and maintaining the ML Platform, with a large focus on Databricks and AWS (Amazon Web Services). The Platform team works to build the unified architecture to automate ML pipelines and model serving capabilities across teams in the space. The company is on the journey to move services from on-premises to the cloud. The technology stack includes, but is not limited to GitHub Enterprise, Terraform, AWS Services (EC2, S3, CloudWatch, Lambda, etc.), Elasticsearch, DataBricks, MongoDB, Kafka, Elasticsearch.

Job Description

• In this role you will have the opportunity of working directly across the firm with developers, operations staff, Data Engineers, Data Scientists, Architects, and business constituents to develop and enhance the ML Platform. 

Responsibilities 

• Maintain and enhance systems for the ML Platform 
• Integrating with Databricks 
• Building additional tooling to support model serving 
• Utilizing our CI/CD tools to automate processes 
• GitHub Actions, Jenkins 
• System architecture 
• Designing and testing new architectural patterns  
• Working with both on-premises and cloud infrastructure 

Requirements 

• Experience with CI/CD tools (GitHub Actions, Jenkins, Argo CD) 
• Experience with containerization (Docker, Rancher, Kubernetes and etc) 
• Programming skills in Python, Golang or Java 
• Strong problem-solving skills 
• Eagerness to learn innovative approaches and technologies 

Nice to have 

• Background in Computer Science, Engineering, Physics, Mathematics or equivalent 
• Experience with cloud technologies (AWS, Microsoft Azure, OpenStack etc.) 
• Understanding of modern Big Data technologies (Hadoop, Spark, Kafka, NoSQL etc.) 
• Experience with Databricks 

Education

• Bachelor's Degree: Information Technology