Data Engineer - Centurion at AVBOB South Africa

Description

This role will be responsible to build and model a robust, fault-tolerant data pipeline that cleans, transforms, and aggregates structured and unstructured data into data lakes/warehouse, databases and data sources. The role will work in an agile environment, both in business as usual and project-based team structure, coordinating with ICT team, data scientist/s and data analysts to respond to business requirements by developing and deploying analytical solutions.

Data Strategy

• Assisting in the implementation of a short, medium and long-term Data Analytics strategy related to the specific scope of work that is aligned to the overall AVBOB Data & Analytics strategy.
• Assisting in the implementation of the overall Data & Governance Strategy

Data Engineering

• Liaising with the Chief Data Officer / Data Business Partners /project manager/s / business stakeholders to understand business data requirements in relation to the business objectives and maximizing value of data initiatives.
• Developing an expert understanding of the business’ core operations and related systems and data assets.
• Understanding the appropriate data sets required by business to develop simple models by developing initial drafts
• Providing up-to-date expertise and apply to the development, execution, and improvement of action plans.
• Monitoring the overall performance and stability of data systems and ensure cleaning of data warehouse from time-to-time.

Operations

• proactively implement the standard Data Office guidelines, policies, practices and procedures when developing any solution.

Risk, Governance and Compliance

• Pro-actively keep up to date with required legislative, governance and compliance requirements relating to privacy, security such as POPIA
• Ensuring full compliance with corporate governance, financial and statutory requirements related to data security and data retention and deletion.
• Ensure compliance with established internal control procedures and authority levels.
• Ensuring that exposure to business risks is managed and mitigated through the adoption of effective actions and measures

Teamwork

• Ensuring that SLAs and key success metrics for own work is defined, measured and managed across all data visualisation activities, as required.

Requirements

• Relevant graduate or post-graduate degree (with specific reference to Computer Science, Data Engineering, Business Mathematics and Informatics, Information Technology or related field)
• Successful completion of one or more technical skills assessments
• Prior experience in working with data warehouse, lakes and/or cloud solutions
• At least 4+ years’ experience in data engineering or related fields

KNOWLEDGE, TECHNICAL AND BEHAVIOURAL COMPETENCIES

• Strong analytical and critical thinking.
• Problem solving and attention to detail.
• Communication and collaboration skills.
• Data Source Identification - Functional business domain and scenarios. Categories of data and where it is held. Business data requirements. Database technologies and distributed data stores (e.g. SQL, NoSQL).
• Data Transformation and Integration - Data sources, internal and external. Data extraction software. Data processing techniques. Cloud and big data environments
• Data Modeling - Cloud data strategy, data warehousing, data lake, and big data platforms. Data modeling techniques and tools (For example, Dimensional design and scalability, Entity Relationship diagrams). Database programming languages SQL / NoSQL.
• Code Development and Testing - Coding languages like SQL, Java, C+ and others. Testing methods like static, dynamic, software composition analysis, manual penetration testing.
• Data Governance - Data value chains. Data processes and practices. Regulatory and ethical requirements around data.