Data Engineer at FirstRand Group

Job Description

To ensure effective movement, collection, integration, storage, and provisioning of data to meet business objectives through sound understanding of business unit requirements and frequent collaboration with relevant stakeholders (such as Enterprise Architecture, Database and Solution Architects, Business Intelligence Developers, Data Scientists and Product Owners, etc.)

• Control expenditure and identify process improvements to contain and reduce costs.
• Build working relationships across teams and functional lines to enhance work delivery, collaboration, and innovation.
• Conduct research on emerging technologies.
• Recommend and implement technologies that improve cost effectiveness and systems flexibility.
• Confer with end users, clients, or senior management to understand business requirements for complex development or enhancements Assist with gap analysis and business cases including cost and effort analysis.
• Conduct hands-on work related to profiling, documenting, and validating the clients.
• Execute remediation actions as agreed with client Install or update required system components.
• Implement the necessary components and frameworks required for automated deployments and task scheduling.
• Build unit and systems tests to ensure successful delivery of components into production.
• Manage the user acceptance testing UAT and associated signoff through change control.
• Acquire and collect data via ETL (Extract, Transform and Load) processes from source systems into the Reservoir and Enterprise Data warehouse, adhering to the appropriate data platform standards.
• Integrate data from multiple sources through the enterprise data platform architecture to meet the business objective.
• Develop and maintain the physical data marts and databases.
• Automate tasks related to data pipelines for the deployment of operational analytics.
• Prepare and provision data for advanced analytical modelling by data scientists (as and when applicable).
• Perform data quality assessments and introduce monitors and alerts to ensure data quality is maintained throughout all managed systems.
• Create change scripts and sets scripts up to be ready and implemented in production.
• Participate in architecture forum (as and when required).
• Utilise various components and tools which make up the data platform for enhanced service delivery.
• Work with Senior Engineer to present technology solutions to senior leadership and influence architectures that will lead the transformation of our IT data analytics platform.
• Learn from the Subject Matter Expert on technical environment or tools for own area of expertise.
• Provide Analytic infrastructure or big data technologies related support to Data operations and Analytic teams.
• Grow online technical knowledge platform, identify best practices, and develop guidelines for optimum usage of tools.
• Assist and work on projects to roll out and support to team members.
• Participate in planned activities that are appropriate for own development.
• Develop, encourage, and nurture collaborative relationships across area of specialisation.

Qualification

• Degree/Diploma in Computer Sciences or related

Required Skills and Experience

• 3 to 5 years’ experience in a similar environment, of which 1 - 2 years ideally at a junior specialist level
• Experience with Extract, Transform and Load (ETL)
• Experience with Big Data and related platforms (Hadoop)
• Experience in data integration for consumption use cases.
• Experience with Ab Initio is advantageous.
• DBA experience advantageous.
• Technical skills (e.g., Code development, translate Business Requirements into technical requirements and produce technical requirements specifications documentation)
• Business understanding (e.g., Understanding context to requests such as objectives and questions to be answered)
• People skills in relation to stakeholder management
• Leadership skills
• Strategic thinking/organizational awareness

Required Skills:

• ETL
• Hadoop (Hive)
• SQL querying and administration (Teradata advantageous)
• Ab Initio advantageous