Data Engineer at Vito Solutions

JOB OVERVIEW:

• Our client is looking for an experienced and driven Data Engineer to become part of their vibrant data engineering unit.
• The successful candidate's responsibility will involve utilising their technical expertise to integrate software, systems, and data, deriving valuable insights from unprocessed data.
• They'll work closely with data scientists, analysts, and various stakeholders to guarantee data accessibility, accuracy, and peak efficiency.

DESCRIPTION OF POSITION:

Client and Requirement Analysis

• Comprehend and assess client demands and operational necessities.
• Recognise, scrutinise, visualise, and grasp underlying data to suggest robust resolutions.

Design and Development

• Create and construct data tiers to drive Big Data analysis.
• Plan and build data integration frameworks and guarantee effective data retrieval, transformation, and loading from diverse origins.
• Create and maintain technical documentation.
• Support existing solutions within GCP and Oracle.
• Examine requirements and data, crafting data repository, and product strata.
• Develop, test, and ensure the quality of data pipelines and layers.
• Conduct peer evaluations and adhere to the Software Development Life Cycle (SDLC) procedures and documentation guidelines.

Team Collaboration and Support

• Engage proactively with the product team and offer cross-training and mentorship.
• Provide timely status updates to the team.
• Log change requests and accurately log time.
• Participate in standby rotation.
• Be a cooperative team member; consistently work together, interact socially, and stay involved with your product team and the broader team.

Quality and Efficiency

• Responsible for the delivery of value and quality solutions.
• Drive ticket progress and ensure timely resolution.

Operational Management

• Manage GCP costs and IT responsibilities.
• Guarantee the effective development of infrastructure necessary for the optimal extraction, transformation, and loading of data from diverse sources.

KNOWLEDGE AND SKILLS:

• Ownership and responsibility.
• Strong problem-solving and critical-thinking skills.
• Effective planning and organisational abilities.
• Detail-oriented with excellent communication skills.
• Ability to manage multiple tasks and adapt to changing priorities in a fast-paced environment
• Curiosity and interest in analysing problems and solutions.
• Strong teamwork capabilities.
• Self-driven and passionate about new technology.
• Knowledge of cloud platforms (e.g. AWS, Azure, Google Cloud) and their data services.

QUALIFICATIONS REQUIRED:

• Bachelor's Degree in Computer Science, Information Technology, Engineering, or a related field.

EXPERIENCE REQUIRED:

• 4 - 6 years of data warehouse ETL experience.
• Experience with Google Cloud Platform.
• Proficiency in SQL and experience with relational databases (e.g. PostgreSQL, MySQL, SQL Server).
• Experience with dimensional modelling and data analysis.
• Preferred experience with data visualisation tools and the retail industry.
• Understanding of version control (SVN/GIT) and proficiency in programming languages such as Python, Java, Korn shell scripting, and SQL.
• Broad understanding of different SDLCs.
• Exposure to Agile methodologies.