Cloud Data Engineer at Vito Solutions

JOB OVERVIEW:

• Our client is looking for an experienced and driven Cloud Data Engineer to become part of their vibrant data engineering unit. The successful candidate's responsibility will involve utilising their technical expertise to integrate software, systems, and data, deriving valuable insights from unprocessed data. They'll work closely with data scientists, analysts, and various stakeholders to guarantee data accessibility, accuracy, and peak efficiency.

DESCRIPTION OF POSITION:

Client and Requirement Analysis

• Comprehend and assess client demands and operational necessities.
• Recognise, scrutinise, visualise, and grasp underlying data to suggest robust resolutions.

Design and Development

• Create and construct data tiers to drive Big Data analysis.
• Plan and build data integration frameworks and guarantee effective data retrieval, transformation, and loading from diverse origins.
• Create and maintain technical documentation.
• Support existing solutions within GCP and Oracle.
• Examine requirements and data, crafting data repository, and product strata.
• Develop, test, and ensure the quality of data pipelines and layers.
• Conduct peer evaluations and adhere to the Software Development Life Cycle (SDLC) procedures and documentation guidelines.

Team Collaboration and Support

• Engage proactively with the product team and offer cross-training and mentorship.
• Provide timely status updates to the team.
• Log change requests and accurately log time.
• Participate in standby rotation.
• Be a cooperative team member; consistently work together, interact socially, and stay involved with your product team and the broader team.

Quality and Efficiency

• Responsible for the delivery of value and quality solutions.
• Drive ticket progress and ensure timely resolution.

Operational Management

• Manage GCP costs and IT responsibilities.
• Guarantee the effective development of infrastructure necessary for the optimal extraction, transformation, and loading of data from diverse sources.

KNOWLEDGE AND SKILLS:

• Ownership and responsibility.
• Strong problem-solving and critical-thinking skills.
• Effective planning and organisational abilities.
• Detail-oriented with excellent communication skills.
• Ability to manage multiple tasks and adapt to changing priorities in a fast-paced environment
• Curiosity and interest in analysing problems and solutions.
• Strong teamwork capabilities.
• Self-driven and passionate about new technology.
• Knowledge of cloud platforms (e.g. AWS, Azure, Google Cloud) and their data services.

QUALIFICATIONS REQUIRED:

• Bachelor's Degree in Computer Science, Information Technology, Engineering, or a related field.

EXPERIENCE REQUIRED:

• 3 - 5 years of data warehouse, ETL experience.
• Experience with Google Cloud Platform.
• Proficiency in SQL and experience with relational databases (e.g. BigQuery, PostgreSQL, MySQL, SQL Server).
• Experience with dimensional modelling and data analysis.
• Preferred experience with data visualisation tools and the retail industry.
• Understanding of version control (SVN/GIT) and proficiency in programming languages such as Python, Java, Korn shell scripting, and SQL.
• Broad understanding of different SDLCs.
• Exposure to Agile methodologies.