Snowflake Data Engineer at Intellinexus

What you will do:

The Data Engineer will work collaboratively with the Project Managers, Data Scientists, Systems Architects to define data sources, data ingestion, modelling and reporting artefacts as defined in a custom data framework. Together these teams will enable data driven actionable insights.

Core responsibilities include:

• Work within a highly specialized and growing team to enable delivery of data and advanced analytics system capability
• Develop and implement a reusable architecture of data pipelines to make data available for various purposes including Machine Learning (ML), Analytics and Reporting
• Work comfortably with structured and unstructured data in a variety of different programming languages such as SQL, R, python, Java etc
• A solid experience and understanding of architecting, designing and operationalization of large-scale data and analytics solutions on Data Warehouse is a must
• Provide support for Data Warehouse issues such as data load problems etc.
  Understanding data pipeline requirements and which tools to leverage to get the job done
• Testing and clearly documenting implementations, so others can easily understand the requirements, implementation, and test conditions
• Build data solutions that leverage controls to ensure privacy, security, compliance, and data quality
• Understand meta-data management systems and orchestration architecture in the designing of pipelines
• System integration skills between Business Intelligence and source transactional

Qualification & Experience:

• Honours or Masters degree in BSc Computer Science or Engineering or Software Engineering
• Minimum 2 years of developing a fully operational production grade large scale data solution
• 4 years of hands on experience with building productized data ingestion and processing pipelines using standard data pipeline techniques (Spark, Python, ADF, etc..)
• 2 years of hands-on experience designing and implementing production grade data warehousing solutions on large scale data technologies such as SQL Server, Teradata, Oracle or DB2
• Excellent presentation and communication skills, both written and verbal
• Ability to problem solve and architect in an environment with unclear requirements
• Cloud experience a bonus