Senior Data Engineer at Apex Group

Role purpose

• As a Senior data engineer, you will be a driving force towards data engineering excellence.
• Working with other data engineers, analysts, and the architecture function, you’ll be involved in the building out of a modern data platform using a number of cutting-edge technologies, and in a multi cloud environment,
• You’ll get the opportunity to spread your knowledge and skills across multiple areas, with involvement in a range of different functional areas.
• As the business grows, we want our staff to grow with us, so there’ll be plenty of opportunity to learn and upskill in areas such as data pipelines, data integrations, data preparation, data models, analytical and reporting marts.

Also, whilst work is often following business requirements and design concepts​, you’ll play a huge part in the continuous development and maturing of design patterns and automation process for others to follow​.

Accountabilities and main responsibilities
In this role, you will be delivering solutions and patterns through Agile methodologies as part of a squad. You’ll be collaborating with customers, partners and peers, and will help to identify data requirements. We’d also rely on you to:

• Contribute to defining the prioritisation of your squad’s backlog​
• Contribute to the continuous development and maturing of design patterns for others to follow​
• Pick the most appropriate tool, method and design pattern in order to satisfy the requirement ​
• Prepare our data in order to surface it for use within APIs​
• Provide guidance and training to other squad members
• Help design the documentation structures, support processes, and management techniques of maintaining a modern data platform
• Provide guidance and training to downstream consumers of data on how best to use the data in our platform
• Design, support and Build new data APIs

Qualifications and skills
Technical Skills:

• Modern, public Cloud based Data Platforms and Lambda Architecture​ (Azure/AWS)
• Microservices, API and Event Driven Architecture​
• Data Warehousing and Data Modelling​
• CI/CD Pipelines and Large-scale data deployments
• Data Lakes (AWS Lake Formation, Azure Data Lake)
• Cloud Data Warehouses (AWS Redshift, Azure Synapse, Snowflake)
• ETL/ELT/Pipeline tools (AWS Glue, Azure Data Factory, FiveTran, Stitch) ​
• Data Message Bus/Pub Sub systems (AWS SNS & SQS Azure ASQ, Kafka, RabbitMQ)
• Data Programming languages (SQL, Python, Scala, Java) ​
• Cloud Workflow Service (AWS Step Functions, Azure Logic Apps, Camuda)
• Interactive Query Services (AWS Athena, Azure DL Analytics)
• Event and schedule management (AWS Lambda Functions, Azure Functions)
• Traditional Microsoft BI Stack (SQLServer, SSIS, SSAS, SSRS)​
• Reporting and visualisation tools (Power BI, QuickSight, Mode​)
• Data Governance Concepts and methodologies (Desirable)
• NoSQL & Graph DBs (AWS Neptune, Azure Cosmos, Neo4j) (Desirable)
• API Management (Desirable)

Core Skills:

• Excellent communication and interpersonal skills​
• Critical Thinking and research capabilities
• Strong problem-solving skills
• Ability to plan, and manage your own work loads​
• Work well on own initiative as well as part of a bigger team
• Strong ability to train others within your squad
• Familiar with agile methodologies and experience in working in that way​
• High level of Data Literacy
• Competent in design patterns and data flows