Azure Integration Software Engineer - Cape Town at CDW

Key responsibilities

• CDW is undergoing a roll out of our Azure data platform, and we are looking for an Azure-based Software Engineer to join a growing team to build our data integration services, responsible for managing the communication of data between distributed operational systems across CDW’s technology estate. The data integration project transitions from point-to-point integrations to a centralised hub and spoke model, promoting decoupling of systems, improved data quality, and simplified estate architecture.
• Engineer highly scalable and resilient data integrations, leveraging Azure Cloud PaaS and reference architectures.
• Create data integrations using different data latency methodologies, e.g., real-time and periodic.
• Subscribe and publish to operational systems using their native application interface technologies, such as REST, GraphQL, SOAP, Service Bus, SQL, etc.
• Perform transformations to conform the data with expected schema required by downstream operational systems.
• Develop a toolset to monitor the health of data integrations, including near real-time alerting of failures, data volume metrics, resource consumption metrics, etc.
• DevOps approach to software; create high quality code using traditional software practices, such as building, linting, unit and integration testing, source control, CI/CD, peer reviews, etc.
• DevOps approach to support; monitor pipelines to ensure businesscritical data pipelines are processed meeting time constraint and data quality expectations (including implementing reactive changes where applicable).
• Integrate into the data team’s SCRUM ceremonies, including backlog refinement, sprint planning, demonstrations, and retrospectives, including translation of user requirements into technical requirements including complexity estimation, implement in two-week sprint cycles, collaboration into process improvement, etc.
• Offer Level 3 and beyond support for platform.
• Based on requirements, perform ad-hoc analysis of data across multiple data sources to inform solution design.
• Document datasets in data catalogue, including ownership, stewardship, dictionaries, glossaries, lineage, sensitivity, etc.
• Document solution design in wiki.

Qualifications, Skills & Experience Management Responsibilities

• Strong Azure Function Apps experience for data integrations, using C# and .Net Core; including Durable Functions.
• Strong Azure SQL and data skills.
• Strong understanding of software development practices, such as SOLID principals, functional and object oriented, structuring code, testing, IOC, dependency injection, etc.
• Strong unit testing, including TDD.
• Strong experience with Azure DevOps Repositories, Pipelines and Artifacts (git, multistage YAML, NuGet).
• Strong experience with Azure data integration stack, including Azure Function Apps, Azure Logic Apps, Azure API Management, Azure Service Bus, Azure Blob Storage etc.
• Strong understanding of distributed systems, considering scalability, resiliency, high availability, disaster recovery, networking, etc.
• Strong understanding of application interface technologies including REST, GraphQL, SOAP, Service Bus, SQL, etc.
• IaC, e.g., Terraform, ARM, Bicep, etc. o Includes solid Azure Resource Manager skills including Azure Portal, Az CLI and Az PowerShell.
• Demonstrate understanding of Event driven Architectures.
• Knowledge of Canonicalised modelling.
• Excellent written and verbal communication skills
• Presentation skills, e.g., to Architecture Review Board.
• A minimum of 5 years of experience as an Azure Software Engineer.
• A demonstrable track record of getting stuff done whilst managing competing pressures and deadlines and retaining an eye for detail and quality.
• A passion for technology and its ability to have a positive impact on business.

Nice To Have

• Desirable if also has Azure Stream Analytics, Azure Data Factory V2, Azure EventHubs.
• Other languages, such as Python, PowerShell.
• Knowledge of Data Catalogue systems.

Essential Attributes

• Desirable if also has Azure Stream Analytics, Azure Data Factory V2, Azure EventHubs.
• Other languages, such as Python, PowerShell.
• Knowledge of Data Catalogue systems.