Big Data Architect - Health Systems at Discovery Limited

Job description

Key Purpose

The primary responsibility of this role is to understand the complexity of the system with focus on processing architecture. Understand the end to end processing architecture. Be able to provide solution designs based on Big Data requirements.

Key Areas of Responsibility

• Define the backup and DR strategy.
• Define a standard for Ingest and Extract processes.
• Define standard (and be involve) for integration methods and patterns.
• Define monitoring strategy.
• Help with the design of custom ingest applications.
• Define the role based security model for the defined solution
• Advise on how to use Storm, Zeppelin & Hive etc. for providing business solutions.
• Be able to provide solution designs based on Big Data requirements.
• Be able to troubleshoot and perform root cause analysis.
• Define and ensure adherence to SLAs in the context of the solution.
• Evaluate third party components (e.g. analytics, natural speech processing etc.) for integration within the environment.
• Be able to perform the senior administer tasks if required.
• Develop any custom extensions and ingestion modules.

Personal Attributes and Skills

• Have deep understanding of Hadoop (HDFS, YARN, MapReduce), Accumulo, Zookeper, NGINX and how all fits together. Understand the end to end processing architecture.
• Deep understand of operating system
• Solid understand or relational databases and transactionality
• Solid understanding of various NoSQL DB flavours.

Education & Experience

• BSc (Comp Sci) or equivalent
• 5 Years of Java Development Experience
• 10 Years of IT Experience
• Experience using Hadoop
• Scala or other functional programming experience

Equity Statement

Preference will be given to applicants from designated groups and suitable internal candidates in line with Discovery’s policies.