Data Engineer at RMB - Rand Merchant Bank

• The data engineer will be responsible for developing features, ongoing support and administration, and documentation for the service. The platform provides a messaging queue and a blueprint for integrating with existing upstream and downstream technology solutions.
• Our data engineers create robust and scalable computing environments which bring data-driven technologies to our users. We are constantly challenging ourselves to build more effective data architectures, flexing our freedom to incorporate new technologies and expand our computing power.

Are you someone who can: 

• Develop and deploy of data applications
• Design & Implement of infrastructure tooling and work on horizontal frameworks and libraries
• Create data ingestion pipelines between legacy data warehouses and the big data stack
• Automate application back-end workflows
• Build and maintain backend services created by multiple services frameworks.
• Maintain and enhance applications backed by Big Data computation applications.

You will be an ideal candidate if you: 

• Have a relevant Degree in Computer Science, Engineering, IT, Mathematics or equivalent or related field
• Minimum of 3 years experience within ETL tools such as Ab Initio and Informatica
• Ability to configure repository projects using Ab Initio EME for creating a common development environment.
• Have Knowledge of Control M to automate and schedule jobs.
• Informatica PowerCenter and EDC.
• Programming languages (SQL, XTML, Java, Python).
• Data platforms (Oracle, Teradata, Hadoop, SQL).
• Worked on Big Data platforms (Vanilla Hadoop, Cloudera, or Hortonworks).
• Experience in designing and setting up large data systems, with an ability to assess the tradeoffs in architectural decisions.
• Knowledge of large data architectures (data warehouses, lakes, meshes, etc).
• Experience with Scala or other functional languages (Haskell, Clojure, Kotlin, Clean).
• Experience with some of the following: Apache Hadoop, Spark, Hive, HDFS, ZooKeeper, Linux, Bash, version control tools, continuous integration tools.
• Experience with reporting like PowerBi.

You will have access to: 

• Opportunities to network and collaborate
• Opportunities to innovate
• Working directly across RMB with developers, operations staff, data scientists, architects, and business constituents to develop and enhance the big data service.

We can be a match if you are: 

• Curious & courageous - you're driven by always wanting to know more and learn more
• Obsessed with mastery - you know what it takes to become good at what you do and are constantly pushing yourself to do it