Lead, data engineer

Overview

Location: ZA, undefined, Johannesburg, 30 Baker Street

Responsible for overseeing junior data engineering activities and aiding in building the organisations data collection systems and processing pipelines. Oversee infrastructure, tools and frameworks used to support the delivery of end-to-end solutions to business problems through high performing data infrastructure. Responsible for expanding and optimising the organisations data and data pipeline architecture, whilst optimising data flow and collection to ultimately support data initiatives.

Responsibilities Qualifications Type of Qualification: Post Graduate Degree Field of Study: Information Studies /Information Technology Experience Required Data Monetisation Data & Analytics 8-10 years Experience with big data tools: Hadoop, Spark, Kafka, etc. Experience with relational SQL and No SQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luig...