3352 Data Engineer (Expert)

ROLE & RESPONSIBILITIES: Design, build and operate operational data integration solutions focused on making enterprise data available, trusted and consumable. Ingest and stream data from Zero Trust data sources (CMDB, identity systems, security tooling) into operational pipelines rather than analytics stores. Build and maintain Kafka topics, producers/consumers, connectors and streaming applications to enable realtime flows. Implement API-based integrations, webhook listeners and file ingestion solutions to capture operational events. Develop robust ETL/ELT and stream processing logic to normalise, correlate and enrich data across sources. Ensure pipelines are idempotent and resilient (retries, replay, backpressure and compensation strategies). Apply data modelling and metadata practices to ensure consistent schemas and discoverability. Implement and monitor data quality checks, anomaly detection and validation rules; drive remediation where needed. Maintain data lineage, access contro...