Data Engineer

Main Activities

1. Developing Data Pipelines (50%)

• Design, develop, and maintain scalable Synapse pipelines for data ingestion, processing, and transformation in Azure data platform.
• Develop and optimize T‑SQL and Python-based data processing scripts and integrate them with Synapse pipelines for ETL tasks and data transformations.
• Design and develop mapping dataflow solutions for complex data transformations.
• Develop and maintain data storage solutions, ensuring efficient data retrieval and storage on Azure Data Lake and databases.
• Implement and maintain API integrations, including REST APIs, for seamless data flow between systems.
• Design and test the end‑to‑end process for data ingestion, data transformation, data cleansing, data delivery, data quality and data timeliness.
• Implement and ensure data security and privacy measures, complying with industry standards and regulations.
• Monit...