Data Engineer

Job Title: Data Engineer – Azure Databricks.

We are seeking a skilled Data Engineer to join our team. The ideal candidate will have hands-on experience in Azure Databricks for data engineering and analytics, Microsoft Purview for data governance, and Microsoft Fabric for modern data integration and analytics. Strong proficiency in Python (PySpark) and SQL, along with expertise in data lake architecture, ETL processes, and data quality management, is essential. Experience with Azure data services and excellent technical documentation skills are also required.

Responsibilities:

• Design, develop, and implement data processing pipelines using Azure Databricks and Spark.

• Write efficient and optimized code in Python (PySpark) and SQL for large-scale data processing.

• Architect and maintain data Lakehouse solutions leveraging Microsoft Fabric for analytics and reporting.

• Implement data governance and cataloging using Microsoft Purview, ensur...