Senior Data Engineer

We are seeking a skilled and experienced Data Engineer with expertise in PySpark and Azure Data Factory to join our team. The ideal candidate will have a minimum of 5 years of professional experience in data engineering and a strong understanding of data processing, transformation, and integration. Knowledge of Power BI or any other data visualization tool is highly preferred. Key Responsibilities: Design, develop, and maintain scalable data pipelines using PySpark and Azure Data Factory. Transform and integrate large datasets from multiple sources to support analytical and business intelligence requirements. Collaborate with data analysts, scientists, and other stakeholders to define data requirements and deliver solutions. Optimize data workflows for performance, scalability, and cost efficiency. Monitor and troubleshoot data pipelines to ensure high availability and reliability. Implement best practices for data governance, security, and compliance. Utilize Power BI or other visuali...