Lead Data Engineer at Upshop

Advance your career with Upshop as a Lead Data Engineer focused on enhancing our Databricks Lakehouse. This role emphasizes data architecture and systems design to drive impactful retail analytics.
In this crucial leadership position, you will manage the architecture and scalability of data products, delivering actionable insights to food retailers. Your responsibilities will include leading the design of our Databricks Lakehouse and developing ingestion strategies from various data sources while collaborating with BI, Data Science, and Product teams for scalable solutions.
Key Responsibilities:
• Own the end-to-end design of Databricks Lakehouse architecture
• Drive ingestion strategies from Azure and APIs
• Lead development of PySpark-based ETL frameworks
• Implement robust data validation and observability practices
• Oversee CI/CD pipelines and maintain deployment integrity
Requirements:
• 5+ years in Data Engineering and 3+ in leadership
• Proficient ...