Data Engineer

About Position:We are looking for an experienced Databricks Architect who can build, optimize, and maintain scalable data pipelines on the Databricks platform.- Role: Databricks Architect- Location: Pune- Experience: 12+ years- Job Type: Full Time EmploymentWhat You'll Do:- Design end‑to‑end Lakehouse architecture including ingestion, transformation, modeling and consumption.- Develop and maintain ETL/ELT pipelines using Databricks (PySpark, SQL, Notebooks).- Define and implement Medallion Architecture (Bronze/Silver/Gold) using Delta Lake.- Build high-performance ETL/ELT pipelines using PySpark, Spark SQL, Delta Lake.- Architect and optimize batch and streaming data pipelines.- Perform advanced Spark optimization, cluster sizing, and cost management.- Implement CI/CD, version control, and DevOps best practices within Databricks.- Design end‑to‑end Lakehouse architecture including ingestion, transformation, modeling and consumption.- Develop and maintain ETL/ELT pipelines using Databri...