Databricks Engineer (Colombia)

Responsibilities

• Design, develop, and maintain scalable data pipelines, ETL/ELT processes, and data integration solutions using Databricks, PySpark, and Delta Lake.
• Build and optimize cloud-native lakehouse architectures leveraging Azure Databricks, Azure Data Lake Storage (ADLS Gen2), and modern data engineering best practices.
• Develop robust data ingestion frameworks supporting structured, semi-structured, and unstructured data sources.
• Create high-performance data transformation workflows using Python, SQL, Spark, and Databricks notebooks.
• Design, implement, and optimize data models, schemas, partitioning strategies, and storage structures for large-scale analytics workloads.
• Integrate Databricks environments with downstream platforms including Snowflake, business intelligence tools, APIs, enterprise applications, and reporting solutions.
• Utilize Azure Data Factory (ADF), Azure Functions, and Azure ecosystem s...