Data Engineer

Key Responsibilities
Technical Leadership & Ownership
Own the end-to-end data engineering architecture for large-scale AWS data platforms
Define and enforce data engineering standards, best practices, and governance frameworks
Lead design reviews, code reviews, and technical decision-making across teams
Act as the primary technical escalation point for complex data pipeline issues

ETL/ELT Design & Development
Design, build, and optimize scalable ETL/ELT pipelines using:
AWS Glue (Jobs, Workflows, Crawlers)
PySpark / Spark SQL, Snowflake, SnowsQL
Python- based data processing frameworks
Implement incremental processing, CDC, and data partitioning strategies
Develop reusable and modular data pipeline frameworks for enterprise use

Data Lake & Storage Management
Design and manage data lake architecture on

AWS (S3 + Apache Iceberg )
Implement ACID-compliant data layers using Iceberg
O ptimize storage formats (Parquet, ORC)...