Cloud Data Engineer with Spark Expertise

Elevate your career as a hands-on Data Engineer in the Total Fund Management team. Optimize large-scale cloud data systems using Spark and PySpark, emphasizing modern storage formats.
This role requires a strong focus on developing and optimizing Spark workloads in cloud environments. You will work with extensive datasets leveraging Parquet and Iceberg, translating requirements into robust engineering solutions while ensuring performance and reliability.
Key Responsibilities:
• Develop and optimize Spark workloads in cloud environments
• Work with large datasets using Parquet and Iceberg
• Translate requirements into effective engineering solutions
• Ensure performance, reliability, and maintainability
• Contribute to monitoring, documentation, and deployment
Requirements:
• Strong Python and PySpark skills
• Hands-on experience with Apache Spark in the cloud
• Familiarity with Databricks
• Expertise in large-scale data systems
• Background in cli...