Big Data Spark Developer (Python & Scala)

Python Spark Scala • Primary skills:Technology->Big Data - Data Processing->Spark,Technology->Java->Apache,Technology->Machine Learning->Python Core Skills 2–5 years of experience in Python development Hands-on experience with Apache Spark (PySpark and/or Scala) Strong understanding of data processing and ETL concepts Good knowledge of SQL and relational databases Big Data & Spark Development Develop and maintain data processing pipelines using Apache Spark (PySpark & Scala) Work with Spark DataFrames, RDDs, and Spark SQL Implement transformations, joins, aggregations, and optimizations Tune Spark jobs for performance, scalability, and reliability Python & Scala Programming Write clean, efficient, and scalable code in Python and Scala Develop modular and reusable components Integrate data pipelines with various applications and APIs ETL & Data Engineering Design and build ETL workflows for structured and unstructured data Extract data from multiple sources (databases, APIs, flat files)...