Data Engineer

Job Title: Data Engineer (PySpark / Scala / Python)

Location: Remote

Job Description:

We are hiring a Data Engineer with strong hands-on experience in PySpark, Scala, and Python. You must have solid expertise in Apache Spark, as it will be the core technology used for building and managing large-scale data processing pipelines.

Experience with cloud platforms like Google Cloud Platform (GCP), Microsoft Azure, or AWS is a plus.

Required

Skills

• Strong hands-on experience with Apache Spark
• Proficient in PySpark
• Experience in Scala and Python
• Knowledge of ETL processes and data pipeline design
• Understanding of distributed data processing
• Familiarity with version control tools like Git
• Basic knowledge of cloud platforms (GCP, AWS, or Azure)

Nice to Have:

• Experience with cloud-native data tools (e.g., Dataproc, Glue, EMR, BigQuery)
• Familiarity with workflow/orchestration tools like Airflow or Cloud Composer
• Experience with CI/CD for data engineering
• Exposure to both structured and unstructured data