全职 Data Engineer – Databricks | AWS | Azure 工作, 薪水 up to SGD 10,000, Yoda Technologies Pty Ltd North Region (Singapore) 公司招聘中 - Ricebowl

Data Engineer – Databricks | AWS | Azure

Location: Singapore – Onsite
Experience: 5+ Years

Job Summary

We are looking for a Data Engineer with 5+ years of experience in building scalable data solutions using Databricks, AWS, and Azure.

Key Responsibilities

• Develop and maintain ETL/ELT pipelines using Databricks, PySpark, Python, and SQL.
• Build Lakehouse/Medallion Architecture using Delta Lake.
• Work with AWS services such as S3, Glue, Athena, Redshift and Azure services such as ADLS Gen2, ADF, and Synapse.
• Develop batch and real-time data pipelines and optimize Spark workloads.
• Implement data modelling, data quality, governance, and performance optimization.
• Manage Databricks Jobs/Workflows and production pipelines.
• Implement CI/CD using Git, Azure DevOps/GitHub.
• Troubleshoot production issues and collaborate with architects and business teams.

Required Skills

Databricks | PySpark | Python | SQL | Apache Spark | Delta Lake | AWS | Azure | S3 | Glue | ADLS | ADF | Synapse | ETL/ELT | Data Modelling | CI/CD | Git

Preferred

Kafka/Spark Streaming, Airflow, Terraform, Docker, Unity Catalog, CDC, and cloud certifications.

Qualification: Bachelor's degree in Computer Science/IT/Engineering or related field.
Requirement: Strong production experience with Databricks and cloud data platforms; willing to work onsite in Singapore.

Pay: $7,000.00 - $10,000.00 per month

Experience:

• data engineer: 5 years (Required)
• databricks: 4 years (Required)
• AWS: 3 years (Required)
• Azure Databricks: 2 years (Required)

Work Location: In person