全职 Lead Data Engineer 工作, 薪水, ETeam Johor 公司招聘中 - Ricebowl

We're hiring on behalf of our client.

The consultant needs to be strong in bringing data together from multiple enterprise systems, cleaning/reconciling it, and creating a reliable data pipeline/model that supports OTIF calculations.

Core

• 5+ years of experience in Data Engineering, with 2+ years in a technical lead role.
• Strong hands-on experience building enterprise-scale data pipelines.
• Strong expertise in Python and SQL.
• Strong experience with Apache Spark/PySpark.
• Deep AWS experience with services such as S3, Glue, Redshift, Athena, EMR, Lambda, Kinesis/MSK, Step Functions and Lake Formation.
• Experience designing and implementing Data Lake/Lakehouse architectures.
• Strong understanding of ETL/ELT, CDC, batch and streaming architectures.
• Experience with relational and NoSQL databases.
• Strong understanding of data modeling, dimensional modeling, and data warehouse concepts.

Employment type: 1 year contract - extendable