全职 Data Engineering 工作, 薪水, ETeam Johor 公司招聘中 - Ricebowl

The consultant needs to be strong in bringing data together from multiple enterprise systems, cleaning/reconciling it, and creating a reliabledata pipeline/model that supports OTIF calculations

.

The profile I would look for is someone with:

Core

* 8–12+ years of experience in Data Engineering, with 3+ years in a technical lead role.

* Strong hands-on experience building enterprise-scale data pipelines.

* Strong expertise in Python and SQL.

* Strong experience with Apache Spark/PySpark.

* Deep AWS experience with services such as S3, Glue, Redshift, Athena, EMR, Lambda, Kinesis/MSK, Step Functions and LakeFormation.

* Experience designing and implementing Data Lake/Lakehouse architectures.

* Strong understanding of ETL/ELT, CDC, batch and streaming architectures.

* Experience with relational and NoSQL databases.

* Strong understanding of data modeling, dimensional modeling, and data warehouse concepts.