- Bedok East Region (Singapore) Singapore
全职 Senior Data Engineer 工作, 薪水 up to SGD 9,000, Exceltech Computers Pte. Ltd. East Region (Singapore) 公司招聘中 - Ricebowl
分享
保存
工作地点
职位描述
岗位职责
Work location- Paya Lebar
Lead the design and operation of scalable batch and streaming data pipelines on AWS and Databricks using Python, PySpark, and SQL.
Build Bronze, Silver, and Gold layers in Delta Lake and develop reusable data models and curated datasets for analytics, reporting, and ML.
Integrate databases, files, APIs, and event streams using incremental loads and change data capture, with support for late-arriving data, backfills, and replay.
Enforce data contracts, schema validation, and reconciliation, and implement end-to-end lineage, encryption, and least-privilege access.
Orchestrate workflows with Databricks and AWS services, and automate testing and deployment across environments using Git, CI/CD, and Terraform.
Monitor pipeline health and data freshness, lead incident troubleshooting, and optimise Spark and SQL workloads for performance and cloud cost.
The Company's principal activity is manpower contracting services with other information technology and computer services.
Lead the design and operation of scalable batch and streaming data pipelines on AWS and Databricks using Python, PySpark, and SQL.
Build Bronze, Silver, and Gold layers in Delta Lake and develop reusable data models and curated datasets for analytics, reporting, and ML.
Integrate databases, files, APIs, and event streams using incremental loads and change data capture, with support for late-arriving data, backfills, and replay.
Enforce data contracts, schema validation, and reconciliation, and implement end-to-end lineage, encryption, and least-privilege access.
Orchestrate workflows with Databricks and AWS services, and automate testing and deployment across environments using Git, CI/CD, and Terraform.
Monitor pipeline health and data freshness, lead incident troubleshooting, and optimise Spark and SQL workloads for performance and cloud cost.
The Company's principal activity is manpower contracting services with other information technology and computer services.
重要安全守则
申请工作时，切勿提供您的银行或信用卡详细资料。不要转账或完成无关的在线调查问卷。如果您发现可疑内容，请举报此招聘广告。
了解更多