Ensure the security and governance of the Big Data Infrastructure platform, including managing access controls, implementing data encryption, and conducting regular security audits.
Create and support a dedicated China data environment on Alibaba Cloud (AliCloud) for data processing, analytics, machine learning, and reporting workloads.
Collaborate with data scientists, business analysts, product managers, software engineers and other data engineers to develop, implement and validate deployed data solutions.
Cross-Functional Collaboration: Work with business stakeholders, analytics, product, and engineering teams to understand data requirements and establish clear data definitions.
Optimise system and pipeline performance through ongoing monitoring and implementation of scalable solutions designed to handle expanding data volumes and growing organisational demands.
4+ years as a software engineer, data engineer, or AI/ML practitioner writing technical design documents, data pipeline documentation, or API specifications
Design data models for mission-critical, high-volume, near-real-time/batch data; build idempotent/atomic production data pipelines to make data ingestion more fault tolerant.
World-class benefits: On top of a competitive salary (based on your location, experience, and skills), we provide a comprehensive benefits package to enable holistic well-being for you and your family.
Pipeline Architecture: Design, build, and maintain robust, highly scalable ETL/ELT data pipelines to ingest and process vast amounts of data from diverse sources.
Design and operate production-grade pipelines across statistical, licensed, API, database, file and web sources, with robust validation, monitoring and recovery.