CMC APAC Hiring! Full Time Senior Data Engineer in - Ricebowl

We are implementing a new Data Platform where data from multiple operating systems is aggregated and transformed to answer strategic business questions. You will join a high-performing, multi-disciplinary research division whose work impacts policy and operations, and you will lead the engineering behind that platform.

KEY RESPONSIBILITIES

• Lead and advise on data engineering strategy, architecture and implementation across the agency's digital systems

• Establish data architecture standards and developer operations best practices across multiple product teams

• Lead technical discussions with the data engineering team and stakeholders to shape the direction of digital products

• Mentor and train data engineers in pipeline development, data quality, governance, monitoring and documentation

• Oversee data lakes and database infrastructure supporting analytical, reporting and AI workloads

• Work with product teams, analysts and stakeholders to turn business data requirements into technical specifications and scalable solutions

KEY REQUIREMENTS

• 5+ years in data engineering, cloud infrastructure, platform engineering or related technical roles

• Bachelor's Degree in Computer Science, Data Science, Engineering, Information Technology or a related technical field

• Proficiency in at least one of Python, Java or Scala, and essential SQL knowledge across relational and non-relational systems

• Advanced knowledge of data modelling and schema design, with familiarity in ETL and data integration

• Experience with any cloud platform (AWS, Azure or GCP), preferably AWS services such as S3, EC2 and RDS

• Experience with Databricks and implementing batch and real-time pipelines, plus exposure to Spark or similar frameworks

• Experience with BI and visualisation tools such as Power BI or AWS QuickSight

• Self-driven, analytical, with strong project management, communication and stakeholder management skills

GOOD TO HAVE

• AWS Certified Data Engineer or Databricks Certified Data Engineer

• Knowledge of data science, statistical analysis or machine learning to better support researchers and analysts

• Understanding of data governance policies, access controls and security best practices in government environments

• Familiarity with agile development methodologies and version control such as Git