EMA Energy Market Authority Hiring! Full Time [Contract] Analyst - Principal Analyst (Data Engineering Branch) in - Ricebowl

[What the role is]

You will design, build and operate secure, scalable and reliable data platforms and pipelines that support EMA’s regulatory, operational, analytics and artificial intelligence needs. Working across cloud and on-premises environments, you will transform diverse energy-sector data into trusted, reusable data products that improve data availability, quality and time to insight.

[What you will be working on]

The key responsibilities of the officer include:

• Design, develop, test, deploy and maintain robust batch and near-real-time data pipelines that ingest and integrate structured, semi-structured and unstructured data from internal and external sources.
• Build and enhance cloud and on-premises data platforms, including data lakes, lakehouses, data warehouses and curated data layers, in accordance with enterprise architecture, security and governance standards.
• Develop reusable ETL/ELT components, data models and transformation logic using SQL and programming languages such as Python, Java or Scala.
• Implement automated data validation, reconciliation, monitoring, lineage and alerting controls to ensure the accuracy, completeness, freshness and reliability of data products.
• Optimise pipeline performance, storage, compute utilisation and query efficiency, while maintaining appropriate service levels and cost controls.
• Apply sound software engineering practices, including version control, code reviews, automated testing, CI/CD, technical documentation and configuration management.
• Monitor production data workflows, troubleshoot failures, perform root-cause analysis and implement sustainable improvements to platform reliability and maintainability.
• Work with business users, system owners, architects, analysts, data scientists, government agencies and industry partners to translate data requirements into secure, scalable and maintainable engineering solutions.
• Contribute to technical standards, reusable engineering patterns and continuous improvement of EMA’s data engineering capabilities.

[What we are looking for]

• Degree in Computer Science, Information Systems, Engineering or a related technical discipline, or equivalent practical experience.
• Hands-on experience in data engineering, data integration, data platform development or a related field. Fresh graduates with relevant internships, projects or technical portfolios may be considered for the entry-level position.
• Strong proficiency in SQL and at least one general-purpose programming language, preferably Python, Java or Scala.
• Sound understanding of ETL/ELT design, data modelling, relational and non-relational databases, data warehousing, data lakes or lakehouse architectures.
• Experience with data services on AWS or Microsoft Azure, such as object storage, serverless compute, orchestration, data integration, distributed processing and analytical databases, will be advantageous.
• Knowledge of distributed data processing or streaming technologies, such as Apache Spark, PySpark or Kafka, will be advantageous.
• Knowledge of data quality, metadata management, lineage, access control, privacy and data governance principles.
• Strong analytical and problem-solving skills, with the ability to diagnose complex data issues and develop pragmatic, sustainable solutions.
• Good written and verbal communication skills, with the ability to collaborate effectively across technical and business teams.
• A committed team player with a strong interest in public service and in shaping Singapore’s energy future.