全职 Data Engineer (Geospatial) 工作, 薪水 up to SGD 7,500, CMC APAC Pte Ltd Central Region (Singapore) 公司招聘中 - Ricebowl

Data Engineer – Geospatial Team

What You Will Be Working On

As a Data Engineer on the Geospatial Team, you’ll be responsible for designing, developing, and maintaining the robust data infrastructure that enables analytics and insights across our Client’s long-term infrastructure and space planning and management needs.

One of such projects involves contributing to our Client’s Spatial Modelling Engine, which forecasts future education demand based on:

• Housing growth
• Demographics
• Migration patterns
• Land-use plans
• Accessibility

Key Responsibilities

1. Requirements Analysis and Solution Design

• Collaborate with business users, data analysts, and stakeholders to elicit and document requirements for analytics use cases.
• Translate business requirements into technical specifications.
• Design optimal data architecture solutions that align with organisational data strategy and governance frameworks.

2. Data Modelling and Architecture

• Design and implement appropriate data models based on analytical requirements.
• Create appropriate table structures and relationships based on business needs and query patterns.
• Consider performance, maintainability, and scalability when making modelling decisions.
• Work with stakeholders to understand data requirements and translate them into effective database designs.

3. Data Pipeline Architecture and Design

• Design end-to-end data pipelines from various source systems to different layers within the data analytics platform, including:
• Raw layer
• Technical layer
• Business layer
• Ensure pipeline designs follow best practices for scalability, reliability, and maintainability while adhering to data governance and security requirements.

4. Data Pipeline Development and Implementation

• Develop, test, and deploy data pipelines using modern data engineering tools and frameworks.
• Implement data transformation logic, quality checks, and error handling mechanisms to ensure reliable data processing.
• Build automated workflows that can handle both batch and real-time data processing requirements.

5. Data Infrastructure Maintenance and Optimisation

• Monitor and maintain existing data pipelines to ensure optimal performance, reliability, and cost-effectiveness.
• Troubleshoot data quality issues.
• Resolve pipeline failures.
• Implement performance improvements.
• Conduct regular reviews of data infrastructure to identify opportunities for enhancement and modernisation.

Experience

• Minimum 3–5 years of experience in data engineering, data analytics, or a related technical field.
• Demonstrated experience in designing and implementing data pipelines and analytics solutions.

Required Skills

Data Platform Technologies

• Comprehensive understanding of modern data architecture patterns, including:
• Data Lake
• Data Warehouse
• Data Lakehouse
• Data Mesh
• Ability to evaluate and recommend appropriate architectural approaches based on business requirements and technical constraints.

Technical Programming Skills

• Proficient in Python programming language.
• Experience with data manipulation libraries such as:
• pandas
• numpy
• Experience with data pipeline frameworks and API development.
• Strong SQL skills for:
• Data querying
• Data transformation
• Database management across various database platforms

Data Engineering Practices

• Solid foundation in data engineering principles, including:
• Data ingestion
• Data transformation
• Data quality assurance
• Pipeline orchestration
• Knowledge of data analysis techniques and data management practices, including:
• Data governance
• Lineage tracking
• Metadata management

Cloud and Platform Experience

• Knowledge of Databricks and AWS Cloud Services will be an advantage.
• Experience with:
• Cloud-based data processing
• Storage solutions
• Managed analytics services
• Familiarity with:
• Infrastructure-as-Code (IaC)
• DevOps practices for data platforms

Problem-Solving and Communication

• Strong analytical and problem-solving skills.
• Ability to troubleshoot complex data issues and optimise system performance.
• Excellent communication skills to effectively collaborate with both technical and non-technical stakeholders.
• Ability to translate business requirements into technical solutions.

Additional Advantage

• Experience with GIS platforms (e.g., ArcGIS).
• Experience with:
• Geospatial APIs
• Routing engines
• 2D/3D mapping technologies

Pay: $5,500.00 - $7,500.00 per month

Experience:

• data engineer: 4 years (Required)

Work Location: In person