全职 Senior Data Engineer (Data Vault 2.0 - Fabric) 工作, 薪水, Aventra Group Federal Territory 公司招聘中 - Ricebowl

We are seeking an experienced Senior Data Engineer to design, develop, and optimize modern enterprise data platforms leveraging Microsoft Fabric, Azure Cosmos DB, Star Schema, and Data Vault 2.0 methodologies. The ideal candidate will have a strong background in cloud data architecture, data modeling, ETL/ELT development, and large-scale analytics platforms. This role requires hands-on expertise in building scalable, high-performance data solutions that support business intelligence, AI/ML, and operational reporting.

Key ResponsibilitiesData Platform Engineering

• Design, develop, and maintain enterprise-grade data platforms using Microsoft Fabric.
• Build scalable Lakehouse, Data Warehouse, and Real-Time Analytics solutions within Microsoft Fabric.
• Develop robust and efficient data pipelines using Fabric Data Factory, Spark Notebooks, and Dataflows.
• Implement monitoring, performance tuning, and platform optimization strategies.

Data Modeling & Architecture

• Design and implement Data Vault 2.0 models including Hubs, Links, and Satellites for enterprise data warehousing.
• Develop dimensional models using Star Schema for reporting, analytics, and Power BI consumption.
• Ensure adherence to data governance, metadata management, and data quality standards.
• Collaborate with business stakeholders to translate requirements into scalable data models.

Azure Cosmos DB Engineering

• Design, develop, and optimize solutions leveraging Azure Cosmos DB.
• Implement data ingestion, transformation, and synchronization processes between Cosmos DB and Fabric.
• Optimize partitioning strategies, indexing policies, and query performance.
• Support high-volume transactional and analytical workloads.

Data Integration & ETL/ELT

• Develop end-to-end ELT/ETL pipelines integrating data from multiple enterprise systems.
• Work with structured, semi-structured, and unstructured datasets.
• Implement incremental loading, CDC (Change Data Capture), and near real-time processing patterns.
• Ensure data reconciliation, validation, and quality controls.

Performance & Governance

• Establish best practices for scalability, reliability, security, and maintainability.
• Implement CI/CD pipelines for data engineering workloads.
• Support data governance initiatives including lineage, cataloging, and compliance requirements.
• Conduct code reviews and mentor junior data engineers.

Required QualificationsEducation

• Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
• Master's degree is an advantage.

Experience

• 6-10+ years of experience in Data Engineering.
• Minimum 2+ years of hands-on experience with Microsoft Fabric.
• Strong experience implementing enterprise Data Warehousing solutions.
• Proven experience working with Azure Cosmos DB.
• Experience designing and implementing Data Vault 2.0 architectures.
• Strong expertise in Star Schema and dimensional modeling.

Technical SkillsMust Have

• Microsoft Fabric
• Fabric Data Factory
• Lakehouse
• Data Warehouse
• OneLake
• Spark Notebooks
• Real-Time Analytics
• Azure Cosmos DB
• Data Vault 2.0
• Star Schema & Dimensional Modeling
• SQL (Advanced)
• PySpark
• Python
• Azure Data Services
• Git & CI/CD
• Power BI Integration
• ETL/ELT Frameworks