居家办公 Senior Data Engineer (GCP) 工作, 薪水, EPAM Systems, Inc. 公司招聘中 - Ricebowl

We are seeking a Senior Data Engineer (Google Cloud Platform). You will build reliable ETL and ELT pipelines, optimize SQL and orchestration in Apache Airflow and help teams turn raw data into trusted, ready-to-use datasets. You will partner with clients and delivery teams to improve quality, performance and operational stability across cloud data platforms.

Responsibilities

• Design and build scalable ETL and ELT pipelines using Python, SQL,Big Query and cloud-native services
• Develop and optimize complex SQL for transformation, validation, troubleshooting and performance
• Create and maintain data models and warehousing solutions that support quality, availability and scale
• Orchestrate workflows in Apache Airflow, including scheduling, monitoring and incident resolution
• Support pipeline delivery and platform operations across Google Cloud Platform and Amazon Web Services (AWS)
• Improve CI/CD, source control and automated deployment practices for data solution
• Investigate data, integration and infrastructure issues, driving root-cause analysis and fixes
• Collaborate with clients and cross-functional teams to clarify requirements, risks, dependencies and delivery plans

Requirements

• Hands-on experience building ETL and ELT pipelines and supporting data warehousing
• Advanced SQL skill set including optimization, data validation and complex transformation
• Python proficiency for pipeline development and software engineering practices
• Experience with distributed processing using PySpark or Apache Beam
• Practical cloud experience with Google Cloud Platform and or Amazon Web Services (AWS) for data workloads
• Workflow orchestration background with Apache Airflow or Google Cloud Composer
• Knowledge of data modeling data lifecycle management and data quality controls
• Clear communication with the ability to explain trade-offs, risks and solution options to stakeholders

Nice to have

• Infrastructure-as-code exposure using Terraform and or Kubernetes
• Streaming familiarity with Kafka and event-driven patterns
• Data integration tooling experience such as Fivetran

We offer

• By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023.
• Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
• You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
• We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
• At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us

Life at EPAM

• EPAM is a leader in the fastest-growing segment (product development/digital platform engineering) of the IT industry. We acquired Just-BI in 2021 to reinforce our leading position as a global Business Intelligence services provider and have been growing rapidly. With a talented multinational team, we provide data and analytics expertise
• We are currently involved in end-to-end BI design and implementation projects in major national and international companies. We are proud of our entrepreneurial start-up culture and are focused on investing in people by creating continuous learning and development opportunities for our employees who deliver engineering excellence for our clients