Build and test data pipelines on modern data platforms
Develop new pipelines and data products, and automation
Enhance existing pipelines and data products, and provide support
Maintain data pipelines and data products of these Solutions
Support data engineering, ingestion, transformation and consumption activities
Provide technical services like development, data preparation, data transformation, data encryption, data masking, data optimization and data testing preparation
Provide support and integration with capability on latest AI tool stack to expedite the development, testing and deployment process
Required Skills:
Python
PySpark
Snowflake
Databricks
Cloudera
Migration from Cloudera to Snowflake/Databricks with metadata-driven design
Required Experience:
Minimum 5+ years of experience in coding and development work
Good understanding of data warehouse implementations
Hands-on experience in big data engineering jobs using Python, PySpark to build and test data pipelines on modern data platforms such as Snowflake, Databricks and Cloudera