Role Overview
We are seeking a skilled Data Engineer with strong Python fundamentals and hands-on ETL experience. The successful candidate will be instrumental in developing and maintaining ETL connectors and data pipelines using our proprietary Python-based framework. This role requires a solid understanding of API integration, data engineering principles, and a commitment to test-driven development.
Responsibilities
- Design, develop, and maintain ETL pipelines and connectors to SaaS applications using an in-house Python-based framework.
- Build and maintain data pipeline logic using Python, with exposure to cloud data warehouse platforms.
- Use AI coding tools like GitHub Copilot and other LLM-based agents to prototype pipelines faster, while assessing quality and making adjustments as needed.
- Work with APIs to handle data exchange, implementing authentication methods and secure communications.
- Manipulate and manage data using Python dataframes and third-party Python packages.
- Conduct testing and quality assurance to keep pipelines reliable and scalable.
- Quickly adapt to and understand enterprise B2B data systems to build effective solutions
Qualifications
- Qualifications in Computer Science, Engineering, or a related field.
- 3 to 7 years proven experience in data engineering or software development, with very solid, hands-on Python skills.
- Strong familiarity with data engineering concepts, ETL/ELT processes, and pipeline design.
- Experience with API interactions and protocols.
- Experience with cloud data warehouse platforms (Snowflake, BigQuery, Redshift, or similar) is a plus.
- Knowledge of test-driven development practices.
- Good command of English, written and spoken, to work closely with an AU/NZ based team.
- Strong soft skills alongside strong hard skills. Excellent problem-solving ability and capacity to work independently.
Why Join Us?
We are a small, friendly team building a great product that customers love. We are a customer-funded, profitable company with achievable growth plans, led by product and engineering founders.