Find, collect and shape public data for Wingman, starting with motorsport (car racing): research new sources, build the tools that collect them, and turn the results into clean, well-structured data.
The Role
You find and bring in the data Wingman is built on. Most of it is public data, starting with motorsport (car racing). You research where good data lives, decide the best way to get it (collecting it ourselves, or buying it from a data broker or provider), build the collectors, and turn what comes in into clean, well-structured files. You are the person who knows where our data comes from and how trustworthy it is.
What you'll do
- Research new data sources: public websites, official publications, data brokers and paid providers. Compare what each offers, how complete and reliable it is, and what it costs.
- Help evaluate and buy data: talk to data brokers and providers, check samples, and recommend what is worth paying for.
- Build Python collectors for websites, JavaScript-heavy pages and PDF documents, and keep them running on a schedule.
- Shape the data into a good format: consistent columns, names, dates and units, so it is ready to use.
- Notice and flag data problems: missing records, duplicates, numbers that don't add up, or sources that disagree. Find the cause and fix it at the source instead of patching files by hand.
- Document each source: where it comes from, how often it updates, and what its limits are.
What we're looking for
- Good Python: clean, readable scripts someone else could maintain.
- Web scraping experience: requests and BeautifulSoup for HTML, and a headless browser (Playwright or similar) for sites that need JavaScript.
- Extracting data from PDFs (pdfplumber or similar).
- Curiosity and research skills: you enjoy hunting down where data lives and judging whether it can be trusted.
- Care with data: dates and time zones, name spellings, consistent formats, and noticing when a number doesn't make sense.
- Comfortable with Git and GitHub.
- Works independently and explains clearly what was collected, what is missing and why.
Nice to have
- Interest in motorsport or other sports.
- Experience working with data brokers, data vendors, or APIs.
- Experience getting past rate limits and bot protection politely and within a site's terms.
- Tests for collectors, so a site change is caught before bad data gets in.