Scraping Engineer
ABOUT THE ROLE
You'll be an embedded member of a fast-growing AI startup team, owning the reliability and quality of a web extraction infrastructure that processes millions of pages daily through hundreds of scripts. Reporting to a Forward Deployed Engineer, this role is critical to keeping a high-throughput data pipeline running smoothly and accurately.
WHAT YOU'LL DO
- Monitor and triage a queue of broken scrapers and data quality alerts to keep operations running without interruption.
- Build and deploy new web scraping scripts for websites that need to be added to the extraction pipeline.
- Validate scraped data for accuracy and investigate any discrepancies that surface.
- Create dashboards to visualize and monitor scraped data in real time.
- Collaborate with AI agents to fill capability gaps, fix issues, and improve existing scripts.
WHAT WE'RE LOOKING FOR
- 1+ years of hands-on, professional experience building or maintaining web scraping solutions.
- Strong proficiency in TypeScript and Node.js for building and debugging scraping scripts.
- Solid SQL skills for data querying and validation.
- Experience with Puppeteer or similar browser automation libraries.
- Experience debugging and fixing broken scrapers in production environments.
- Familiarity with message queues such as RabbitMQ and in-memory caching systems such as Redis.
- Experience with Google Cloud Platform or equivalent cloud infrastructure, including data warehouse tools like BigQuery.
- Comfort with bash scripting and git version control.
- Experience validating data quality and accuracy in extracted datasets.
- Experience building dashboards or data visualization tools is a plus.
- Strong async communicator who sends proactive updates and flags blockers early.
- Comfortable with ambiguity and able to scope project timelines independently in a fast-paced startup setting.
LOCATION
Fully remote, open to any time zone. You will need 8+ hours of daily availability with overlap during US business hours. Visa sponsorship is not available.
Findigo hittar jobben och fyller i ansökan. Du klickar Skicka.
Visa jobbet och ansökUrsprunglig annons: jobs.ashbyhq.com