Google posted a job opening for an Engineering Analyst focused on anti-scraping in Google Search. The job is listed on Google Careers. As of publication, the posting outlines responsibilities for detecting and countering abusive automated access to Search.
Google Is Hiring an Anti-Scraping Engineering Analyst
According to the Google Careers description, the role focuses on abuse detection in Search, identifying scraper activity, and implementing defenses. The description cites developing rules, models, and system changes that target abusive behavior.
The opening also drew attention on LinkedIn, where Jamie Indigo highlighted the Engineering Analyst posting.
Key Details
- Employer: Google - role sits within the Google Search team.
- Title: Engineering Analyst focused on search scraping and abuse detection.
- Investigate abuse patterns in Search and develop countermeasures.
- Analyze large datasets to identify trends and anomalies that indicate automated abuse.
- Build and track metrics for scraper impact and the effectiveness of defenses.
- Collaborate with engineering to design, test, and launch anti-scraper rules and models.
- Review proof-of-concept attacks and external research to inform priorities.
- Evaluate detection mechanisms and their effects on scrapers and legitimate users.
- Contribute signals and features to machine-learning models for abuse detection.
- Develop and maintain threat intelligence on scraper actors and tactics.
Background Context
Google's Terms of Service restrict unauthorized automated access to its services and require users to follow the provided interfaces and instructions.
For programmatic access, Google offers the Custom Search JSON API, which provides documented methods and quotas for developers.
Separately, Google modified the num=100 results parameter used by some SEO tools to block generating 100 search results with one search query, a change aligned with efforts to limit abusive automated access.
.svg)
.svg)
.svg)