Skip to content
Amethyst Amethyst Quickstart Guide

When You Need to Investigate More URLs

Basic overview

Section titled “Basic overview”

Index Worker uses Google’s API through Search Console properties.

Due to Google’s specifications, there is a rate limit of 2,000 URLs per day for each property.

🎨 You can increase the investigation volume by configuring multiple properties. You can also set up both a domain property and a URL-prefix property.

Use recurring runs effectively

Section titled “Use recurring runs effectively”

  • Manage the 2,000 URLs per day limit by alternating jobs, such as running Job A on Monday, Wednesday, Friday, and Sunday, and Job B on Tuesday, Thursday, and Saturday.

  • Reduce the number of recurring jobs and use manual investigations with Run once (immediate run).

Useful to know

Section titled “Useful to know”

💡 Full investigations are not recommended. In many cases, a sample size of 500 is enough. One advantage of Amethyst is that it can calculate the index rate through sampling without investigating every URL.