When You Need to Investigate More URLs

Basic overview

Index Worker uses Google’s API through Search Console properties.

Each Search Console property can investigate a combined total of up to 2,000 URLs per day.

The limit is shared by every job that uses the same property.

Jobs in different projects still count together when they use the same property.

For example, four runs of 500 URLs using the same property total 2,000 URLs.

This is a Google Search Console API quota, not a feature limit determined by your Amethyst subscription plan.

Each registered property has its own 2,000 URL limit.

You can register a domain property and a URL-prefix property as separate properties.

Use recurring runs effectively

After creating or changing a recurring schedule, use the Job execution plan to review the planned URL volume for each property and weekday.

Use the plan to check for days with more than 2,000 URLs, making it easier to identify days that exceed the limit.

• Add the sample sizes of jobs that use the same property, and schedule them so their total stays within 2,000 URLs per day. For example, run Job A on Monday, Wednesday, Friday, and Sunday, and Job B on Tuesday, Thursday, and Saturday.

• Reduce the number of recurring jobs and use Run once (immediate run) only when needed. Run once also counts toward the same property limit.

Useful to know

💡 Full investigations are not recommended. In many cases, a sample size of 500 is enough. One advantage of Amethyst is that it can calculate the index rate through sampling without investigating every URL.