Help CenterIntegration
What's a recrawl?

What's a recrawl?

In a recrawl, we dispatch our web crawler to article URLs it’s already visited in order to update the metadata associated with those records. This is useful in situations where you’ve configured your metadata incorrectly, for example, or when you’ve decided to add richer metadata retroactively that you’d like to see updated in your dashboard and API results.

You also submit individual URLs to be recrawled if you’re and admin for your site. Do so from dash.parsely.com/(your API key)/settings/api/ .

Contact value@parsely.com if you need to set up a bulk recrawl.

Note: If the article you are recrawling is less than 5 days old, the historical data will automatically be fixed in an automated process called a ‘rebuild’. If the article is older than 5 days old, contact value@parsely.com to manually rebuild the data.

rocket emoji