What’s a recrawl?

In a recrawl, we dispatch our web crawler to article URLs it’s already visited in order to update the metadata associated with those records. This is useful in situations where you’ve configured your metadata incorrectly, for example, or when you’ve decided to add richer metadata retroactively that you’d like to see updated in your dashboard and API results. Contact your account representative if you need to set up a bulk recrawl. You can also submit individual URLs to be recrawled yourself if you’ve got API access enabled; do so from dash.parsely.com/(your API key)/settings/api/.
Note: If the article you are recrawling is less than 5 days old, the historical data will automatically be fixed in an automated process called a ‘rebuild’. If the article is older than 5 days old, you should contact your account representative to manually rebuild the data.

Do you have an urgent support question?