When you add a job to the API, it goes into a queue for processing. During the lifetime of a job, it can have one of these statuses:
When a job is processing the status will show as pending, and then changes to complete if the scrape has been completed successfully.
In cases where the has been a problem with the scraping (such as a change on the review site in question), the job status changes to maintenance, and two things happen:
- Our team is notified for investigation.
- The job retries 2, 3, 5, 12, 24 and 72 hours later.
There are also cases where the provided review profile is detected as invalid by our system, in which case it is marked as invalid_url. Note that given the endless variations of URLs available, it's not possible for our system to detect all of these cases.
Finally, in cases where the job finishes its retries without becoming complete, it is set to the failed status and no more retries are conducted.
Get in touch with our support if you need further information about a specific case you are seeing.