An additional fix has been applied to prevent this failure case from happening again. Crawls and batch scrapes submitted in the past 24 hours are unavailable via the API, but downloadable through the Dashboard. In-progress crawl, batch scrape, and extract jobs were interrupted.

The issue is now resolved.

The API is returning 500 errors due to an issue with one of our Redis instances. Resolution is underway.