Concurrency limits for async service endpoints: how many callback jobs can run in parallel?

Hi!

We need to set up a service that runs an external process, then returns data to us for processing.

Our intended setup: A scheduled service sends each project to an external API (fire-and-forget). The API processes it for 2–3 minutes and then posts the result back to a service endpoint in our solution. That endpoint has Run Async enabled and processes and saves the results, which takes about 5–20 minutes depending on the project’s size. We need to run this for about 600 projects per night.

If we send them between 00:00 and 06:00 this means one project every 36 seconds and 34 threads at max..

My question is: how many concurrent threads can a service have before it starts throwing 429 errors?

Hi!

Please read here about that behaviour. 2-3 in parallell is the default:

This sounds like something to discuss with Appfarm. The resources and horizontal scaling may be increased.