What is Async
Async is a managed asynchronous service by Leapcell, offering a fully serverless experience. It is an event-driven service that executes code in response to different events. These events can be HTTP requests, timers, message queues, and more.
When you send an HTTP request to an Async endpoint, it triggers an event that writes your request to a message queue. Then, Async has a workers pool that retrieves requests from the message queue and executes your code. This approach allows your code to run in response to different events without needing to manage servers.
Here is an architecture diagram of Async:
Use Cases
- Machine learning task processing
- Data processing
- Sending emails
Concepts
Dynamic Concurrency Scaling
Async dynamically adjusts concurrency based on the number of workers you configure on the platform. You can adjust the number of workers based on your needs to control the rate. For example, if your downstream services have QPS limitations, you can adjust the worker count to control the rate.