Request concurrency and burst management

IAM Cloud has implemented a wrapper over our HTTP client calls, which limits the number of concurrent requests and introduces a slight delay between requests to prevent burst patterns.

By default, only 6 concurrent requests are allowed at any time, if this limit is reached, a 50ms delay is applied between each request, which helps avoid generating large bursts of requests to the provider in quick succession. This is particularly useful in scenarios where we get additional information in a loop, which could generate hundreds of requests. By intentionally slowing down the rate of requests, Cloud Drive Mapper (CDM) avoids overwhelming the provider.

The wrapper is applied across all endpoint types, this ensures consistent request handling and throttling mitigation throughout CDM.

Related topics:

Retry dispersion

User dispersion

Caching