Skip to content

Commit ac62e3c

Browse files
authored
feat: increase rate limits (#1836)
We have [doubled](apify/apify-core#22634) API rate-limits and this PR updates the docs accordingly.
1 parent 7fdc8df commit ac62e3c

File tree

4 files changed

+10
-10
lines changed

4 files changed

+10
-10
lines changed

apify-api/openapi/openapi.yaml

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -372,7 +372,7 @@ info:
372372
<tr>
373373
<td><code>429</code></td>
374374
<td><code>rate-limit-exceeded</code></td>
375-
<td>You have exceeded the rate limit of 30 requests per second</td>
375+
<td>You have exceeded the rate limit of ... requests per second</td>
376376
</tr>
377377
<tr>
378378
<td><code>405</code></td>
@@ -398,18 +398,18 @@ info:
398398
### Per-resource rate limit
399399
<span id="/introduction/rate-limiting/per-resource-rate-limit"></span>
400400
401-
The default per-resource rate limit is _30 requests per second per resource_, which in this context means a single Actor, a single Actor run, a single dataset, single key-value store etc.
401+
The default per-resource rate limit is _60 requests per second per resource_, which in this context means a single Actor, a single Actor run, a single dataset, single key-value store etc.
402402
The default rate limit is applied to every API endpoint except a few select ones, which have higher rate limits.
403403
Each API endpoint returns its rate limit in `X-RateLimit-Limit` header.
404404
405-
These endpoints have a rate limit of _100 requests per second per resource_:
405+
These endpoints have a rate limit of _200 requests per second per resource_:
406406
407407
* CRUD ([get](#/reference/key-value-stores/record/get-record),
408408
[put](#/reference/key-value-stores/record/put-record),
409409
[delete](#/reference/key-value-stores/record/delete-record))
410410
operations on key-value store records
411411
412-
These endpoints have a rate limit of _200 requests per second per resource_:
412+
These endpoints have a rate limit of _400 requests per second per resource_:
413413
* [Run Actor](#/reference/actors/run-collection/run-actor)
414414
* [Run Actor task asynchronously](#/reference/actor-tasks/runs-collection/run-task-asynchronously)
415415
* [Run Actor task synchronously](#/reference/actor-tasks/runs-collection/run-task-synchronously)

sources/platform/storage/dataset.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -93,7 +93,7 @@ To add data to a dataset, issue a POST request to the [Put items](/api/v2/datase
9393
https://api.apify.com/v2/datasets/{DATASET_ID}/items
9494
```
9595

96-
> API data push to a dataset is capped at _200 requests per second_ to avoid overloading our servers.
96+
> API data push to a dataset is capped at _400 requests per second_ to avoid overloading our servers.
9797
9898
Example payload:
9999

@@ -450,8 +450,8 @@ See the [Storage overview](/platform/storage/usage#sharing-storages-between-runs
450450

451451
### Rate limiting
452452

453-
The rate limit for pushing data to a dataset through the [API](/api/v2/dataset-items-post) is capped at _200 requests per second_ for each dataset, a measure to prevent overloading Apify servers.
453+
The rate limit for pushing data to a dataset through the [API](/api/v2/dataset-items-post) is capped at _400 requests per second_ for each dataset, a measure to prevent overloading Apify servers.
454454

455-
For all other dataset [API endpoints](/api/v2/storage-datasets) , the rate limit is _30 requests per second_ for each dataset.
455+
For all other dataset [API endpoints](/api/v2/storage-datasets) , the rate limit is _60 requests per second_ for each dataset.
456456

457457
Check out the [API documentation](/api/v2#rate-limiting) for more information and guidance on actions to take if you exceed these rate limits.

sources/platform/storage/request_queue.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -627,8 +627,8 @@ CRUD ([add](/api/v2/request-queue-requests-post),
627627
[get](/api/v2/request-queue-request-get),
628628
[update](/api/v2/request-queue-request-put),
629629
[delete](/api/v2/request-queue-request-delete))
630-
operation requests are limited to _200 requests per second_ per request queue. This helps protect Apify servers from being overloaded.
630+
operation requests are limited to _400 requests per second_ per request queue. This helps protect Apify servers from being overloaded.
631631
632-
All other request queue API [endpoints](/api/v2/storage-request-queues) are limited to _30 requests per second_ per request queue.
632+
All other request queue API [endpoints](/api/v2/storage-request-queues) are limited to _60 requests per second_ per request queue.
633633
634634
Check out the [API documentation](/api/v2#rate-limiting) for more information and guidance on actions to take if you exceed these rate limits.

sources/platform/storage/usage.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -107,7 +107,7 @@ Use this tool to estimate storage costs by plan and storage type.
107107

108108
## Rate limiting
109109

110-
All API endpoints limit their rate of requests to protect Apify servers from overloading. The default rate limit for storage objects is _30 requests per second_. However, there are exceptions limited to _200 requests per second_ per storage object, including:
110+
All API endpoints limit their rate of requests to protect Apify servers from overloading. The default rate limit for storage objects is _60 requests per second_. However, there are exceptions limited to _400 requests per second_ per storage object, including:
111111

112112
* [Push items](/api/v2/dataset-items-post) to dataset.
113113
* CRUD ([add](/api/v2/request-queue-requests-post),

0 commit comments

Comments
 (0)