Skip to main content

Updates: Result window is too large, limit * page must be less than or equal to 10,000

  • February 7, 2024
  • 3 replies
  • 243 views
E
  • EricM
  • Participating Frequently

If I execute a query where page * limit is greater than 10,000 I receive the following error:

image

Is this expected behavior? Is there a limit to the number of updates an instance can have? What’s the suggested solution if there can be more updates than this limit? The Updates object does not seem to support filters besides ID.

I did find that this a common error for a Elasticsearch backend:
Result window is too large, from + size must be less than or equal to: [10000] but was [10050] - Elastic Stack / Elasticsearch - Discuss the Elastic Stack
There were workarounds specific to Elasticsearch (search after, search with date filters), but they do not seem to be applicable in this situation.

3 replies

A
  • anon29275264
  • Participating Frequently
  • February 7, 2024

This is because you’re retrieving a single update (limit: 1) per page. You’re getting to page 10000 trying to get all of the updates by looping 10000 times?

If you increase the limit to something reasonable, you’ll need far fewer pages.

E
  • EricM
  • Author
  • Participating Frequently
  • February 8, 2024

This is more of a technical/development question. I understand the limit and that it is likely not a problem in most cases. This is a finite series - meaning there is a theoretical limit to the number of updates I can retrieve from the API. Something like:

S=1 page * 10000 limit + 2 page * 5000 limit + 3 page * 3333 limit + 4 page * 2500 limit …
100,000,000 updates I believe?

Is there a reason behind this limit for this specific object? The other objects seem to work with page * limit beyond 10,000. I’m asking for the worst-case scenario where a client might have more updates than this, or is that not possible?

A
  • anon29275264
  • Participating Frequently
  • February 9, 2024

There is also a hard limit of 1000 updates per item. Which is why I’m shaking my head here, you’re trying to account for an impossibility.

Another thing, the limit is just how many updates to return. Lets assume there are 100 updates.

limit: 50, page: 1 returns updates 1-50
limit: 50, page: 2 returns updates 51-100
limit: 200: page: 3 returns nothing, there are no updates 401-600 (it assumes pages 1 & 2 were also 200 updates in size, 1-200, and 201-400)

Just because other ones don’t throw an error with a limit over 10000 doesn’t mean they can return more than 10000. Most are limited to 1000 actual items. you specify 10000 and they just return 1000. Thats if the query doesn’t error/timeout at 1000 (your query must return in 60s or less).

items_page is limited to 500 items, even if you specify a higher limit. Most root queries are limited to 100 I believe.

Terms & ConditionsCookie settingsAccessibility statement