429: Too Many Requests Error happens when a customer calls us at a higher than allotted QPS (queries per second).
By default, every customer is set at 10 QPS, so if they send a request higher than 10, they will get a 429 HTTP error. In general, we see 95% of our customers are within this QPS limit and are able to get all of their queries served successfully without any errors. However, we certainly have customers who need a much higher QPS. They generally fall into two categories:
- Enterprise customers serving high loads
- Batch runs that customers run on a daily, weekly, or monthly basis
In both these cases, Trestle can work with the customer to appropriately adjust the QPS allowed. Our service tiers cover up to 256 QPS, but we have a few customers with a custom configuration of up to 750 QPS.
If you have any questions, feel free to contact us at firstname.lastname@example.org.