Glossary

Rate limiting

Rate limiting is a restriction a website places on how many requests a single source can make within a given time period, used to protect server load and deter abuse.

Rate limiting is a restriction a website places on how many requests a single source can make within a given time period, used to protect server load and deter abuse. It matters in e-commerce data collection because respecting a site's rate limits is part of collecting data responsibly; going over them risks getting blocked and can affect other visitors to the site. Well-built data collection paces requests within published or reasonable limits rather than maximizing speed, and spreads load across time rather than hitting a site in a burst. It's one of the main reasons collecting data from many sources on a fixed schedule takes longer than a single quick export would suggest.

Need this field in your own feed?

Tell us which stores and fields you need. We reply within one business day with a scope and a price.