RSS Rate limits

[xtrime-ru]

Your use case

What would you like to do?

Need ability to control how many requests your backend sends to different data providers.

Why would you like to do it?

Some sources have rate limits. When multiple users add a lot links from same source your server will stuck in blacklist.

Im owner of Telegram -> RSS bridge https://github.com/xtrime-ru/TelegramRSS. Public url: https://tg.i-c-a.su/. And your server constantly exceeds RPM limits.

I increased RPM for your server as temporary fix.

How would you like to achieve it?

Add table with source/host -> Max RPS relation. Then control how many requests backend generates to such sources.
Also validation would be fine: disable sources with constant errors. For example, if channel removed.

Have you considered any alternatives?

No response

Additional context

No response

[Half-Shot]

Thanks for the report. I think I understood your request well enough and have opened an issue to track in matrix-org/go-neb#382

[xtrime-ru]

I checked new issue - it is exactly what i meant. Thanks!