Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SQS inbound connector doesn't take polling delay into account on errors #3405

Open
chillleader opened this issue Oct 1, 2024 · 2 comments
Open
Assignees
Labels
kind:bug Something isn't working

Comments

@chillleader
Copy link
Member

Describe the Bug

The SQS inbound connector doesn't take polling delay into account when the receiveMessage call returns an error.

This leads to eternal retries without delay every couple of ms when there is an error, e.g. when the queue doesn't exist or there is a network error.

Steps to Reproduce

  1. Create an SQS inbound connector, specify a non-existing queue name but otherwise the config should be valid
  2. Deploy the diagram
  3. Observe never-ending polling requests without any delays (on the debug logging level)

Expected Behavior

  1. Fail-fast check on connector startup whether the queue exists or not, the connector should not start if the queue doesn't exist
  2. If an error happens during connector execution: add a retry policy, take the polling delay into account
  3. Improve visibility: currently, errors during the SQS connector execution are logged on the debug level, which makes it difficult to spot errors.

Environment

  • All connectors versions are affected where the SQS inbound connector is present
@chillleader chillleader added the kind:bug Something isn't working label Oct 1, 2024
@chillleader
Copy link
Member Author

This will partially fix the issue, full patch is targeted for the next release cycle: #3415

@sbuettner
Copy link
Contributor

@chillleader Can we close this one?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind:bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants