Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Manage url that have non encoded characters #144

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Commits on Jul 28, 2021

  1. Manage url that have non encoded characters

    If the crawler tries to request a url that has non encoded characters, it will simply stop there and giv an error. 
    
    To fix this, url is first decoded to decoded what is already present in the url so that there wil not be a double encoding. It is then encoded.
    beaubbe authored Jul 28, 2021
    Configuration menu
    Copy the full SHA
    ccbb997 View commit details
    Browse the repository at this point in the history