Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Allow specification of HTTP headers during crawler invocation #250

Open
niltonb opened this issue Mar 1, 2017 · 0 comments
Open

Allow specification of HTTP headers during crawler invocation #250

niltonb opened this issue Mar 1, 2017 · 0 comments
Assignees
@nadgowdas
Labels
enhancement

Comments

@niltonb
Copy link
Collaborator

niltonb commented Mar 1, 2017

Description

Allow specification of HTTP headers (e.g Content-type, Authorization, ) when crawler is invoked with HTTP/HTTPS URL.

How to Reproduce

Log Output

Debugging Commands Output

Output of docker version:

(paste your output here)

Output of docker info:

(paste your output here)

Output of python --version:

(paste your output here)

Output of pip freeze:

(paste your output here)
@niltonb niltonb changed the title Feature: Allow specification of HTTP headers during crawler invocation Allow specification of HTTP headers during crawler invocation Mar 1, 2017
@nadgowdas nadgowdas self-assigned this Mar 7, 2017
@sahilsuneja1 sahilsuneja1 mentioned this issue Apr 27, 2017
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@nadgowdas nadgowdas

Labels
enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@nadgowdas @niltonb