You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Urllib screws up capitalization in "User-Agent" HTTP Header #60592
Urllib encodes as: "User-agent"
The correct form is: "User-Agent"
This is quite important, as it makes this library totally unusable for scraping moronic websites which require a recognized User-Agent string to work correctly, of which there are many.
Activity
CalvinOwens commentedon Nov 2, 2012
Urllib encodes as: "User-agent"
The correct form is: "User-Agent"
This is quite important, as it makes this library totally unusable for scraping moronic websites which require a recognized User-Agent string to work correctly, of which there are many.
CalvinOwens commentedon Nov 2, 2012
2275 hasn't been touched for almost 2 years.
If there was a fix in v3.3, it ought to be backported. But it doesn't look like they ever came up with one.
orsenthil commentedon Nov 8, 2012
Calvin. - I shall act upon old bug. The tricky nature of backwards compatibility sometimes let's it stale because we can not come t a good conclusion.