urlparse normalize URL path #46835

Activity

1. monkeboy commented on Apr 8, 2008

   

   monkeboymannequin

   on Apr 8, 2008

   MannequinAuthor

   More actions

   Hi,
   This is my first problem with anything Python :-) and my first issue.

   Doing in the following:

     urlparse.urljoin( 'http://site.com/', '../../../../path/' )
     'http://site.com/../../../../path/'
   
     urlparse.urljoin( 'http://site.com/', '/path/../path/.././path/./' )
     'http://site.com/path/../path/.././path/./'

   These URLs are normalized to http://site.com/path/ in both Firefox and
   Google (the google spider would follow these OK)

   I think the documentation could be improved to point at the
   posixpath.py normpath function and how it solves the above. I blogged a
   how to:

   http://teethgrinder.co.uk/blog/Normalize-URL-path-python/

   I hope my bug report is OK. Thanks for all the code :-)

   johng@neutralize.com
2. monkeboy

   added

   stdlibStandard Library Python modules in the Lib/ directoryStandard Library Python modules in the Lib/ directory

   type-bugAn unexpected behavior, bug, or errorAn unexpected behavior, bug, or error

   on Apr 8, 2008
3. orsenthil commented on May 16, 2008

   

   orsenthil

   on May 16, 2008

   Member

   More actions

   Just try it this way.
   >>> print urlparse.urljoin('http://site.com/', 'path/../path/.././path/./')
   http://site.com/path/
   >>>

   The difference is the inital '/' in the second argument.
   Human interpretation is:
   Go to http://site.com/ and 1) go to path directory 2) go to one-level
   above (/../) which results in site.com again 3) go to path directory 4)
   go to one-level above (..) (results site.com )5) Stay in the same
   directory (.) 6) goto path 7) stay there (.)
   Final result is http://www.site.com/path/

   When you start the path with a '/'
   >>> print urlparse.urljoin('http://site.com/', '/path/../path/.././path/./')
   http://site.com/path/../path/.././path/./

   The RFC (1808) suggests the following.
   urlparse.urljoin('http://a/b/c/d','/./g') = <URL:http://a/./g\>
   The argument is taken as a complete path for the server.

   The way to use this would be, this way:

   >>> print urlparse.urljoin('http://site.com/', 'path/../path/.././path/./')
   http://site.com/path/
   >>>

   This is not a bug and can be closed.
4. orsenthil commented on May 16, 2008

   

   orsenthil

   on May 16, 2008

   Member

   More actions

   Btw, Thank you for the exciting report monk.e.boy. :-)
   There are many hidden in urlparse,urllib*. I hope you will have fun time
   finding them (and fixing them too :)

   And one general comment. If the bug is valid, Python official
   Documentation cannot be made to reference a blog site. Instead, a patch
   to fix the python doc would itself be welcome.
5. facundobatista commented on May 21, 2008

   

   facundobatista

   on May 21, 2008

   Member

   More actions

   Not a bug...
6. facundobatista

   closed this as completedon May 21, 2008
7. facundobatista

   added

   invalid

   on May 21, 2008
8. ezio-melotti

   transferred this issue fromon Apr 10, 2022