Skip to content

Instantly share code, notes, and snippets.

View drfill's full-sized avatar

Fill Quazy drfill

  • NJoyX
  • Riga, Latvia
View GitHub Profile
@mnot
mnot / urlnorm.py
Created December 1, 2009 05:29
urlnorm.py: URL normalisation
#!/usr/bin/env python
"""
urlnorm.py - URL normalisation routines
urlnorm normalises a URL by;
* lowercasing the scheme and hostname
* taking out default port if present (e.g., http://www.foo.com:80/)
* collapsing the path (./, ../, etc)
* removing the last character in the hostname if it is '.'