Commits

Commit history

1. Commits on Jun 14, 2012

   • massive spin speedup

     matthewrobertbell

     committed
     8bb5d02View commit details

     Copy full SHA for 8bb5d02

     Browse repository at this point
2. Commits on May 24, 2012

   • fix domain_crawl

     matthewrobertbell

     committed
     5b95a77View commit details

     Copy full SHA for 5b95a77

     Browse repository at this point

   • fix domain_crawl

     matthewrobertbell

     committed
     711aa36View commit details

     Copy full SHA for 711aa36

     Browse repository at this point

   • break ALL the things

     matthewrobertbell

     committed
     2162e53View commit details

     Copy full SHA for 2162e53

     Browse repository at this point
3. Commits on May 5, 2012

   • fix

     matthewrobertbell

     committed
     041f231View commit details

     Copy full SHA for 041f231

     Browse repository at this point
4. Commits on May 4, 2012

   • push, push, push

     matthewrobertbell

     committed
     d8b26bfView commit details

     Copy full SHA for d8b26bf

     Browse repository at this point
5. Commits on Apr 29, 2012

   • teh magic

     matthewrobertbell

     committed
     831c63bView commit details

     Copy full SHA for 831c63b

     Browse repository at this point
6. Commits on Apr 18, 2012

   • make multiprocess work

     matthewrobertbell

     committed
     834e39fView commit details

     Copy full SHA for 834e39f

     Browse repository at this point
7. Commits on Apr 16, 2012

   • screwed up referrer header was sometimes being passed

     matthewrobertbell

     committed
     40bef9eView commit details

     Copy full SHA for 40bef9e

     Browse repository at this point
8. Commits on Apr 11, 2012

   • picloud support

     matthewrobertbell

     committed
     32b1647View commit details

     Copy full SHA for 32b1647

     Browse repository at this point
9. Commits on Mar 21, 2012

   • sort it out dominbik

     matthewrobertbell

     committed
     efb1148View commit details

     Copy full SHA for efb1148

     Browse repository at this point

   • Merge branch 'master' of github.com:mattseh/python-web

     matthewrobertbell

     committed
     c773c6aView commit details

     Copy full SHA for c773c6a

     Browse repository at this point

   • merge stuff

     matthewrobertbell

     committed
     acb8ba7View commit details

     Copy full SHA for acb8ba7

     Browse repository at this point

   • Merge pull request #3 from kamired22/master

     Show description for c0b0217
     matthewrobertbell

     committed
     c0b0217View commit details

     Copy full SHA for c0b0217

     Browse repository at this point
10. Commits on Mar 19, 2012

    • added view() for debugging purposes

      kamired22

      committed
      7cad833View commit details

      Copy full SHA for 7cad833

      Browse repository at this point
11. Commits on Mar 18, 2012

    • mods for crawling

      matthewrobertbell

      committed
      19614eaView commit details

      Copy full SHA for 19614ea

      Browse repository at this point
12. Commits on Mar 8, 2012

    • unicode was screwing up POSTs

      matthewrobertbell

      committed
      8485787View commit details

      Copy full SHA for 8485787

      Browse repository at this point
13. Commits on Mar 4, 2012

    • trying to break gevent less

      matthewrobertbell

      committed
      9cc2289View commit details

      Copy full SHA for 9cc2289

      Browse repository at this point
14. Commits on Mar 3, 2012

    • maybe no stupid queue waits now?

      matthewrobertbell

      committed
      f60721dView commit details

      Copy full SHA for f60721d

      Browse repository at this point
15. Commits on Mar 2, 2012

    • hello dominik

      matthewrobertbell

      committed
      0d0cfbdView commit details

      Copy full SHA for 0d0cfbd

      Browse repository at this point
16. Commits on Feb 19, 2012

    • domain_grab works, legacy cruft removed

      matthewrobertbell

      committed
      a441bccView commit details

      Copy full SHA for a441bcc

      Browse repository at this point
17. Commits on Feb 17, 2012

    • i think i have abstracted myself out

      matthewrobertbell

      committed
      aaee979View commit details

      Copy full SHA for aaee979

      Browse repository at this point

    • do not waste proxies sir

      matthewrobertbell

      committed
      290c3f7View commit details

      Copy full SHA for 290c3f7

      Browse repository at this point

    • Wanna split your ProxyManager for use in multiple processes?

      matthewrobertbell

      committed
      700e6daView commit details

      Copy full SHA for 700e6da

      Browse repository at this point

    • args, kwargs, this is fucking inception, how deep you wanna go?

      matthewrobertbell

      committed
      781099dView commit details

      Copy full SHA for 781099d

      Browse repository at this point

    • pooler args, kwargs experiment, a few cleanups

      matthewrobertbell

      committed
      42405ebView commit details

      Copy full SHA for 42405eb

      Browse repository at this point
18. Commits on Feb 14, 2012

    • remove custompool

      matthewrobertbell

      committed
      fec50aaView commit details

      Copy full SHA for fec50aa

      Browse repository at this point

    • move DBC import into the only method that uses it

      matthewrobertbell

      committed
      ff21fc3View commit details

      Copy full SHA for ff21fc3

      Browse repository at this point
19. Commits on Feb 13, 2012

    • queue powered pooler

      matthewrobertbell

      committed
      624a05eView commit details

      Copy full SHA for 624a05e

      Browse repository at this point
20. Commits on Jan 30, 2012

    • RandomLines now detects stale index files based on source file size

      matthewrobertbell

      committed
      78135dfView commit details

      Copy full SHA for 78135df

      Browse repository at this point
21. Commits on Jan 24, 2012

    • destructor for BloomFilter, decrease how often autosave happens

      matthewrobertbell

      committed
      6077e30View commit details

      Copy full SHA for 6077e30

      Browse repository at this point

    • fix fuckup of multi_grab

      matthewrobertbell

      committed
      7cb9310View commit details

      Copy full SHA for 7cb9310

      Browse repository at this point

    • HTTPResponse .lower() the domain, not internal_links() works on an all caps domain

      matthewrobertbell

      committed
      1e9f99aView commit details

      Copy full SHA for 1e9f99a

      Browse repository at this point

    • passing a file object to multi_grab now works (new lines broke it before)

      matthewrobertbell

      committed
      00feff2View commit details

      Copy full SHA for 00feff2

      Browse repository at this point

    • BloomFIlter name (and therefore saving) is optional

      matthewrobertbell

      committed
      62ff31bView commit details

      Copy full SHA for 62ff31b

      Browse repository at this point