2DWorlds Forums › Off Topic › Programming v
I created a crawler!

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Thread Modes
I created a crawler!
Dignity Offline
Posting Freak
*****
Posts: 1,725
Threads: 105
Joined: Feb 2011
Reputation: 0
#1
09-23-2011, 01:00 AM (This post was last modified: 09-23-2011, 09:33 PM by Eyrk.)
(Just wait for the max-resource-error to be resolved)

http://vscope.tk/Crawl/

I highly advise NOT to not to enter a url. (confusing, eh?)

It isn't perfect, so some pages may appear as 301 Moved Permanently.
High Resource Error gone.

Time to make a search engine.
Find
Reply


Messages In This Thread
I created a crawler! - by Dignity - 09-23-2011, 01:00 AM

Forum Jump:


Users browsing this thread: 2 Guest(s)