arachnode.net
An Open Source C# web crawler with Lucene.NET search using SQL Server 2008/2012/2014/2016/CE An Open Source C# web crawler with Lucene.NET search using MongoDB/RavenDB/Hadoop

Completely Open Source @ GitHub

Does arachnode.net scale? | Download the latest release
80 Legs Private Beta

What would you do with the bandwidth and power of 50,000 computers?

It's time to find out.

80legs is a service platform for web crawling and processing web content. We give you access to the bandwidth and computing power of over 50,000 computers at prices anyone can afford. Our flexible platform allows you to completely customize how you crawl and process the web. With 80legs, the web is within your reach.

Learn more or contact us to join the private beta.

Looks cool!  I bet they're using arachnode.net for the base.  Stick out tongue

Also, they entered 'arachnode.net' as one of their AdWords keywords.  Cool!



Posted Sat, Aug 1 2009 10:38 AM by arachnode.net
Filed under:
An Open Source C# web crawler with Lucene.NET search using SQL 2008/2012/CE

copyright 2004-2017, arachnode.net LLC