arachnode.net
An Open Source C# web crawler with Lucene.NET search using SQL Server 2008/2012/2014/2016/CE An Open Source C# web crawler with Lucene.NET search using MongoDB/RavenDB/Hadoop

Completely Open Source @ GitHub

Does arachnode.net scale? | Download the latest release

How to learn the 'arachnode'?

rated by 0 users
Answered (Verified) This post has 1 verified answer | 11 Replies | 4 Followers

Top 100 Contributor
4 Posts
cyj1988jyc posted on Tue, May 19 2009 9:35 PM

Hello,Why don't you write some tutorials to learn the 'arachnode.net'?

I find that it is hard to learn only from the code.

Thanks.

Answered (Verified) Verified Answer

Top 10 Contributor
1,905 Posts

MAIN INSTALLATION DOCUMENTATION LINK: http://arachnode.net/Content/InstallationInstructions.aspx

New help links:  http://arachnode.net/Content/WalkthroughVideo.aspx, http://arachnode.net/Content/GettingStartedGuide.aspx

http://www.youtube.com/user/arachnodenet

 

 

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

All Replies

Top 10 Contributor
1,905 Posts

Someday perhaps.  (It is time consuming enough as it is to craft the code... :))

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Top 10 Contributor
1,905 Posts

Documentation is in the works ATM... coming very shortly...

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Top 150 Contributor
2 Posts

Hello,

I'm trying to get my head around arachnode.net but its really hard to know what all the projects in the codeplex zip do. Is there any basic 'getting started' documentation? Or can someone tell me what the console project does? does it initialize things?

Just some basic explanation on how the search works or how to crawl a website etc would clear a lot for me (and hundreds of other arachnode enthusiasts)

Thanx a lot,

Cypress

Top 10 Contributor
1,905 Posts

I know I posted this before, in this thread, but additional documentation is coming shortly.

The console project is a demo of how you might wire up the API to perform crawling operations.  Instantiating the Crawler(.cs) initializes the main configuration.

What else can I help you with?

Mike

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Top 150 Contributor
2 Posts

Thanks Mike for your quick response.

I first tried the Web porject. I started the Search.aspx and it always gave me the error that nog segment files (=indexex?) were found in my LuceneIndex folder. I then tried to run the console and it created some of those index files and now my Search seems to work. Is it necessary to run the console before you run anything else? If so, that info can be usefull for other newby users.

I'm really looking forward to the documentation.

Regards,

Cypress

Top 10 Contributor
1,905 Posts

Cypress -

You are correct.  You need to run the Console application before you run the Web project.

I am too!  The AN team member IS working on it!  Smile

-Mike

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Top 10 Contributor
1,905 Posts

MAIN INSTALLATION DOCUMENTATION LINK: http://arachnode.net/Content/InstallationInstructions.aspx

New help links:  http://arachnode.net/Content/WalkthroughVideo.aspx, http://arachnode.net/Content/GettingStartedGuide.aspx

http://www.youtube.com/user/arachnodenet

 

 

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Top 75 Contributor
5 Posts

hello, http://arachnode.net/Content/WalkthroughVideo.aspx, http://arachnode.net/Content/GettingStartedGuide.aspx 

 

 

Last nigth i read them is not this, please help me.

Top 75 Contributor
5 Posts

 

the  urls(http://arachnode.net/Content/WalkthroughVideo.aspx, http://arachnode.net/Content/GettingStartedGuide.aspx) are not working normally now, please help, thank you!

Top 10 Contributor
1,905 Posts

Sorry about that - restoring now...

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Page 1 of 1 (11 items) | RSS
An Open Source C# web crawler with Lucene.NET search using SQL 2008/2012/CE

copyright 2004-2017, arachnode.net LLC