Peppermint OS Community Forum

General => General Discussion => Topic started by: williamthe1st on February 14, 2018, 02:37:17 am

Title: What are Spiders
Post by: williamthe1st on February 14, 2018, 02:37:17 am
Ive for the first time noticed at the bottom of the main forum page its says .......  49 Guests, 2 Users (4 Spiders)

Can some one please explain the 4 Spiders  :-\

William
Title: Re: What are Spiders
Post by: zebedeeboss on February 14, 2018, 02:45:54 am
Hi

In their most simplistic terms, You can think of these spiders as information gather's running round the web collecting and collating information stipulated by their parameters. ie Find all Linux related Forums - or find all web sites with the word "Peppermint" in them.

Web search engines will use them.

There maybe other reasons too and if I am completely wrong, lol, we will both find out   :D

Regards Zeb...


Title: Re: What are Spiders
Post by: williamthe1st on February 14, 2018, 03:10:08 am
Hi

In their most simplistic terms, You can think of these spiders as information gather's running round the web collecting and collating information stipulated by their parameters. ie Find all Linux related Forums - or find all web sites with the word "Peppermint" in them.

Web search engines will use them.

Regards Zeb...

Thanks Zeb , now I understand , I learn some thing new every day  :)


William
Title: Re: What are Spiders
Post by: PCNetSpec on February 14, 2018, 07:40:24 am
Yeah basically they are automated bots that crawl the web gathering information for their makers .. think - How does Google/Yahoo/Bing/Baidu/etc. collate new web content for display in their search results ?, it's because their spiders crawl the web following hyperlinks looking for and logging changes.

Not all spiders are necessarily from search engines .. some are corporate, governmental, or academic research .. but they are all automated algorithms that crawl the "web", hence "spider" :)