Choose style:

Author Topic: Users Online -- Is Google a Spider? (SOLVED)  (Read 3605 times)

0 Members and 1 Guest are viewing this topic.

Offline perknh

  • Trusted User
  • Hero
  • *****
  • Posts: 3849
  • Karma: 303
  • Soy un huevo, nada más.
    • View Profile
  • Peppermint version(s): Peppermint 10
Users Online -- Is Google a Spider? (SOLVED)
« on: April 17, 2014, 05:12:59 pm »
Hello everyone,

I often like to see what the activity is like in Peppermint forum.  Usually there are several users on line, and few quests.  But what in the world is a spider?  I often seen Google listed without actually seeing Google in the user/guest/ administrator lineup.  Is Google a spider?

Are we always being automatically scanned by Google?

Thanks,

perknh
« Last Edit: May 05, 2014, 06:24:29 am by perknh »
We're all Peppermint users and that's what matters  ;).  -- AndyInMokum

Online VinDSL

  • Global Moderator
  • Hero
  • *****
  • Posts: 5397
  • Karma: 948
  • Peppermint Mod
    • View Profile
  • Peppermint version(s): Developmental Builds
Re: Users Online -- Is Google a Spider?
« Reply #1 on: April 17, 2014, 05:59:13 pm »
Are we always being automatically scanned by Google?

Short answer: yes   ;)

Offline mac

  • Global Moderator
  • Veteran
  • *****
  • Posts: 1088
  • Karma: 336
    • View Profile
  • Peppermint version(s): Peppermint 7-8-9
Re: Users Online -- Is Google a Spider?
« Reply #2 on: April 17, 2014, 05:59:33 pm »
Yep, automatically scanned by Google (and others).  But don't worry, it isn't NSA.  They gather info for their search engine(s). ;)
Peppermint: Standing Out from the Cloud
Reg. Linux User #432835

Online VinDSL

  • Global Moderator
  • Hero
  • *****
  • Posts: 5397
  • Karma: 948
  • Peppermint Mod
    • View Profile
  • Peppermint version(s): Developmental Builds
Re: Users Online -- Is Google a Spider?
« Reply #3 on: April 17, 2014, 06:23:49 pm »
Google et al. and their bots are quite insidious -- it's the primary reason I don't use the Chrome browser.

Of course, it's a double-edged sword that can work to your advantage, especially for SEO, but that's fodder for a different discussion.

I was building a web page once, testing it with Chrome.  I had the test page outside the normal  webpath, and blocked from public viewing.  Yet, the page turned up in the Google Search results, a few minutes later.  Go figure.

And, here's more recent Google weirdness (yesterday), dissociated with Chrome...

I tried to access my account on a US government website yesterday, but I didn't have the password relegated to memory.  After 3 fails, it locked me out of the site for 24 hours.  Immediately after this, I did a Google Search for something, and the result page required me to answer a two-word Captcha riddle before displaying the results.  That's a first, for me.  I *assume* Google thought I was a bot, because I failed to furnish the correct password on the US government website.  I highly doubt it was a coincidence.

Personally, I think all of this stuff is connected more than ppl realize.  ;)

Online VinDSL

  • Global Moderator
  • Hero
  • *****
  • Posts: 5397
  • Karma: 948
  • Peppermint Mod
    • View Profile
  • Peppermint version(s): Developmental Builds
Re: Users Online -- Is Google a Spider?
« Reply #4 on: April 18, 2014, 06:48:15 am »
Heh! 

Baidu bots were reported, this morning... :)

Offline kendall

  • Developer
  • Member
  • *****
  • Posts: 535
  • Karma: 75
  • Peppermint Dev
    • View Profile
    • http://kendallweaver.com
Re: Users Online -- Is Google a Spider?
« Reply #5 on: April 18, 2014, 02:03:58 pm »
A quick image search revealed this:

Co-Founder and CTO of Peppermint. Developer, Photographer, and spicy food lover.

Peppermint is powered by VPS.NET Cloud Servers.

Offline 10i

  • Trusted User
  • Member
  • *****
  • Posts: 481
  • Karma: 129
  • Peppermint Enthusiast
    • View Profile
    • My Peppermint Blog
  • Peppermint version(s): Peppermint 10 - 64 bit
Re: Users Online -- Is Google a Spider?
« Reply #6 on: April 18, 2014, 02:07:38 pm »
They have cars with cameras on to spy on us irl, and spiders to watch us online! Eeeeeeppp!!!

Sent from my GT-I9100 using Tapatalk

Running Peppermint 8- 64 bit on my Lenovo i3 laptop.

View my Linux blog:  http://myiceadventure.blogspot.com

Offline perknh

  • Trusted User
  • Hero
  • *****
  • Posts: 3849
  • Karma: 303
  • Soy un huevo, nada más.
    • View Profile
  • Peppermint version(s): Peppermint 10
Re: Users Online -- Is Google a Spider?
« Reply #7 on: April 18, 2014, 05:04:15 pm »
In reference to Kendall's quick image search.

Not only do I know now that Google is a spider, but I also know now what the Google spider actually looks like!

Good one!!   ;D

And here's a little something from Wikipedia to help define what a Web spider a.k.a a Web crawler is:

Web crawler
From Wikipedia, the free encyclopedia

Not to be confused with offline reader. For the search engine of the same name, see WebCrawler.

A Web crawler is an Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing. A Web crawler may also be called a Web spider,[1] an ant, an automatic indexer,[2] or (in the FOAF software context) a Web scutter.[3]

Web search engines and some other sites use Web crawling or spidering software to update their web content or indexes of others sites' web content. Web crawlers can copy all the pages they visit for later processing by a search engine that indexes the downloaded pages so that users can search them much more quickly.
Crawlers can validate hyperlinks and HTML code. They can also be used for web scraping (see also data-driven programming).

Here's the Wikipedia link, if you want to know more:

https://en.wikipedia.org/wiki/Web_crawler#Overview
« Last Edit: April 19, 2014, 06:52:46 am by perknh »
We're all Peppermint users and that's what matters  ;).  -- AndyInMokum

Offline TonyB

  • Jr. Member
  • **
  • Posts: 34
  • Karma: 8
  • I'm right by the ocean in sunny KZN, South Africa
    • View Profile
  • Peppermint version(s): Peppermint 5
Re: (Solved) Users Online -- Is Google a Spider?
« Reply #8 on: April 19, 2014, 12:07:21 pm »
I'm veering off-topic, which I am assured is quite normal for people my age,  but the pic Kendall posted hasn't got enough legs for a spider, has it?

In any event, it doesn't look friendly.


Online VinDSL

  • Global Moderator
  • Hero
  • *****
  • Posts: 5397
  • Karma: 948
  • Peppermint Mod
    • View Profile
  • Peppermint version(s): Developmental Builds
Re: (Solved) Users Online -- Is Google a Spider?
« Reply #9 on: April 19, 2014, 04:56:25 pm »
I'm veering off-topic, which I am assured is quite normal for people my age,  but the pic Kendall posted hasn't got enough legs for a spider, has it?

It's Google.  They truncate the legs, if they're above a certain amount...   ;)