What are the bots?

Questions and updates for http://www.railroadfan.com are posted here. If anyone has suggestions, either post here or email me at zack@railroadfan.com.
User avatar
Ypsi
The Bestest Railroadfan... fan
Posts: 5511
Joined: Sun Feb 07, 2010 2:13 pm

What are the bots?

Unread post by Ypsi »

just curious about the "bots that appear in the users online area, like Bing[Bot] and Google[Bot] what do they do?
"Ann Arbor 2373 Calling... Milkshake. Over"

All Aboard Amtrak: Northbound, Southbound, and My Hometown

Michigan Railfan
Railroadfan...fan
Posts: 407
Joined: Sun Oct 16, 2011 11:04 pm
Location: Brownstown, MI
Contact:

Re: What are the bots?

Unread post by Michigan Railfan »

I agree. What are they? I do have a theory, though.

The bots are Google and Bing, two of the biggest and most known search engines on the web. My guess is that they are possibly "users" that are always online to display search queries. As in, if someone searches something train related, Google and Bing would show links to this website. It may be like this for all websites, but for some reason only this site shows them.
Jake
Railroading YouTube channel: http://www.youtube.com/user/trainster100
Aviation YouTube channel: http://www.youtube.com/user/dtwdelta763

User avatar
~Z~
Sofa King Admin
Posts: 12946
Joined: Tue Oct 12, 2004 2:14 pm
Location: Grand Rapids, MI
Contact:

Re: What are the bots?

Unread post by ~Z~ »

The site recognizes when google, bing, and various other search engines are crawling the site. Basically these search engines keep visiting the site, they check for updated pages, which is basically every time someone posts anything, and the search engines will browse through, updating their own databases. Googleadsense bot stops by a lot too to try to figure out what ads to display on the threads. Our site is crawled many times a day, so google keeps a very up-to-date snapshot of what is on the site so they can direct users at us with fresh information.

Bots crawl most other sites..some sites turn off the crawling ability by altering their robots.txt file in the root directory. I let the bots crawl as it really helps to drive in new users, and we have plenty of bandwidth to let them roam.
Webmaster
Railroad photos on Railroadfan.com

User avatar
Ypsi
The Bestest Railroadfan... fan
Posts: 5511
Joined: Sun Feb 07, 2010 2:13 pm

Re: What are the bots?

Unread post by Ypsi »

ahhhhhhh i always wondered about them and now i know :D
"Ann Arbor 2373 Calling... Milkshake. Over"

All Aboard Amtrak: Northbound, Southbound, and My Hometown

User avatar
Jetlink
Not a Railfan
Posts: 3575
Joined: Mon Jun 27, 2011 2:41 pm
Location: 2.5 miles from CH 116.3

Re: What are the bots?

Unread post by Jetlink »

~Z~ wrote: I let the bots crawl as it really helps to drive in new users,
That's how I found your site.
interested in trains

Patiently waiting for LansingRailfan to antagonize me in his tagline

User avatar
GR Ron
Railroadfan...fan
Posts: 124
Joined: Tue Sep 30, 2008 11:03 am
Location: Grand Rapids (Rockford/Cedar Springs area)

Re: What are the bots?

Unread post by GR Ron »

Glad we go to the "Bots"tom of that!!!!!! :lol: :roll:
GR Ron

DelayInBlock
Railroadfan...fan
Posts: 455
Joined: Fri Sep 23, 2011 4:47 pm
Location: Cleveland, TN
Contact:

Re: What are the bots?

Unread post by DelayInBlock »

I have a really stupid sounding question, forgive me, but what is bandwidth? I have another question for later, but my fingers are sore from typing messages all night! Ha!
Delay In Block Productions: "Railroading a Little Different than Usual."

Visit my YouTube Channel and Subscribe: http://www.YouTube.com/user/DelayInBlock
Like My Page on Facebook: http://www.Facebook.com/DelayInBlockProductions

Post Reply