Sponsored

Observation on Bots spiders crawling this friendly little B6G Forum

privateer35

Badlands
Well-Known Member
Joined
Jul 21, 2020
Threads
33
Messages
624
Reaction score
808
Location
Seattle
Vehicle(s)
Ford Bronco 2021
Your Bronco Model
Badlands
Clubs
 
I do SEO for a local agency. This forum produces a ton of content (mostly complaining ???)

in order for google to keep the most up to date information, frequent crawling of the forums is necessary. How else do they have news articles in their search results minutes after they are posted!
Came here to say this ^
Sponsored

 

jayhawkco

Badlands
Well-Known Member
First Name
Chris
Joined
Sep 13, 2020
Threads
3
Messages
290
Reaction score
673
Location
Aurora, CO
Vehicle(s)
2006 Nissan Xterra Off Road
Your Bronco Model
Badlands
Not to make everyone sad, but a "robot" or a "crawler" is just a script or program that someone has run, possibly a large website like Google, that "scrapes" or reads the data on the publicly viewed pages to make it readable by that site. So Google would scrape to make it a part of their search engine. If I wrote my own script for a personal web page, it might pull info such as new posts (or B&P notices). Nothing to get too excited about alas.

Chris
 

lenitech

Base
Well-Known Member
First Name
Rob
Joined
Jul 14, 2020
Threads
17
Messages
369
Reaction score
1,138
Location
Granite Bay, CA
Vehicle(s)
1972 Bronco, 2021 Base Sasquatch (AMB)
Your Bronco Model
Base
Clubs
 
I find it crazy that a small dealership in Iowa has a tech savvy guy that figured out how to take advantage of the modern internet to drive mega sales to his dealership from around the country and none of the big dealers in Silicon Valley have figured this out. Instead of them using modern marketing tools they are whining to Ford that it's not fair. I have to give mega props to Albert and Granger for figuring this out.
 

Sponsored

Dads_bronze_bronco

Raptor
Well-Known Member
Joined
Feb 18, 2020
Threads
6
Messages
4,165
Reaction score
7,449
Location
NC
Vehicle(s)
08 JKUR / x_x 00 TJ x_x
Your Bronco Model
Raptor
Clubs
 
I always feel like somebody's watching me...
 

Blksn955.o

Badlands
Well-Known Member
First Name
Greg
Joined
Jun 14, 2020
Threads
17
Messages
1,261
Reaction score
2,579
Location
Wentzville, MO
Vehicle(s)
17 Ford Escape Ti, 94 Ford Mustang GT, 21 BL
Your Bronco Model
Badlands
Clubs
 
Ha, as I sit waiting for a search analytics report finish. Will be running an internal and Google analytics reporting today.
 

vrtical

Raptor
Well-Known Member
First Name
Doug
Joined
Jul 14, 2020
Threads
34
Messages
6,078
Reaction score
12,217
Location
GSMNP, TN
Vehicle(s)
Fords
Your Bronco Model
Raptor
Clubs
 
good ole google crawling the site.

User-agent: *
Disallow: /
 

Monster79

Badlands
Well-Known Member
First Name
E
Joined
Mar 10, 2020
Threads
3
Messages
573
Reaction score
1,571
Location
Alabama
Vehicle(s)
15'Stang, 07'F150, 23',96',93',79'Bronco
Your Bronco Model
Badlands
Clubs
 
Just when I thought your avatar couldn't get any better...

Well done sir, you have won
 

Sponsored
OP
OP
Granger Ford

Granger Ford

Badlands
Well-Known Member
Base Sponsor (Level 1)
First Name
Jay
Joined
Oct 1, 2019
Threads
39
Messages
2,123
Reaction score
9,862
Location
Granger,IA
Website
www.grangerford.com
Vehicle(s)
*
Your Bronco Model
Badlands
Clubs
 
Those were some funny replies, yes we do analytics on our sites as well...

But I did not realize how often and quickly they are gathering the new data was...

Makes the Google buy words more affective...
 

BroncOBX

Black Diamond
Well-Known Member
First Name
Rick
Joined
Jul 14, 2020
Threads
13
Messages
220
Reaction score
400
Location
NoVaStan: Land of the Petulant
Website
www.polaris-intel.com
Vehicle(s)
2012 Ford F-150 FX4; Mavic 2 Pro
Your Bronco Model
Black Diamond
Clubs
 
 


Top