Google Indexing Over 90,000 Pages

Get answers to your installation and setup questions.
Post Reply
bnownlater
Experience Level 2
Experience Level 2
Posts: 56
Joined: Tue Dec 30, 2008 11:42 am
Location: Orlando, Florida
Contact:

Google Indexing Over 90,000 Pages

Post by bnownlater » Fri Apr 05, 2013 8:27 am

I am seeing through Google Webmaster Tools that one of my sites that just got upgraded from 530 to 540 has over 91,500 pages indexed (the high was 251,000). I only have 42 category pages (42 cat x 10 items x 10 pages = 4200 max pages). Some where Google is crawling Amazon category links and indexing products that do not fit my filters. So my topical relevancy for the site is being trashed with unrelated products.

I took a look at another site using AOM running 521. There were 1300 pages reported as indexed in GWT. I have 26 category pages (26 cat x 10 items x 10 pages = 2400 max pages). So the range of indexed pages is more inline.

Anyone else notice this on their sites? Unfortunately those extra pages produce 200 HTTP status so Google would have no reason to drop them from their index.
Associate-O-Matic is changing. For the better. 8)

Please CLICK HERE for our important announcement.

jquarta
Experience Level 7
Experience Level 7
Posts: 532
Joined: Thu Nov 30, 2006 7:09 am
Location: Big Sky Country, Montana
Contact:

Re: Google Indexing Over 90,000 Pages

Post by jquarta » Fri Apr 05, 2013 10:10 am

This is what Google has been doing for quite awhile! I adjusted their crawl rate down to it's lowest setting, (under pressure from my host) after googlebot crashed my server multiple times in a week! It appears it was in the process of indexing the whole Amazon catalog! I have over 900,000 pages indexed according to webmaster tools!

I am way past the point of caring what Google does! Matt Cutts complains about duplicate content, yet the problems arise and are caused by Goolebot itself, and not from affiliate sites with little or no content!

Joe...
Associate-O-Matic is changing. For the better. 8)

Please CLICK HERE for our important announcement.

infomatique
Experience Level 1
Experience Level 1
Posts: 18
Joined: Sat Apr 19, 2008 4:58 am

Re: Google Indexing Over 90,000 Pages

Post by infomatique » Fri Apr 19, 2013 8:38 pm

I am a bit confused by this discussion ... Based on my experience if you submit site maps with say 5000 links that is the maximum that will be indexed.
Associate-O-Matic is changing. For the better. 8)

Please CLICK HERE for our important announcement.

more4kids
Experience Level 1
Experience Level 1
Posts: 25
Joined: Sat Feb 20, 2010 12:04 pm

Re: Google Indexing Over 90,000 Pages

Post by more4kids » Mon Apr 22, 2013 5:24 pm

Will this affect the amazon api at all?
Associate-O-Matic is changing. For the better. 8)

Please CLICK HERE for our important announcement.

jquarta
Experience Level 7
Experience Level 7
Posts: 532
Joined: Thu Nov 30, 2006 7:09 am
Location: Big Sky Country, Montana
Contact:

Re: Google Indexing Over 90,000 Pages

Post by jquarta » Mon Apr 22, 2013 6:33 pm

I am a bit confused by this discussion ... Based on my experience if you submit site maps with say 5000 links that is the maximum that will be indexed.
Nothing is set in stone with Googlebot, they will index one page or thousands at any given time regardless of any sitemap submitted! Unfortunately there is no maximum number that Googlebot adheres to in either direction!

Joe...
Associate-O-Matic is changing. For the better. 8)

Please CLICK HERE for our important announcement.

Post Reply

Who is online

Users browsing this forum: No registered users and 16 guests