Do we need to disallow aom folders in robots.txt

Questions, tips and ideas related to marketing, SEO and Google.
Post Reply
MrXgame
Experience Level 1
Experience Level 1
Posts: 11
Joined: Sat Jun 23, 2012 9:11 pm

Do we need to disallow aom folders in robots.txt

Post by MrXgame » Fri Sep 14, 2012 7:23 pm

I'm still confusing that do we need to put disallow this from user-agent in robots.txt :
/admin.php
/aom/
/ioncube/

someone please help, or refer to forum if already answered.

I will apply the answer to my aom:
http://www.kidstazion.com
http://www.mrxgame.com
http://www.rajaadwords.com
http://www.tiresandwheelsdepot.com

I got no traffic and sales anymore from the above domain,

Thanks for help
MrXgame
Associate-O-Matic is changing. For the better. 8)

Please CLICK HERE for our important announcement.

mcarp555
Admin
Admin
Posts: 4088
Joined: Thu Sep 14, 2006 5:19 pm
Location: United Kingdom
Contact:

Re: Do we need to disallow aom folders in robots.txt

Post by mcarp555 » Fri Sep 14, 2012 11:50 pm

I probably wouldn't. The admin.php file is encoded, anyway. Most of the files in the /ioncube directory don't contain anything useful or legible as well. Disallowing the /aom directory might interfere with legitimate attempts to read things like template files, images, etc.

I tend to block things like the View Cart, Search and Advanced Search pages, since they're more or less the same on every site. Which makes them a potential source of duplicate content.
Associate-O-Matic is changing. For the better. 8)

Please CLICK HERE for our important announcement.

User avatar
littletoons
Experience Level 10
Experience Level 10
Posts: 1208
Joined: Mon Oct 01, 2007 9:53 am
Location: Atlanta, Georgia USA
Contact:

Re: Do we need to disallow aom folders in robots.txt

Post by littletoons » Sun Sep 16, 2012 3:41 pm

I wouldn't block anything that has to do with the program. Keep in mind tens of thousands of sites use ioncube as a means to decode proprietary code. You're not going to be penalized on that. You would if you have the same sales checkout page as 22,000 other sites though :)
Associate-O-Matic is changing. For the better. 8)

Please CLICK HERE for our important announcement.

earthylad
Experience Level 3
Experience Level 3
Posts: 135
Joined: Thu Oct 21, 2010 6:19 am

Re: Do we need to disallow aom folders in robots.txt

Post by earthylad » Thu Sep 27, 2012 1:23 pm

Having read this thread I'm a bit concerned about the robots file I have at the moment. Could someone give some guidance on what to disallow in the program itself. My robots file is below. I do have to watch the bandwidth as I have 2Gb limit. Thanks!

User-agent: *
Disallow: /aom/
Disallow: /ioncube/
Disallow: /images/

User-agent: *
Disallow: /shop.php?a=cartview/
Disallow: /shop.php?a=advanced/
Disallow: /ship.php
Disallow: /page-shippinginfo.html
Disallow: /page-contactus.html
Disallow: /bad-bots.php

Sitemap: http://www.gardenallsorts.com/shop.php?a=sitemap
Associate-O-Matic is changing. For the better. 8)

Please CLICK HERE for our important announcement.

mcarp555
Admin
Admin
Posts: 4088
Joined: Thu Sep 14, 2006 5:19 pm
Location: United Kingdom
Contact:

Re: Do we need to disallow aom folders in robots.txt

Post by mcarp555 » Thu Sep 27, 2012 3:08 pm

As I said, I wouldn't worry about the folders. I think it's good to have the standard AOM pages (View Cart, Advanced Search, etc.) in the robots.txt file, since they're common to many thousands of AOM sites.
Associate-O-Matic is changing. For the better. 8)

Please CLICK HERE for our important announcement.

earthylad
Experience Level 3
Experience Level 3
Posts: 135
Joined: Thu Oct 21, 2010 6:19 am

Re: Do we need to disallow aom folders in robots.txt

Post by earthylad » Thu Sep 27, 2012 4:29 pm

Thanks Mike! That makes it clear enough :D
Associate-O-Matic is changing. For the better. 8)

Please CLICK HERE for our important announcement.

abhigarg
Posts: 7
Joined: Fri Jun 07, 2013 5:20 am
Contact:

Re: Do we need to disallow aom folders in robots.txt

Post by abhigarg » Tue Jun 25, 2013 5:22 am

Yes, You need to do this because these are the file which do nothing with users... so avoid them to being indexed by Google

hide all the pages that contain files that do nothing with users because it creates too many unnecessary pages that's increase pageload and also decrease the value of the website
Associate-O-Matic is changing. For the better. 8)

Please CLICK HERE for our important announcement.

Post Reply

Who is online

Users browsing this forum: No registered users and 2 guests