crazydevil
Active Member
Знам, че не е точно по темата, но аз лично ползвам този robots.txt за opencart, за да не индексира някои ненужни линкове:
User-agent: Googlebot
Disallow:
User-agent: googlebot-image
Disallow:
User-agent: googlebot-mobile
Disallow:
User-agent: *
Disallow:
Disallow: /*admin
Disallow: /*cache
Disallow: /*download
Disallow: /*export
Disallow: /*library
Disallow: /*system
Disallow: /*route=account*
Disallow: /*route=checkout*
Disallow: /*route=checkout/shipping
Disallow: /*route=common/home
Disallow: /*=common/*
Disallow: /*route=product/product/captcha*
Disallow: /*route=product/product*&manufacturer_id=*
Disallow: /*route=product/search
Disallow: /*route=information/contact/captcha
Disallow: /*route=account/login
Disallow: /*information/sitemap
Disallow: /*route=account/
Disallow: /*route=account/login
Disallow: /*route=checkout/
Disallow: /*route=checkout/cart
Disallow: /*route=affiliate
Disallow: /*route=product/search
Disallow: /*?sort=*
Disallow: /*?sort*
Disallow: /*&sort=*
Disallow: /*?order=*
Disallow: /*?order*
Disallow: /*product/special*
Disallow: /*=DESC
Disallow: /*=ASC
Disallow: /*=rating*
Disallow: /*search&filter_name*
Disallow: /*filter=*
Disallow: /*product/search*
Disallow: /*search&filter_tag*
Disallow: /*route=product/compare*
Disallow: /*filter_tag*
Disallow: /*&order=*
Disallow: /*?limit=*
Disallow: /*&limit=*
Disallow: /*filter_name*
Disallow: /*filter_sub_category*
Disallow: /*filter_description*
Disallow: /*?tracking=*
Disallow: /*&tracking=*
Disallow: /*manufacturer*
Disallow: /*keyword*
Disallow: /*shop/?route*
Disallow: /*/?route*
Disallow: */?route*
Disallow: /*product&path*
Sitemap: http://mysite.com/index.php?route=feed/google_sitemap