I work in a company that owns a Magento 1.9 store and in order to optimize the search it organizes we are trying to delete hundreds of pages indexed by google, however, I am facing two difficulties.
Shop: lojamastertoys.com
1) The "Categories" page is generic, it looks at all products whether they are boys or girls, so this category and all its dependencies have been set as noindex, nofolow in meta robots, it is still indexed. p>
2) In Robots.txt it was set to exclude for example the category page and all its dependencies, as well as my account page, contact, about, whishlist, product_search among others, they are still indexed after some days.
Below I will put my robots.txt, maybe I have done something wrong or you might know another solution to delete these several pages.
User-agent: Googlebot-Image
User-agent: googlebot
User-agent: google
User-agent: bingbot
User-agent: bing
Disallow: /404
Disallow: /app
Disallow: /cgi-bin
Disallow: /downloader
Disallow: /errors
Disallow: /includes
Disallow: /lib
Disallow: /magento
Disallow: /pkginfo
Disallow: /report
Disallow: /scripts
Disallow: /shell
Disallow: /stats
Disallow: /var
Disallow: /index.php
Disallow: /catalogsearch
Disallow: /catalogsearch/*
Disallow: /catalog/*
Disallow: /catalog/product_compare
Disallow: /catalog/product_compare/*
Disallow: /catalog/category/view
Disallow: /catalog/category/view/*
Disallow: /catalog/product/view
Disallow: /catalog/product/view/*
Disallow: /catalog/product/gallery
Disallow: /catalog/product/gallery/*
Disallow: /checkout
Disallow: /control
Disallow: /contacts
Disallow: /customer
Disallow: /customize
Disallow: /newsletter
Disallow: /poll
Disallow: /review
Disallow: /sendfriend
Disallow: /tag
Disallow: /wishlist
Disallow: /cron.php
Disallow: /cron.sh
Disallow: /error_log
Disallow: /install.php
Disallow: /LICENSE.html
Disallow: /LICENSE.txt
Disallow: /LICENSE_AFL.txt
Disallow: /STATUS.txt
Disallow: /*?SID=
Disallow: /*?*SID=
Disallow: /politica-de-trocas
Disallow: /categorias
Disallow: /categorias/*
Disallow: /sobre
Disallow: /contato