There are two ways to exclude pages from appearing in your search:
- Crawler exclusions
- Excluded pages tool
Crawler exclusions should be used when there are multiple pages that can be excluded and there's a pattern in the URL that can be used to identify how the excluded pages should be removed.
Go to your crawler settings and select the crawler you'd like to exclude pages from.
In step one, domains to be crawled, go to the URLs to be excluded from the crawler section to the right of the domains to be crawled. This is helpful if you would like to exclude old archives from appearing in search. Enter the URL match you'd like to use to exclude pages and hit the + sign.
*When creating crawler exclusions using a URL match, any URL that contains that string will be ignored and excluded from the search index. For example, an exclusion for /2016 would exclude all pages that have /2016 in the URL.
You can also use Regular Expression (regex) to exclude pages. To find this setting, click Advanced Settings and add the expression
The excluded pages tool allows users to prevent specific pages from showing up in the results of any search that is performed on their site. This tool allows you to search the index for a specific page that has already been indexed and remove it from the search engine.
To exclude a page, go to the Excluded Pages tool in your MyCludo menu.
To exclude pages from searches performed on your site, click the “New” button in the upper-right corner of the main excluded pages screen.
After clicking “New,” an overlay appears where you can search for pages by either title or URL. When you input a title or URL into the text box, a search occurs automatically, providing you with a list of web pages that you can exclude your searches.
The pages presented in the list have a title and a URL. If you click on the URL, you are directed to that page, allowing you to make sure it is a page that you want to exclude. By clicking on the “+” button that corresponds to a page, that page is placed in a sublist where it can be excluded from your searches. If a page does not have a “+” button, that page has either been ranked or is already excluded using the page ranking tool and cannot be added as an excluded page using this tool.