Engines are at the heart of Cludo as it puts you in control of the search relevance. An engine is in charge of pulling the right content from a crawler(s) when a search query takes place. In relation to a crawler, the crawler’s job is to gather the different sources of content for a search and then the engine’s job is to process it to provide relevant search results.
When to create an Engine
One engine can pull multiple sources of content from a crawler(s). An engine is configured to show specific content indexed by a crawler, in which you can control a search engine’s page rankings, banners, quicklinks, misspellings, synonyms, and excluded pages. To determine whether you need multiple engines, ask yourself the following questions:
- Do I have multiple languages on my site(s)?
- Do I need to show a very specific set of pages/domains on a website’s search versus another website?
- Does the relevancy of a search differ from site to site?
If you answered yes to any of these questions, you may want to create multiple engines.
For example, if you have multiple languages across your website(s), you will want to ensure only the English pages are processed by a search engine dedicated to the English website, and a French crawler points to a French engine.
You may have a subdomain of a website have a dedicated search engine to only it’s pages instead of a global search engine. For instance, if you have a subdomain that includes information about old press releases or city meeting notes, you may want the search engine to only pull content from the relevant sources instead of all of the content that is being indexed for the global site search.
If you have a specific strategy for search on a site that differs from another, you can create a specific engine to configure the boosting value for each engine. For example, on a law firms website, you may want to create an engine that boosts the partners higher than press releases, but on the blog, you want to boost press releases and exclude partner pages.
The number of engines available in an account will vary per plan. Please review your contract for contact support for more details.
If you have questions about when to create new engines versus crawlers, please contact support. We want to ensure you have the right setup for your search needs.
Create an Engine
To create a new engine, go to the Settings menu, located on the left side of your MyCludo dashboard, and select Engines. Click New.
First, name the engine. This can be the name of the site that the engine will be used on. You may edit the name as needed.
Assign the crawlers to the engine. When adding a crawler to an engine, any content that a crawler has indexed will be included in the library of pages for the engine. You can point multiple crawlers to one engine.
Filters allow you to include a very specific set of content indexed by a crawler. Filtering options are available based on the settings configured for the specific crawler. If you only want a specific section to be included in the engine, you can use a filter to narrow the pages. For example, if I only want the product updates blog posts from the Blog crawler to be indexed on the Main website engine, I can create a filter to only pull content that has /product-update in the URL.
Boosting search results is one of the most powerful features of Cludo. Cludo already as an intelligent algorithm to provide relevant results, however, as a user, you have the power to further control ranking for the search. Boost areas of your website that are important to your web strategy and lower the value of the areas that are not as relevant. For example, within higher education, you may want to boost your admissions page results higher than your campus news pages. In legal, you may want to ensure you boost your partner pages higher than an associate. You may also want to decrease the boosting on old news articles. Review your website goals and ensure the search engine and boosting support your goals.
To add a new boosting, click Add Boosting, and set up the criteria of what you’d like to boost.
- Boosting based on path: Boost a result based on a URL match. For example, anything with /products should be ranked higher than the other results.
- Boosting based on a field: Boost a result based on a query match with the title, category, Id, or any custom fields set. For example, if someone searches the word “tuition”, boost all the pages that have “tuition” in the page title higher.
- Boosting based on a field value comparison: Boost a result where a specified field contains a specific value. For example, if the category contains Admissions for a specific search result, display the page higher.
- Dynamic boosting: Boost a result dynamically using a defined value set within a specified field. If you have a custom field to pull a value for how high you would like a page boosted, the engine will dynamically rank it accordingly. This boosting is controlled by the custom field that is set.
Boosting at 100% is what the average algorithm is set to. Anything boosted over 100% will increase it’s ranking and anything boosted under 100% will decrease it. The boosting percentage is multiplied by the calculated ranking score.
Viewing Engines in MyCludo
You can toggle between different engines using the drop-down menu on the top navigation, next to the timeframe selector.
All dashboards, analytics, tools, and settings are specific to one engine.