Engines are at the heart of Cludo as it puts you in control of the search relevance. An engine is in charge of pulling the right content from a crawler(s) when a search query takes place. In relation to a crawler, the crawler’s job is to gather the different sources of content for a search and then the engine’s job is to process it to provide relevant search results.
When to create an Engine
One engine can pull multiple sources of content from a crawler(s). An engine is configured to show specific content indexed by a crawler, in which you can control a search engine’s page rankings, banners, quicklinks, misspellings, synonyms, and excluded pages. To determine whether you need multiple engines, ask yourself the following questions:
- Do I have multiple languages on my site(s)?
- Do I need to show a very specific set of pages/domains on a website’s search versus another website?
- Does the relevancy of a search differ from site to site?
If you answered yes to any of these questions, you may want to create multiple engines.
For example, if you have multiple languages across your website(s), you will want to ensure only the English pages are processed by a search engine dedicated to the English website, and a French crawler points to a French engine.
You may have a subdomain of a website have a dedicated search engine to only it’s pages instead of a global search engine. For instance, if you have a subdomain that includes information about old press releases or city meeting notes, you may want the search engine to only pull content from the relevant sources instead of all of the content that is being indexed for the global site search.
If you have a specific strategy for search on a site that differs from another, you can create a specific engine to configure the boosting value for each engine. For example, on a law firms website, you may want to create an engine that boosts the partners higher than press releases, but on the blog, you want to boost press releases and exclude partner pages.
The number of engines available in an account will vary per plan. Please review your contract for contact support for more details.
If you have questions about when to create new engines versus crawlers, please contact support. We want to ensure you have the right setup for your search needs.
Create an Engine
To create a new engine, go to the Settings menu, located on the left side of your MyCludo dashboard, and select Engines. Click New.
First, name the engine. This can be the name of the site that the engine will be used on. You may edit the name as needed.
Assign the crawlers to the engine. When adding a crawler to an engine, any content that a crawler has indexed will be included in the library of pages for the engine. You can point multiple crawlers to one engine.
Filters allow you to include a very specific set of content indexed by a crawler. Filtering options are available based on the settings configured for the specific crawler. If you only want a specific section to be included in the engine, you can use a filter to narrow the pages. For example, if I only want the product updates blog posts from the Blog crawler to be indexed on the Main website engine, I can create a filter to only pull content that has /product-update in the URL.
Viewing Engines in MyCludo
You can toggle between different engines using the drop-down menu on the top navigation, next to the timeframe selector.
All dashboards, analytics, tools, and settings are specific to one engine.