Cludo supports intranet searches for Enterprise subscriptions. Please reach out to an Account Executive to discuss if Cludo can support your intranet search and for a scope of work.
Accessing and crawling intranet websites:
Typically crawler access is located behind a login on on-premise. Cludo supports the following methods for crawling an intranet or password-protected website:
- Allow Cludo's crawler-IP to access the site
- Push API (not recommended)
Setting up the search engine on intranets
There are two different ways to set up an engine on an intranet site.
Option A: Standard Implementation
For websites that are password protected with low levels of security, you can implement Cludo similar to public engines. In this instance, the page title, description, and URL of the intranet pages will be exposed in the search. It is up to the client to ensure that access beyond that is verified once accessing the page through the search results page.
Option B: Using an internal relay-server
Cludo provides secure intranet search using an internal relay-server on the customer network.
This ensures that requests from outside of the customer organization cannot access confidential information.
Intranet security works by requiring a secret key that needs to be provided with every search request. This key is referred to as the customer key. For public-facing search solutions, the customer key does not need to be kept secret, but for intranet search, the key is kept private but still allow internal users to search. This is done by relaying all search requests through an internal "relay"-server on the internal customer network. The relay server will add the secret key to the request upon forwarding the request to Cludo's public API. Customers need to make sure that only authorized users can send the request to the relay server, but that task is left up to the customer.