Managing the Crawler Connector

You can perform the following operations for the Crawler Connector.

See Also
About the Crawler
Configuring the Crawler
Deploying the Crawler Connector

From the Connectors > CRAWLER CONNECTOR > Operations and Inspection tab:

  • Stop/Start crawl – stops or starts the crawl threads.

  • Clear documents – deletes all connector documents from the system and the connector state is reset.

  • Clean documents – deletes crawled documents in the index if they do not match the existing applied rules. It is useful if you have removed sites from the configuration, or applied stricter crawl rules, and want to get rid of "unwanted documents".

  • Reindex documents – reindexes all documents from the crawler storage (it does not need to download them again).

  • Expand Advanced inspection to monitor the scheduler state.