Using the Interconnector Service

The aim of the Interconnector Service is to use a Exalead CloudView role hosting an Apache ActiveMQ broker that acts as a message bus between a master and a slave connector.

This procedure shows you how to deploy an Interconnector Server with a JDBC connector (master) sending file system paths, indexed by a File System connector (slave). In this example, JDBC and File System documents are merged using a dedicated aggregation processor.

Note: You can also customize your connectors with a dedicated SDK to use the Interconnector Service. For more information, see Customizing Connectors to use the Interconnector Service in the Exalead CloudView Connector Programmer guide.

This task shows you how to:

Configure the Interconnector Server

First deploy your Interconnector Server.

  1. In the Administration Console, go to Deployment > Roles.
  2. In Data Integration, select Interconnecter Server.
  3. Enter an instance name and a port (61616 is the standard ActiveMQ port).
  4. Click Apply.

Configure the File System Connector

Now configure your File System connector (slave).

  1. Open your File System connector.
  2. In the Advanced tab, enter the name of your Interconnector Server in Interconnector server instance name.
  3. In the Configuration tab, select a new and empty directory.
  4. Click Apply.

Configure the JDBC Connector

Now configure your JDBC connector (master).

  1. Open your JDBC connector.
  2. In the Configuration tab > Fields selection, unfold the column in which file paths are stored.
  3. Click Add column processor.
  4. Select Interconnector Service and click Accept.
  5. In the Advanced tab:
    1. Add the name of your Interconnector Server in Interconnector server instance name.
    2. Add the name of your File System connector in Slave connector.
  6. Click Apply.

Add an Interconnector Aggregation Processor

Now that your connectors are properly configured, you can add an Interconnector aggregation processor.

  1. Go to Index > Consolidation > [your_consolidation].
  2. In Aggregation processors, click Add processor.
  3. Enter a name and select Interconnector Aggregator Processor.
  4. Click Accept.
  5. Configure your aggregation processor as follows:
    1. Copy the parts: select the check box to copy the parts from the child document.
    2. Child document type: enter child.
    3. Relation document type: enter relation.
    4. Delete child document: select the check box to delete the child document containing parts and metas once its data has been processed.
    5. Copy the metas: select the check box to copy the metas from the child document.
    6. Path from parent to child: enter parent.rel.
    7. Optional: Specify the metas of the child document that must be filtered in Meta names filter.
    8. Optional: Specify the parts of the child document that must be filtered in Part names filter.
  6. Click Apply.

Scan Connectors

Now that your aggregation processor is configured, you can run a scan.

Note: The master connector must be scanned first.

  1. Go to Index > Connectors.
  2. Click Scan for your JDBC connector.
  3. Click Scan for your File System connector.