Configure the Logs Connector

Scan latest entries only

If selected, the next scan starts at the latest scanned log entry.

Line format

Specify the format of the log files. According to the selected pattern, you need to create the corresponding log fields.

Encoding

Enter the file encoding to use. By default, utf-8.

Max number of crawled lines

Defines the maximum number of lines crawled for a single file.

Log fields

Add fields corresponding to the selected log file format in Line pattern definition.

Additional output

You can:

• Add a meta for the name of the file that has been scanned: Set file name in the meta.
• Add a meta for the line scanned in the file: Set file line in the meta.
• Add a meta for data that have not been parsed properly: Set lines that do not match the format in the meta.
• Group data that has not been parsed properly in a single document: Group consecutive lines that do not match the format.

Filesystem paths

Enter the filesystem path for the files (.ZIP, .LOG, .GZ) or directory to crawl. You can prefix paths by:

• data:// OR /data – relative to the <DATADIR>
• resource:// – relative to the NGRESOURCEPATH (see definition on <DATADIR>/bin/ngstart.env)
• kit:// – relative to the <INSTALLDIR>
• file:// – absolute path, for example, file://temp/csv-data/

Click Add path for each path you want to crawl.