Configuration

When used with a Norconex Crawler, you can use the following XML to configure Microfocus IDOL as the <committer> section of your Norconex Crawler configuration:

<committer class="com.norconex.committer.idol.IdolCommitter">
 
  <!-- To commit documents to IDOL or DIH: -->
  <host>(IDOL/DIH host name or IP)</host>
  <indexPort>(IDOL/DIH index port)</indexPort>
  <databaseName>(Optional IDOL Database Name where to store documents)</databaseName>
  <dreAddDataParams>
     <param name="(parameter name)">(parameter value)</param>
  </dreAddDataParams>
  <dreDeleteRefParams>
     <param name="(parameter name)">(parameter value)</param>
  </dreDeleteRefParams>
 
  <!-- To commit documents to CFS: -->
  <host>(CFS host name or IP)</host>
  <cfsPort>(CFS Server/Ingest port)</cfsPort>
 
  <!-- Common settings: -->
  <sourceReferenceField keep="[false|true]">
     (Optional name of field that contains the document reference, when 
     the default document reference is not used.  The reference value
     will be mapped to the IDOL "DREREFERENCE" field, or the 
     "targetReferenceField" specified.
     Once re-mapped, this metadata source field is 
     deleted, unless "keep" is set to true.)
  </sourceReferenceField>
  <targetReferenceField>
     (Optional name of IDOL target field where to store the source 
     reference. If not specified, default is "DREREFERENCE".) 
  </targetReferenceField>
  <sourceContentField keep="[false|true]">
     (If you wish to use a metadata field to act as the document 
     "content", you can specify that field here.  Default 
     does not take a metadata field but rather the document content.
     Once re-mapped, the metadata source field is deleted,
     unless "keep" is set to true.)
  </sourceContentField>
  <targetContentField>
     (IDOL target field name for a document content/body.
      Default is: DRECONTENT)
  </targetContentField>
  <commitBatchSize>
      (max number of docs to send IDOL at once)
  </commitBatchSize>
  <queueDir>(optional path where to queue files)</queueDir>
  <queueSize>(max queue size before committing)</queueSize>
  <maxRetries>(max retries upon commit failures)</maxRetries>
  <maxRetryWait>(max delay between retries)</maxRetryWait>
</committer>

Tag descriptions: