News
Downloads
Services
Community
Partners
About

11.3.7. on_file_field_error

How to handle IO errors in file fields. Optional, default is ignore_field. Introduced in version 2.0.2-beta.

When there is a problem indexing a file referenced by a file field (Section 11.1.29, “sql_file_field”), indexer can either index the document, assuming empty content in this particular field, or skip the document, or fail indexing entirely. on_file_field_error directive controls that behavior. The values it takes are:

  • ignore_field, index the current document without field;

  • skip_document, skip the current document but continue indexing;

  • fail_index, fail indexing with an error message.

The problems that can arise are: open error, size error (file too big), and data read error. Warning messages on any problem will be given at all times, irregardless of the phase and the on_file_field_error setting.

Note that with on_file_field_error = skip_document documents will only be ignored if problems are detected during an early check phase, and not during the actual file parsing phase. indexer will open every referenced file and check its size before doing any work, and then open it again when doing actual parsing work. So in case a file goes away between these two open attempts, the document will still be indexed.

Example:

on_file_field_errors = skip_document