Configuring Product Data Import

Learn how to configure product data imports.

1. Go to Import Settings

From the menu bar, select Import, then switch the tab in the working area to Import Settings.

The import and database settings specify when and from where data files are retrieved. You can also configure minimum sizes for imported files.

FactFinder can automatically import data on a fixed schedule. You can configure the location of data file(s) as well as the dates and exact times when the data is imported.

The size of the data file can also be verified. Normally, FactFinder generates a new search index once the data file has been retrieved. If the file does not pass validation (for example, it is too small or does not contain enough records), FactFinder continues to use the previous index. This ensures that a damaged or partial file is not used to generate a partial database.

In the expert settings, a cron pattern can be used to specify the import schedule.

2. Select a Channel and Click Edit

Once you have selected a channel from the dropdown menu, click Edit configuration.

3. Customize Import Settings (optional)

These settings are usually implemented during FactFinder integration and rarely need to be changed later. If you do make changes, note that they directly influence FactFinder performance. Only change them if you understand the impact. The FactFinder Service Desk can answer questions.

The following options influence your import:

1. Trim whitespace: Removes spaces from the beginning and end of the entry, and collapses duplicate spaces between terms.

2. Remove HTML code: Replaces HTML code with spaces and decodes HTML entities. Start and end tags are removed completely; multiple tags are replaced with single spaces.

3. Replace special characters with ISO counterparts: Replaces special characters with ISO equivalents.

4. Deduplicate field values: Removes duplicate values from return data so each value is unique.

5. Import on startup: Imports this channel on system startup. If the global "import on startup" module is deactivated, this setting has no effect and cannot be edited.

4. Select Import File and Settings

This step is only required if you have not licensed Channel Management.

If your FactFinder has Channel functionality, you can find the settings for import files under Channel Management → Channel editing.

The following options influence your import:

URL: Location of the source file to download and parse.

Frequency: How often the import should be triggered.

Use interval as import trigger: Triggers imports on a fixed interval.

Delimiter: Field separator used in the import file.

Enclosing (quote) character: Character (for example, ") that encloses field contents when needed (optional).

Escape character: Character that escapes the delimiter if it occurs in field contents (optional).

Min. file size: Minimum acceptable file size. The current file size is also shown.

Expires after: How long a previously downloaded file remains valid before a new download is forced.

5. Set Database Settings

Min. amount of records: Minimum number of records required for the import to be considered successful. If the threshold is not met, the previous index is kept.

6. Set Language and Encoding

Disable Unihan similarities: By default, FactFinder takes identical readings (for example, 架 and 价 both read jià) and readings with different tones (for example, 支 zhī and 至 zhì) into account when working with Unihan. Disable this to turn that behavior off.

Phonetic definition: For security reasons, you cannot define a custom value via the UI. You can set custom values directly in the search configuration XML or select one of the predefined values (derived from the phonetic definitions directory).

7. Save changes

Click Save to apply your changes.