Near-Duplicate Fields in IPRO Analytics
Fields used for near-duplicates analysis are listed in the following table. These fields can be created at the time you configure near-duplicates analytics. Fields are required unless otherwise noted.
|
analytics field |
description |
|
IA ND Family |
An identifier that is used to define items in near-duplicate groups. |
|
IA ND Score |
The similarity of this item to the principal item of a near-duplicate group. This value is expressed as a decimal percent in the range of [0-100]. The principal item of the group and any exact duplicates of it will always have a value of 100. No item will have a value less than the Minimum Similarity setting (expressed as a percentage) used when near-duplicate detection was performed. |
|
IA ND Sort |
A value for items that can be used to sort near-duplicates in a group so that the principal document is first and all other group members follow in order from the highest to the lowest similarity. If multiple groups need to be sorted, the groups should first be sorted by their near dupe family value and then be sorted by this value. |
|
IA ND Words |
The number of duplicative words in the document compared to the principal item on the near duplicate group. |
For more information about near-duplicates see the Near Duplicate Detection video.
Click
here to watch the Near Duplicates video