The attached DataMapper config filters duplicates. It first creates a
sourceRecord property named
fileNames, an empty array in which we’ll be storing the various distinct file names.
In the loop, the content of column1 is checked against the content of the array: if the file name already exists in the array, the condition returns false and nothing is extracted for this line. If the file name is not yet in the array, then it is added to the
fileNames property and the fields are extracted for that line.
removeduplicates-filtered.OL-datamapper (12.6 KB)
EDIT: I just saw that jchamel posted right before I did. His solution is valid, but takes for granted that all the orifilename values are sorted and grouped, whereas mine doesn’t care.