Adding data set to the masking algorithm. (Mapping Algorithm) using Append. Set was divided into 4 txt. files.

  • 1
  • 1
  • Question
  • Updated 9 months ago
  • Answered
I added a data set to the masking algorithm (Mapping Algorithm) using Append. The set was divided into 4 txt files with 1 million records each. When I'm not sure that they have been added in full, can I add each one again? It will replace existing pieces of A B C and D files or will it spoil the uniqueness of records?
Photo of Michał


  • 72 Points

Posted 9 months ago

  • 1
  • 1
Photo of MichaelT

MichaelT, Official Rep

  • 2,364 Points 2k badge 2x thumb
Official Response
Hi Michał,
I just received the following answer from our development team:

It’s safe to add the same file multiple times to a mapping algorithm.  Part of why it takes a bit of time to add a bunch of values is that we query each existing value to ensure the new values added are unique.  Of course, adding the same file twice will not increase the number of mappings available.

Sounds like you should feel free to add them again as you see fit.

Thanks for being an active member of the community.