Standard SM_UNI :
SM_UNI
Custom algorithm configuration:
Input: inputValue
Output: outputValue
Explanation of options (editable in MASK step as above):
- numeric_only true/false default=false
If enabled it will only mask numbers within the given string. When masking data that contains only numerics it is advised to enable this feature as it will increase performance. For decimal types like float it is required to enable the option.
- leading0 true/false default=false
If enabled any leading consecutive zeros are ignored. Masking starts with first non-zero character. Further the feature can be used on NUMERIC columns to avoid that the result of the first masked character will become 0 - to preserve uniqueness (explanation: 0111 is same as 111 > therefore first char should never get a 0 as result of masking)
- keep_first=N N=numeric value default=0
If keep_first is set to 6 the masking would ignore the first 6 characters and start masking beginning with the 7. character
- keep_last=N N=numeric value default=0
If keep_last is set to 6 the masking would ignore the last 6 characters.
- filter_char = false; true/false default=false
The input is filtered and any accented chars replaced with the corresponding base char: é > e
All options can be used in combination following the logic:
<leading0><keep_first><TO_MASK><keep_last>
The options are editable inside the algorithm in plain text.
Features:
- Deterministic (!)
- not limited to 36 characters like standard SM
- preserves length
- preserves case
- preserves uniqueness
- position specific logic
- supports 0-9, a-z, A-Z, accented latin characters and cyrillic characters
- characters not matching the supported character list are preserved (-_,=@$%£'"{}[]()™‹<> etc)
- preserves punctuation / format
- supports different styles of NULL / empty string (for example for Oracle type NUMBER)
------------------------------
Tino Pironti
Technical Services
Delphix
------------------------------
Original Message:
Sent: 07-14-2020 04:12:05 AM
From: Tino Pironti
Subject: What is the best algorithm for Unique values
Your statement is false. SM_UNI does support alfanumeric and in addition to standard SM it supports accented characters, cyrilic and any special characters. There is one option to restrict it to mask only numerics but that is not active by default. Use algorithm as was attached.
------------------------------
Tino Pironti
Technical Services
Delphix
Original Message:
Sent: 07-14-2020 03:49:05 AM
From: Siddharth Jain
Subject: What is the best algorithm for Unique values
Hi Tino,
Thanks for the Detail Explanation , but SM_UNI algorithm mask only numbers and not alphabets
The Algorithm should be in such a way that it mask both Numbers and alphabets irrespective of the String Length and maintain uniqueness.
Do we have such algorithm or can we do some modification which satisfy above criteria?
------------------------------
Siddharth Jain
Senior Support Analyst
Delphix Community Members
Original Message:
Sent: 07-13-2020 08:36:10 AM
From: Ashok Kumar Athuluri
Subject: What is the best algorithm for Unique values
Hi Team,
Currently we have a requirement to Mask Unique Values in PK column, We tried to use algorithm provided by Delphix but it didn't serve the purpose as the Algorithm is not giving unique values in column and Data Masking Job is failing.
We tried to use NAME_TK algorithm , but it introduce Special Character due to which functionality of Application was failing.
I created Segment Mapping algorithm but it has constraint that it can't mask more than 36 character .
Do we have any other solution or algorithm which guarantees us uniqueness, without any special charecters and mask characters more than 36, be it alphanumeric.
Thanks in advance.
------------------------------
Ashok Kumar Athuluri
Associate Engineer
------------------------------