Hi Geetha,
Thanks for reaching out to the community and thanks for the details. The question about the unmasked value depends on a few things.
- Is this the only value?
- Are there Nonconforming Data warnings?
- What is the segment configuration?
Segment Mapping maps input values (or characters) with a random masked value. This mapping is then stored. It does this in segments and if the segment is not matching the input data a Nonconforming Data Warning is reported.
Since the mapping is random - it can be that one value is masked to the same value. Looking at the algorithm as a black box and the randomness of the mapped value, this is ok.
The Nonconforming Data Warning reports if the masking algorithm couldn't apply a masked value. The masked value can, therefore, be the same as the input.
For more details, please find this KBA.
https://support.delphix.com/Delphix_Masking_Engine/Algorithm%3A_Segment_Mapping_(KBA1775)
Please let me know if there are any questions or concerns. Happy to help.
Kind regards,
Anders
------------------------------
Anders Karlsson
Delphix Support
Delphix
------------------------------
Original Message:
Sent: 06-08-2020 11:30:23 AM
From: GEETHANJALI DEVI
Subject: Ignore the space in the SM Alorithm
this if from the Greenplum database. so we are using the script to extract the data from the Database into the csv file will comma separator and then passing the csv flat file for the delphix conversion process.
------------------------------
GEETHANJALI DEVI
Business Objects Developer
Genworth Financial
Original Message:
Sent: 06-08-2020 10:48:13 AM
From: Mouhssine SAIDI
Subject: Ignore the space in the SM Alorithm
Hi Geetha,
One of best ways I'm using personally to standardize non-conforming data is to use custom sql.
The idea is standardize the table inputs at memory read time to delphix masking before applying the SM algorithm.
You can sql commands like replace or regexp_replace
Regards,
Mouhssine
------------------------------
Mouhssine SAIDI
Community Member
Delphix Community Members
Original Message:
Sent: 06-08-2020 09:38:20 AM
From: GEETHANJALI DEVI
Subject: Ignore the space in the SM Alorithm
Hello Mouthssine,
Thanks for the response, i already have the space in my ignore characters list.
Thanks
Geetha
------------------------------
GEETHANJALI DEVI
Business Objects Developer
Genworth Financial
Original Message:
Sent: 06-06-2020 10:25:11 AM
From: Mouhssine SAIDI
Subject: Ignore the space in the SM Alorithm
Hi Geetha,
Just add a blank space in the ignore char filed of the SM algorithm.
BR,
Mouhssine
------------------------------
Mouhssine SAIDI
Community Member
Delphix Community Members
Original Message:
Sent: 06-06-2020 10:06:49 AM
From: GEETHANJALI DEVI
Subject: Ignore the space in the SM Alorithm
Hello All,
i have a retirement to mask the Account number , which has some special characters with, so i have created he new SM algorithm with the special chars in the ignore characters, those are scrambling good. but one the values in data is "3841 ", this value is not scrambling. I am guessing due to the blank space it is not scrambling. is there any possibility to handle this kind of scenario, any hep is appreciated.
Thanks
Geetha.
------------------------------
GEETHANJALI DEVI
Business Objects Developer
Genworth Financial
------------------------------