I've checked your case as best I can, and for me, adding ',' ignore character does what I expect:
First I create SM with 30 alpha-numeric segments, then mask two values:
123456789012345678901234567890 -> 377949142883334923098463559959
12345,6789012345678901234,567890 ->12345,6789012345678901234,567890
Then I added ',' to the list of ignore characters by checking the box in the UI saving the algorithm:
123456789012345678901234567890 -> 377949142883334923098463559959
12345,6789012345678901234,567890 -> 37794,9142883334923098463,559959
The definition of my algorithm looks like this in the api-client:
{
"algorithmName": "ALNUM30",
"algorithmType": "SEGMENT",
"createdBy": "admin",
"description": "",
"algorithmExtension": {
"ignoreCharacters": [
44
],
"segments": [
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
},
{
"length": 1,
"minInt": 0,
"maxInt": 0,
"minRealInt": 0,
"maxRealInt": 0
}
],
"segmentsGroupLength": [
4,
4,
4,
4,
4,
4,
4,
2
],
"errorHandlingMode": "DEFAULT"
}
}
The block with ignoreCharacters is what changed.
If you're familiar with the
api-client, you could post your algorithm definition, you might check that and see if it contains the similar values to what I have here. You might also look in the job results to see what non-conforming data is still being reported, for clues about any data formats you may not have accounted for in your ignore characters. A 30 segment algorithm will not mask a value with 31 characters (no counting ignore characters) or lead/trailing whitespace, which is a common source of problems.
------------------------------
John Leser
Staff Engineer
Delphix
------------------------------
Original Message:
Sent: 05-13-2020 11:56:03 AM
From: GEETHANJALI DEVI
Subject: Ignore Comma in SM algorithm
Thanks for the response John, I am using 5.3.6.0 version of Delphix Masking.
------------------------------
GEETHANJALI DEVI
Business Objects Developer
Genworth Financial
Original Message:
Sent: 05-13-2020 11:08:55 AM
From: John Leser
Subject: Ignore Comma in SM algorithm
Hi, what version is your masking engine?
------------------------------
John Leser
Staff Engineer
Delphix
Original Message:
Sent: 05-13-2020 09:34:23 AM
From: GEETHANJALI DEVI
Subject: Ignore Comma in SM algorithm
Hello All,
I have created a new SM algorithm for 30 char length . I want to ignore comma as special charterer , i have selected that check box . but still it is not scrambling the value which has comma in the data. is i am missing anything ? please advise.
Thanks In advance
------------------------------
GEETHANJALI DEVI
Business Objects Developer
Genworth Financial
------------------------------