Delphix Products

 View Only
Expand all | Collapse all

Masking digits

  • 1.  Masking digits

    Posted 09-05-2023 06:05:00 AM

    Hi Team

    I would like to mask the digits in the below format.

    The original data 20000 records, but all values in table has, 0,1,2,3 only. and I want to mask those digits in below format only.

    Please suggest which AL to use? I have tried secure shuffle, but all values are not masking.

    Scenario 1: 

     

    Database value

    0

    1

    2

    3

     

    Masked value should

    2

    3

    0

    1



    ------------------------------
    Karteek Muthyala
    Information Security Engineer
    Wells Fargo Bank, N.A.
    ------------------------------


  • 2.  RE: Masking digits

    Posted 09-05-2023 07:54:00 AM
    Edited by Sandro Latini 09-05-2023 07:54:27 AM

    Hi Karteek,

    In order to clarify your requirement, do you need to map 0 to 2 and 1 to 3 etc or would you like to replace the original value to 2301?
    I believe that Segment Mapping would fit your needs in either case: Segment mapping as you can either map the digit to another digit or mask it with a constant number.
    If your use case is diverse, please provide further examples.



    ------------------------------
    Sandro Latini
    Senior Principal Support Engineer
    Delphix
    ------------------------------



  • 3.  RE: Masking digits

    Posted 09-05-2023 08:35:00 AM

    Hi Sandro

    I have verified and tried the Segment Mapping, but its not working. and keeping the duplicate values.

    My ask is like, if the original values are 0,1,2,3, so that after masking, the 0 should be 1,2,3 and 1 should, be 0,2,3 and 2 should be 0,1,3 and 3 should be 0,1,2 thats it. Please suggest me the perfect solution



    ------------------------------
    Karteek Muthyala
    Information Security Engineer
    Wells Fargo Bank, N.A.
    ------------------------------



  • 4.  RE: Masking digits

    Posted 09-05-2023 09:05:00 AM
    Edited by Sandro Latini 09-05-2023 09:06:09 AM

    Hi Karteek,

    Did you try to map a single digit to another single digit only, like in my example above? For example, 0 to 3, 1 to  2, 2 to 0, 3 to 4 and 4 to 1.
    Please let me know if that helps.  



    ------------------------------
    Sandro Latini
    Senior Principal Support Engineer
    Delphix
    ------------------------------



  • 5.  RE: Masking digits

    Posted 09-05-2023 09:58:00 AM

    Hi Sandro

    No, let me show you the image,



    ------------------------------
    Karteek Muthyala
    Information Security Engineer
    Wells Fargo Bank, N.A.
    ------------------------------



  • 6.  RE: Masking digits

    Posted 09-06-2023 06:00:00 AM

    Hi Karteek,

    What is the version of the engine? The screenshot shows a Segmented mapping Legacy. Segmented mapping v2 has been introduced with Masking version 6.0.15.0.
    The minimum length of the Segment is 2 in the old Segment mapping algorithm, whereas it's 1 in the new algorithm.



    ------------------------------
    Sandro Latini
    Senior Principal Support Engineer
    Delphix
    ------------------------------



  • 7.  RE: Masking digits

    Posted 09-07-2023 12:48:00 AM

    Hi Sandro

    We are using 6.0.12.1. Give me some example? 

    Ana am unable to open the given link from the other thread. https://maskingdocs.delphix.com/Authoring_Extensible_Plugins

    -



    ------------------------------
    Karteek Muthyala
    Information Security Engineer
    Wells Fargo Bank, N.A.
    ------------------------------



  • 8.  RE: Masking digits
    Best Answer

    Posted 09-07-2023 01:27:00 AM

    Hi Sandro

    Today I tried in different method in character Mapping AL , the issue has been sorted out. and masking working as I expected.

    Thank you All. Please look at the image.



    ------------------------------
    Karteek Muthyala
    Information Security Engineer
    Wells Fargo Bank, N.A.
    ------------------------------



  • 9.  RE: Masking digits

    Posted 09-07-2023 03:17:00 AM

    Hi Karteek,

    That is great news! Thank you for sharing the solution.



    ------------------------------
    Sandro Latini
    Senior Principal Support Engineer
    Delphix
    ------------------------------



  • 10.  RE: Masking digits

    Posted 09-11-2023 06:05:00 AM

    Hi Sandro

    The logic with Character Mapping only working when we have a consecutive numbers like 0,1,2,3. But when we have a digits like 1,2 and 9, the same login AL is not working. and its giving error message. I want to mask the 1,2 and 9 with same numbers. like ,1 should be masked 2 or 9. 2 should be mask with 1 or 9 , and 9 should be mask with 1 or 2. Kindly suggest.



    ------------------------------
    Karteek Muthyala
    Information Security Engineer
    Wells Fargo Bank, N.A.
    ------------------------------



  • 11.  RE: Masking digits

    Posted 09-11-2023 08:32:00 AM

    Hi Karteek,

    I would recommend to upgrade the Masking engine to any version after 6.0.15.0 so that you can use the new Segment mapping algorithm. Otherwise, if you have an engine using a newer version, you can test the same set of data there to see if upgrading resolves the issue.



    ------------------------------
    Sandro Latini
    Senior Principal Support Engineer
    Delphix
    ------------------------------



  • 12.  RE: Masking digits

    Posted 09-12-2023 01:54:00 AM

    Hi Sandro

    Thank you sandro, I will use this option once my engine get upgraded. But I have ADF Delphix masking engine, and I can see the new feature in that, but  am not able to establish a connection for SQL servers on this ADF delphix engine. Once I upgrade our on-premise delphxi engine, will try that option. Between I have couple of other questions on clients asks.

    1) The client requirement is similar to digits, they have some text in rows. After masking the row 1 should be masked by row 2 or others. And row 2 should masked with row1 or others. is it possible in Delphix new feature?

    ex: 

    Before Mask After Mask
    Meinke Ma'Roof
    Harwood Meinke
    Vergie Harwood
    Ma'Roof Skidmore
    Skidmore Vergie

    Note: I have tried SL and Secure shuffle, but its not masking as per the customer requirement. After masking job execution, I can see still some rows are not masking, and keeping the original value.

    2) Client have 20000 records, where he want to mask only 15000 records and rest all ( selected rows) should not mask. Is it possible? 

    I mean does delphix support this Partial masking?



    ------------------------------
    Karteek Muthyala
    Information Security Engineer
    Wells Fargo Bank, N.A.
    ------------------------------



  • 13.  RE: Masking digits

    Posted 09-12-2023 08:40:00 AM

    does delphix support this Partial masking?

    You can achieve partial masking by using "Filter Criteria" or "Custom SQL".  This is edited on the table within the ruleset.  Keep in mind that this filters out entire rows.  If your partial masking requirement only applies to certain columns on the table, you will need multiple rulesets (and jobs) to meet the requirement.  

    1. All Rows; Columns 1,3,4
    2. 75% of Rows; Columns 2,6

    And so on.  

    For comparison, we have conditional masking requirements, where we need to apply different algorithms to a field based on the type indicated in another field.  When we were on early versions of 6.x, we needed 12 jobs to correctly mask one field.  We have since migrated to a custom Multi-Column Algorithm which allows us to check the type code, and pass the value to the correct algorithm for masking (via algorithm chaining).  



    ------------------------------
    Kevin Bott
    Sr. Database Architect
    Northwestern Mutual Life Insurance Company
    ------------------------------



  • 14.  RE: Masking digits

    Posted 09-12-2023 08:54:00 AM

    I have tried SL and Secure shuffle, but its not masking as per the customer requirement. After masking job execution, I can see still some rows are not masking, and keeping the original value.

    KBA4088 states that:

    The shuffle is random and will be different from execution to execution.

    It does not mention a guarantee that values will change.  

    Without a copy of the unmasked data, how can you pick out the values that didn't change?



    ------------------------------
    Kevin Bott
    Sr. Database Architect
    Northwestern Mutual Life Insurance Company
    ------------------------------



  • 15.  RE: Masking digits

    Posted 09-12-2023 09:27:00 AM

    Thank you Kevin

    Yes, I will use the custom SQL, but just wonder if Delphix support any new feature for partial masking.

    And for this "Without a copy of the unmasked data, how can you pick out the values that didn't change?", Yes I comapare both unmaksed and masked data,



    ------------------------------
    Karteek Muthyala
    Information Security Engineer
    Wells Fargo Bank, N.A.
    ------------------------------



  • 16.  RE: Masking digits

    Posted 09-12-2023 12:58:00 PM

    In general, you can submit "Request for Enhancement" ticket.  Support will ask clarifying questions.  There's chances the idea has already been submitted and other customers are looking for it too.  Also alert your Customer Success Manager so they can follow up internally.  

    For Partial Masking, how would you want it to work?  I'm trying to understand your use case.  

    Yes I comapare both unmaksed and masked data,

    In a standard workflow, you won't have access to the unmasked copy.  In that case, how could you tell which one hasn't changed?  My point is that without the unmasked copy, you would never know that one of them wasn't shuffled.  In a list of 100k, how would you know?  Also, assuming that other PII fields in the same row have been masked, is the one field that wasn't shuffled actually a problem?

    I recommend submitting a support case for this.  Get justifications from your business partners.  Relay your concern to your Customer Success Manager.  



    ------------------------------
    Kevin Bott
    Sr. Database Architect
    Northwestern Mutual Life Insurance Company
    ------------------------------



  • 17.  RE: Masking digits

    Posted 09-13-2023 01:26:00 AM

    Hi Karteek,

    You can easily achieve your solution with SDK. I would suggest give a try.

    Regards,

    Bhupinder Kwatra



    ------------------------------
    Bhupinder Kwatra
    Delphix Community Members
    ------------------------------