Delphix Products

 View Only
  • 1.  Ignore the space in the SM Alorithm

    Posted 06-06-2020 10:07:00 AM
    Hello All,
      i  have a retirement to mask the Account number , which  has  some special characters with, so i have created he new  SM algorithm  with the special chars in the ignore characters, those are scrambling good. but one the values in data  is "3841              ", this value is not scrambling. I am guessing due to the blank space it is not scrambling. is there any possibility  to handle this kind of scenario, any hep is appreciated.

    Thanks
    Geetha.

    ------------------------------
    GEETHANJALI DEVI
    Business Objects Developer
    Genworth Financial
    ------------------------------


  • 2.  RE: Ignore the space in the SM Alorithm

    Posted 06-06-2020 10:25:00 AM
    Hi Geetha,

    Just add a blank space in the ignore char filed of the SM algorithm.

    BR,

    Mouhssine

    ------------------------------
    Mouhssine SAIDI
    Community Member
    Delphix Community Members
    ------------------------------



  • 3.  RE: Ignore the space in the SM Alorithm

    Posted 06-08-2020 09:38:00 AM
    Hello Mouthssine,

      Thanks for the response, i already have the space in my ignore characters  list.

    Thanks
    Geetha

    ------------------------------
    GEETHANJALI DEVI
    Business Objects Developer
    Genworth Financial
    ------------------------------



  • 4.  RE: Ignore the space in the SM Alorithm

    Posted 06-08-2020 10:48:00 AM
    Hi Geetha,

    One of best ways I'm using personally to standardize non-conforming data is to use custom sql.

    The idea is standardize the table inputs at memory read time to delphix masking before applying the SM algorithm.

    You can sql commands like replace or regexp_replace

    Regards,

    Mouhssine



    ------------------------------
    Mouhssine SAIDI
    Community Member
    Delphix Community Members
    ------------------------------



  • 5.  RE: Ignore the space in the SM Alorithm

    Posted 06-08-2020 11:30:00 AM
    this if from the Greenplum database. so we are using the script to extract the data from the Database into the csv file will comma separator and then passing the csv flat file for the delphix conversion process.

    ------------------------------
    GEETHANJALI DEVI
    Business Objects Developer
    Genworth Financial
    ------------------------------



  • 6.  RE: Ignore the space in the SM Alorithm

    Posted 06-09-2020 04:21:00 PM
    Hi Geetha,

    Thanks for reaching out to the community and thanks for the details. The question about the unmasked value depends on a few things.
    • Is this the only value? 
    • Are there Nonconforming Data warnings?
    • What is the segment configuration?


    Segment Mapping maps input values (or characters) with a random masked value. This mapping is then stored. It does this in segments and if the segment is not matching the input data a Nonconforming Data Warning is reported.

    Since the mapping is random - it can be that one value is masked to the same value. Looking at the algorithm as a black box and the randomness of the mapped value, this is ok.

    The Nonconforming Data Warning reports if the masking algorithm couldn't apply a masked value. The masked value can, therefore, be the same as the input.

    For more details, please find this KBA.
    https://support.delphix.com/Delphix_Masking_Engine/Algorithm%3A_Segment_Mapping_(KBA1775)


    Please let me know if there are any questions or concerns. Happy to help.

    Kind regards, 

    Anders



    ------------------------------
    Anders Karlsson
    Delphix Support
    Delphix
    ------------------------------