Delphix Products

 View Only

  • 1.  Query on Masking performence

    Posted 03-10-2020 01:08:00 AM
    ​Hi Team

    I have query on like, we have 100 GB database where we configured masking with 4 algorithms and its taking more than 8 hours to run the masking Job, any suggestions on this issue like how to improve the performance ? Does any one have encountered such scenario ? 


    ------------------------------
    Karteek Muthyala
    Information Security Engineer
    Wells Fargo
    ------------------------------


  • 2.  RE: Query on Masking performence

    Posted 03-10-2020 03:53:00 AM
    Hi Karteek,

    Can you please provied more details on the following :

    1/ Database type
    2/ Number with columns type and tables you are masking
    3/ Any index, constraints or triggers on the subject column(s)
    4/ Masking job configuration and used algorithms

    Regards,

    Mouhssine

    ------------------------------
    Mouhssine SAIDI
    Community Member
    Delphix Community Members
    ------------------------------

    Original Message


  • 3.  RE: Query on Masking performence

    Posted 07-17-2023 01:51:00 AM

    Hi Saidi

    Please find my response below. Similar issue occurred again, so replying on old thread.


    1/ Database type- Maria DB
    2/ Number with columns type and tables you are masking- One Column- 210 Million records - It took 11 Hrs. to complete the Masking 
    3/ Any index, constraints or triggers on the subject column(s)- Yes, But enabled DROP INDEXES option
    4/ Masking job configuration and used algorithms - Only one AL- Business Legal Entity SL- System SL

    5) Min- 1GB and Max 16 GB assigned in Masking Job.

    Please advise how to improve the Masking job?



    ------------------------------
    Karteek Muthyala
    Information Security Engineer
    Wells Fargo Bank, N.A.
    ------------------------------

    Original Message


  • 4.  RE: Query on Masking performence

    Posted 07-17-2023 11:56:00 AM

    HI Karteek,

    Here is a first approach you can try and let me know how it goes and we can refine it if needed :

    Can you confirm please the engine version you have too ?

    • Add a pre-script to job that disable constraints and triggers on the table
    • Use mysql driver connector to connect to you mariadb
    • In ruleset define logical key as DMS_ROW_ID
    • In masking job configuration set min and max memory to the same value ex: 2048 and disable indexes
    • Add a post-script to enable back constraints / triggers on the table 

    Let me know how did this go for you

    Best,



    ------------------------------
    Mouhssine Saidi
    Technical Services
    Delphix
    ------------------------------

    Original Message


  • 5.  RE: Query on Masking performence

    Posted 03-10-2020 01:49:00 PM

    100 GB / 480min = 0.2 GB / min
    This number seems to be a bit slow.  
    General advise is to drop indexes/triggers/constraints on masked columns and make sure an appropriate logical key is being used (indexed!).

    Please provide details :

    1/ Database type
    2/ Number of columns and tables you are masking
    3/ Any index, constraints or triggers on the subject column(s)
    4/ Masking job configuration and used algorithms

    Oracle specific optimisations:

    https://community.delphix.com/blogs/krishna-kapa1/2019/07/26/delphix-masking-best-practices1?CommunityKey=4e2d7f5c-8842-432b-86ec-1bd8b6f628d7&tab=



    ------------------------------
    Tino Pironti
    Technical Services
    Delphix
    ------------------------------

    Original Message


Related Content