Delphix Products

 View Only

  • 1.  Delphix Masking Where clause List

    Posted 03-28-2024 02:55:00 PM

    Hi, I need to pull only some data from Prod to Test and I am able to apply where clause filter for that in custom sql. However, I have requirement to pull thousands of ID's, which I need to continuously update each time I run the job. Is there a option to configure a lookup file/List for where clause, basically parametrizing it. I am not allowed to create objects in Prod on the Database side.



    ------------------------------
    Chandrapalred Borra
    TDM Engineer
    HCL America Inc.
    ------------------------------


  • 2.  RE: Delphix Masking Where clause List
    Best Answer

    Posted 03-29-2024 02:48:00 AM


    Unfortunately the FILTER clause is not dynamic, the arguments you enter are "digested" by hibernate and used to build the finally executed SQL statements.

    What you could do is to wrap your filter conditions for example into a DB function/procedure and use that as part of your filter SQL clause.

    Another option is to populate a (temporary) table that contains only the IDs (PK or any matching values to find desired rows) and join against that table in filter clause.

    Hope that helps.




    Original Message


  • 3.  RE: Delphix Masking Where clause List

    Posted 03-29-2024 05:08:00 PM

    Thanks for the help ! 



    ------------------------------
    Chandrapalred Borra
    TDM Engineer
    HCL America Inc.
    ------------------------------

    Original Message


  • 4.  RE: Delphix Masking Where clause List

    Posted 04-01-2024 07:52:00 AM

    Tino's suggestion would be most performant, but I understand that you can't create objects in prod (neither can I).  My suggestion is to get familiar with the /table-metadata API endpoint.  You can programmatically update the where clause for each batch. 

    • Read batch of IDs from file
    • Form new where clause
    • Send updated where clause with PUT /table-metadata/{table-id} 
    • Call masking job
    • Check for success
    • ... and loop until you've processed all IDs


    ------------------------------
    Kevin Bott
    Sr. Database Architect
    Northwestern Mutual Life Insurance Company
    ------------------------------

    Original Message


Related Content