Delphix Products

Expand all | Collapse all

Parallelism in Profiling

Jump to Best Answer
  • 1.  Parallelism in Profiling

    Posted 02-20-2018 10:07:00 AM
    Just wanted to understand if parallelism in profiling is allowed :

    1. We break up the schema into multiple rulesets, apply the same profiler set to each and run the profiling jobs in parallel. This should be doable.

    2. We break the profiler set into 2-3 sets having less number of expressions/set. Can we still run the profiling jobs in parallel since each of these jobs will be running on the same ruleset and try to update the same inventory in parallel.

    Thoughts ?
    #Masking


  • 2.  RE: Parallelism in Profiling
    Best Answer

    Posted 02-20-2018 11:21:00 AM
    Hi Mayank,

    You have to explore the "operations" parameter look at the "/resources/json/delphix/source/$VDBREF", you will have to update the provisioning code to set a masking hooks.

     "operations": {            "type": "VirtualSourceOperations",
                "configureClone": [
                    {
                        "type": "RunMaskingJobOnSourceOperation",
                        "name": "MASK DEV DB",
                        "applicationId": "EMPLOYEE APPLICATION",
                        "maskingJobId": "29"
                    }
                ],
                "preRefresh": [],
                "postRefresh": [],
                "preRollback": [],
                "postRollback": [],
                "preSnapshot": [],
                "postSnapshot": [],
                "preStart": [],
                "postStart": [],
                "preStop": [],
                "postStop": []
            }

    Here we set on configureclone event a masking job called "MASK DEV DB".


    Regards,

    Mouhssine


  • 3.  RE: Parallelism in Profiling

    Posted 02-20-2018 11:46:00 AM
    Thanks Mouhssine. Isn't this to automatically trigger a masking job when provisioning a vDB ? My question was more around parallelism in profiling, OR, did i misunderstand the answer completely ?


  • 4.  RE: Parallelism in Profiling

    Posted 02-20-2018 11:51:00 AM
    Hi,

    Oops, sorry answerd on the wrong thread.

    Regards,

    Mouhssine


  • 5.  RE: Parallelism in Profiling

    Posted 02-21-2018 08:39:00 AM
    So, is there an answer for my question ? :)


  • 6.  RE: Parallelism in Profiling
    Best Answer

    Posted 02-21-2018 05:52:00 PM
    Hi Mayank, you are correct on case 1, no issue with parallel execution.  On case 2, you have to be careful if you have any chance of multiple expressions being satisfied as you may end up assigning the wrong algorithm.  You can mitigate this issue by assuring that any expressions that could be satisfied have the same default domain/algorithm.  Operationally, you should be able to update the inventory in two jobs; caveat is that if there are any collisions the last job wins.  


  • 7.  RE: Parallelism in Profiling

    Posted 02-23-2018 11:06:00 AM
    Thanks Robert !