Parallelism in Profiling

  • 0
  • 1
  • Question
  • Updated 9 months ago
  • Answered
Just wanted to understand if parallelism in profiling is allowed :

1. We break up the schema into multiple rulesets, apply the same profiler set to each and run the profiling jobs in parallel. This should be doable.

2. We break the profiler set into 2-3 sets having less number of expressions/set. Can we still run the profiling jobs in parallel since each of these jobs will be running on the same ruleset and try to update the same inventory in parallel.

Thoughts ?
Photo of Mayank Ahluwalia

Mayank Ahluwalia

  • 708 Points 500 badge 2x thumb

Posted 9 months ago

  • 0
  • 1
Photo of Mouhssine SAIDI

Mouhssine SAIDI

  • 4,782 Points 4k badge 2x thumb
Hi Mayank,

You have to explore the "operations" parameter look at the "/resources/json/delphix/source/$VDBREF", you will have to update the provisioning code to set a masking hooks.

 "operations": {            "type": "VirtualSourceOperations",
            "configureClone": [
                {
                    "type": "RunMaskingJobOnSourceOperation",
                    "name": "MASK DEV DB",
                    "applicationId": "EMPLOYEE APPLICATION",
                    "maskingJobId": "29"
                }
            ],
            "preRefresh": [],
            "postRefresh": [],
            "preRollback": [],
            "postRollback": [],
            "preSnapshot": [],
            "postSnapshot": [],
            "preStart": [],
            "postStart": [],
            "preStop": [],
            "postStop": []
        }

Here we set on configureclone event a masking job called "MASK DEV DB".


Regards,

Mouhssine
Photo of Mayank Ahluwalia

Mayank Ahluwalia

  • 708 Points 500 badge 2x thumb
Thanks Mouhssine. Isn't this to automatically trigger a masking job when provisioning a vDB ? My question was more around parallelism in profiling, OR, did i misunderstand the answer completely ?
Photo of Mouhssine SAIDI

Mouhssine SAIDI

  • 4,782 Points 4k badge 2x thumb
Hi,

Oops, sorry answerd on the wrong thread.

Regards,

Mouhssine
Photo of Mayank Ahluwalia

Mayank Ahluwalia

  • 708 Points 500 badge 2x thumb
So, is there an answer for my question ? :)
Photo of Robert Patten

Robert Patten, Employee

  • 520 Points 500 badge 2x thumb
Hi Mayank, you are correct on case 1, no issue with parallel execution.  On case 2, you have to be careful if you have any chance of multiple expressions being satisfied as you may end up assigning the wrong algorithm.  You can mitigate this issue by assuring that any expressions that could be satisfied have the same default domain/algorithm.  Operationally, you should be able to update the inventory in two jobs; caveat is that if there are any collisions the last job wins.  
Photo of Mayank Ahluwalia

Mayank Ahluwalia

  • 708 Points 500 badge 2x thumb
Thanks Robert !