Delphix Products

 View Only

  • 1.  Metrics Creation

    Posted 09-19-2023 02:52:00 AM

    Hi All,

    I am looking for a metrics to be created to capture the masking job run status, tables, columns and algorithms that are used for masking purposes via delphix API call.

    Looking forward to hearing on the best practices implemented to achieve this.

    Thanks

    Vinoth Gopi

    Thanks 

    Vinoth Gopi



    ------------------------------
    Vinoth Gopi
    TDM Consultant
    TATA Consultancy Services Ltd
    ------------------------------


  • 2.  RE: Metrics Creation
    Best Answer

    Posted 09-19-2023 06:12:00 PM

    Hi Vinoth,

    Data Control Tower currently has this built into the product from both an API and UI perspective such that you can have global compliance execution details aggregated centrally across all connected engines. Please see the below job execution report that aggregates job run details no matter where the job was run, what type (compliance or hyperscale) of job was executed, or where the job was initiated (engine, DCT, or Hyperscale Orchestrator).

    This can also be generated using automation with a DCT endpoint  please see the /reporting/masking-execution-metrics API detail

    The typical response payload looks like: 

    {
  "items": [
    {
      "id": "masking-job-1",
      "masking_job_name": "My favorite MaskingJob",
      "masking_job_type": "STANDARD",
      "connector_type": "MARIADB",
      "ruleset_name": "my-ruleset",
      "rows_masked": 1000,
      "rows_total": 5000,
      "bytes_masked": 500,
      "bytes_total": 5000000,
      "duration": 5000000,
      "tables_files_count": 5000000,
      "masked_tables_files_count": 5000000,
      "columns_fields_count": 5000000,
      "masked_columns_fields_count": 5000000
    }
  ],
  "response_metadata": {
    "prev_cursor": "string",
    "next_cursor": "string",
    "total": 0
  }
}

    Please let me know if you have any questions!

    Best,



    ------------------------------
    Ross Millenacker
    Senior Product Manager
    Delphix
    ------------------------------

    Original Message


  • 3.  RE: Metrics Creation

    Posted 09-27-2023 06:17:00 AM

    Hi Ross Millenacker,

    Thanks for the information.

    We don't use DCT we are looking to generate the metrics through Delphix API. could you please let us know do we any possible solutions?

    .



    ------------------------------
    Vinoth Gopi
    TDM Consultant
    TATA Consultancy Services Ltd
    ------------------------------

    Original Message


  • 4.  RE: Metrics Creation

    Posted 09-28-2023 12:35:00 PM

    Hi,

    We created a simple powershell script that calls /executions and /execution-components for the job.  We add a few calculations and write it out to csv for further analysis.



    ------------------------------
    Murray Penno
    Platform Lead
    ANZ Bank New Zealand Limited
    ------------------------------

    Original Message


  • 5.  RE: Metrics Creation

    Posted 09-28-2023 03:52:00 PM
    Edited by Joel Zulueta 09-28-2023 03:52:48 PM

    Check ./dxmc job report --help.  Run as --detail. Not as detailed you are looking for, but have runtime stats.



    ------------------------------
    Joel Zulueta
    TDM
    Allstate Insurance Company
    ------------------------------

    Original Message


Related Content