Delphix Products

 View Only
Expand all | Collapse all

Refresh mask data from production to lower Environment

  • 1.  Refresh mask data from production to lower Environment

    Posted 05-10-2022 03:46:00 PM
    Hi Team,

         we have completed Data making process for RDS oracle.
         Customer now expected Refresh mask data from production to lower Environment.
         can we able to achieve self service for this?
         if yes, can you anyone provide step by step process.

    Thanks
    Raj

    ------------------------------
    Raj Kumar
    Data Engineer
    Liberty Mutual Insurance Company
    ------------------------------


  • 2.  RE: Refresh mask data from production to lower Environment

    Posted 05-12-2022 02:17:00 AM

    Hi Raj,

    Would you explain your Delphix and vDB architecture a bit. It would really help.

    Do you ingest from Prod and create a vDB and then give it as Lower Environment?

    Or do you have a Stage VDB where you would perform masking and other security operations and then create another vDB from the Stage VDB as Lower Environment?

    In both cases, there's solution but in first case, it would take time for the end users to be able to start using the Environment where in the second case, they can refresh their vDB very quickly from Self Service.

    BR,



    ------------------------------
    Rahim Cetinel
    Solution Architect | Delphix Blackbelt
    ------------------------------



  • 3.  RE: Refresh mask data from production to lower Environment

    Posted 05-12-2022 03:10:00 AM

    Hi Rahim.

     

        We have not created any VDB . we have completed  masking  process using Delphix masking Engine.

        Now customer expect prod refresh mask data to lower environment whenever they need .

       For this requirement , what are the process we need to take .

     

     

    Thanks & Regards,

    Raj kumar R

    GRS IT Test Data Management

     






  • 4.  RE: Refresh mask data from production to lower Environment

    Posted 05-12-2022 03:17:00 AM
    Hi Raj,

    Can you please clarify where you connected Delphix Masking Engine? Is the masked database a virtual database or is it a Production database?

    BR,

    ------------------------------
    Rahim Cetinel
    Solution Architect | Delphix Blackbelt
    ------------------------------



  • 5.  RE: Refresh mask data from production to lower Environment

    Posted 05-12-2022 03:29:00 AM
    For an architecture I would suggest the following.

    In this architecture you create a virtual database Stage and connect Delphix Masking Engine to the Stage VDB and mask it. After masking (and all other security operations are completed in the Stage VDB, you provision new vDBs from Stage, as many as you like. And all the VDBs provisioned from Stage would be secure databases.

    You can automate the refresh of Stage VDB and you can also automatically run Masking Engine and right after refresh, which means that you will always have latest secure data in Stage.

    The Self Service structure is to be created for Dev, Test and Lower Environment systems, and Self Service users can refresh and manage their data as they prefer.

    With this architecture when a Self Service user refreshes their vDB, they will get the latest secure data that is available in Stage VDB, and since this is a clone of a clone operation, it will complete much faster than a "provision+masking" operation.

    I hope this clarifies things for you.

    BR,

    ------------------------------
    Rahim Cetinel
    Solution Architect | Delphix Blackbelt
    ------------------------------



  • 6.  RE: Refresh mask data from production to lower Environment

    Posted 05-12-2022 05:23:00 AM
    Hi Rahim 

    in below image you mentioned delphix Engine and it could be masking or virtualization Engine.

    Prod Db --> delphix engine



    ------------------------------
    Raj Kumar
    Data Engineer
    Liberty Mutual Insurance Company
    ------------------------------



  • 7.  RE: Refresh mask data from production to lower Environment

    Posted 05-12-2022 04:52:00 AM
    Edited by Raj Kumar 05-12-2022 04:53:53 AM
    Hi Rahim,

      masking engine directly connected to  Production DB and we are not using virtualization Engine to create VDB.

      Please note : Prod DB in AWS RDS Oracle.in that case can we able to create VDB ?

    Thanks
    Raj


    ------------------------------
    Raj Kumar
    Data Engineer
    Liberty Mutual Insurance Company
    ------------------------------



  • 8.  RE: Refresh mask data from production to lower Environment

    Posted 05-13-2022 12:35:00 PM

    HI Rahim,

     

       we have launched Delphix Masking Engine in AWS Dev  environment and it connect  with AWS RDS oracle in another Dev  aws  environment.

       We have identified sensitive fields and done with in place masking .Now customer need self service option.

        Please assist me here

     

     

     

     

     

    Thanks & Regards,

    Raj kumar R

    GRS IT Test Data Management

     






  • 9.  RE: Refresh mask data from production to lower Environment

    Posted 05-13-2022 01:12:00 PM
    Hi Raj,
    I'd first of all question what self-service capability you need, but in general here's my thoughts on this:

    The self-service capability only operates on Virtual Databases created by Delphix Virtualization (continuous data) Engine.
    You would need to provision the Delphix Virtualization Engine and then ingest the RDS instance, provision a Virtual Database (VDB), create a self-service template and container, where you place the masked VDB.  A user would then be able to use the self-service functionality (bookmark, branch, restore, stop, start, share, etc).  You would either need to provision an Oracle RDS Custom database or an Oracle Database running on a VM.
    It would probably make sense to talk with a Delphix representative to understand exactly what you're trying to achieve from the Self-service.
    I'll ping Rahim to mention that you've followed up on his response and see if he has any other ideas.
    Regards,
    Gary

    ------------------------------
    Gary Hallam
    Director of Channel Sales, EMEA & Asia Pacific
    ------------------------------



  • 10.  RE: Refresh mask data from production to lower Environment

    Posted 05-13-2022 01:24:00 PM

    Hi Gary,

     

         Could you please let me know  delphix Virtualization Engine support AWS RDS  oracle Database to create VDB .

     

     

    Thanks & Regards,

    Raj kumar R

    GRS IT Test Data Management

     






  • 11.  RE: Refresh mask data from production to lower Environment
    Best Answer

    Posted 05-14-2022 12:29:00 AM
    Hi Raj,
    Delphix supports RDS, but you would need to run on RFS Custom, so that we can access the OS for some of the pre-req config settings. See AWS documentation here: https://aws.amazon.com/rds/custom/
    And Delphix here:
    Pretty new features from both orgs so you should get some assistance from your account teams to help set up.
    Regards,
    Gary


    --

    Gary Hallam

    Director of Channel

    Sales

    +447951756650 | +441293324101
    gary.hallam@delphix.com
    www.delphix.com
    1 Finsbury Avenue, London EC2M 2PF
    Join us in Paris to hear  and share digital transformation journey insights