Delphix Products

  • 1.  Delphix and Hadoop

    Posted 10-30-2019 03:47:00 AM
    Hi everyone,

    Is there anyone out there who tried using Delphix with Hadoop instances? Is there any possibility to do it with some addition workaround methods?

    Other than that is there anything in the Delphix Roadmap for privoding virtual data to Hadoop clusters?

    BR,

    ------------------------------
    Rahim Cetinel
    Solution Architect | Delphix Blackbelt
    Accuras, Turkey
    ------------------------------


  • 2.  RE: Delphix and Hadoop

    Posted 10-30-2019 12:01:00 PM
    Edited by Michael Torok 10-30-2019 12:03:03 PM
    Hi @Alexandros Mathopoulos and @Jason Grauel,
    Would either of you be able to address this question from Rahim?
    Would our Virtualization Plugins work for this type of need?

    Rahim,
    I would also suggest you add this request (for Hadoop support) to our Ideation section here: https://community.delphix.com/ideation-home
    Our product team reviews these requests.

    Thanks,
    Michael ​​​​

    ------------------------------
    Michael Torok
    Director of Knowledge and Community Management
    Delphix
    ------------------------------

    Original Message


  • 3.  RE: Delphix and Hadoop
    Best Answer

    Posted 10-30-2019 03:48:00 PM
    Hi Rahim, 

    No customer I am aware of has attempted to virtualize Hadoop using Delphix. We do not recommend trying to use Delphix to create virtual copies of Hadoop. Hadoop has a very different architecture than what Delphix can support today and very different business needs. 

    Virtualization Hadoop is not on our roadmap. 

    Best,

    ------------------------------
    Alexandros Mathopoulos
    Product Manager 2
    Delphix
    ------------------------------

    Original Message


  • 4.  RE: Delphix and Hadoop

    Posted 10-31-2019 04:14:00 AM
    Edited by Mouhssine Saidi 10-31-2019 08:59:50 AM
    Hi Rahim,

    As Alexandros states no native support for Hadoop is provided by delphix.

    Instead, I looked into this question with some prospects (still in study state) and there is no good or bad answer to it as all depends on the customer context.

    One of the best workarounds is to implement delphix upstream to loading data into Hadoop.

    For example, you have user profile records stored in an RDBMS, and you want to do reconciliation of those records with web application logs to get the full user records. 

    You can virtualize/mask both the webapp and database and rely on the correct Hadoop loader tool (eg. SQOOP, FLUME, Pig, Hive ...) to get your data into Hadoop.

    This will advantage of this solution is it helps creating a toolchain that ensures the Hadoop is updated correctly to any point in time you need and that also data are masked inside the Hadoop.

    Regards,

    Mouhssine

    ------------------------------
    Mouhssine SAIDI
    Community Member
    Delphix Community Members
    ------------------------------

    Original Message


Related Content