Delphix Products

 View Only

  • 1.  Masking performance issue for 100 GB Mainframe file

    Posted 03-05-2020 12:49:00 PM

    Hi. We've been seeing slow performance masking a 100 GB mainframe data file using 9 standard(not custom) algorithms.
    It takes about 8 days to mask the mainframe file, and we were wondering if anyone had similar issues with their own files.
    We've tried split on a linux host, but this takes a long time.
    Does anyone know of a good application or command to use to more quickly do the splitting, or any other suggestions for things you've done that we can try to help us with this issue?
    Thanks very much.



    ------------------------------
    Rich Van Veen
    Security Professional
    Wells Fargo
    ------------------------------


  • 2.  RE: Masking performance issue for 100 GB Mainframe file

    Posted 03-06-2020 12:45:00 AM

    Do you use the FTP or SFTP connector?  I assume you copy the file from the mainframe to the Linux subsystem - and from there access via FTP/SFTP?

    In Delphix version 6 is the new option to mount NFS/CIFS shares which possibly gives performance benefits.

    What types of algorithms do you use?  Usually SecureLookup/SegmentedMapping should perform well .. avoid using Mapping algorithms.



    ------------------------------
    Tino Pironti
    Technical Services
    Delphix
    ------------------------------

    Original Message


  • 3.  RE: Masking performance issue for 100 GB Mainframe file

    Posted 03-06-2020 03:35:00 AM
    Hi Rich,

    To complete Tino's questions can you provide more detail on the following :

    - The engine version
    - Memory engine RAM
    - Network speed between target server and masking engine
    - To mask file/files are you relying on Linux to do masking or on Mainframe
    - Number of configured Job/Jobs
    - What configuration are you using for the job (min/max memory, threads, stream ...)
    - Ruleset configuration are you using patterns or individual files
    - What split size you go for

    Did you try using "dd" command to split the 100G file, need some extra work on script with skip part.

    Regards,

    Mouhssine

    ------------------------------
    Mouhssine SAIDI
    Community Member
    Delphix Community Members
    ------------------------------

    Original Message


Related Content