Delphix Products

 View Only
Expand all | Collapse all

Data Masking for Mainframe

  • 1.  Data Masking for Mainframe

    Posted 09-08-2020 12:21:00 PM
    We are trying to mask Mainframe z/os Flat files and db2. I went thru the documentation but didn't find much info on the connection part. Can you please share available methodologies an process to connect to mainframe from delphix?

    ------------------------------
    Bhupinder Kwatra
    Delphix Community Members
    ------------------------------


  • 2.  RE: Data Masking for Mainframe

    Posted 09-09-2020 08:38:00 AM
    Can someone shared the required info please ..

    ------------------------------
    Bhupinder Kwatra
    Delphix Community Members
    ------------------------------



  • 3.  RE: Data Masking for Mainframe

    Posted 09-09-2020 09:57:00 AM
    Hello Bhupinder,

    Thank you for reaching out to the Delphix community.

    Instructions for installing the mainframe connector can be found here: https://maskingdocs.delphix.com/Getting_Started/Db2_Connector_License_Installation/

    I hope this is helpful, please let me know if this is what you are looking for.

    Adam

    ------------------------------
    Adam Smith
    Member of Technical Staff
    Delphix
    ------------------------------



  • 4.  RE: Data Masking for Mainframe

    Posted 09-09-2020 10:19:00 AM
    Hi Adam,

    Thanks for the response. However ,I wanted to know -

    1.) Can delphix directly connect to a fixed file(PS) residing on DASD(Z/OS). If yes , how ?

    As far as I know ,we need to move the file to USS.

    2.) With the DB2 connector , can delphix directly communicate to the DB2 on z/os ?

    Can you please share the common issues that are encountered while performing the above connection?

    Regards,
    Bhupinder Kwatra


    ------------------------------
    Bhupinder Kwatra
    Delphix Community Members
    ------------------------------



  • 5.  RE: Data Masking for Mainframe

    Posted 09-09-2020 11:29:00 AM
    Hello Bhupinder,

    Please see my answers below:

    1. I believe you would need to move the file to USS then we could use sftp for example.

    2. Yes, it can connect directly to the Database, you would need to ensure you have the correct Licence. More info here: https://maskingdocs.delphix.com/Getting_Started/Db2_Connector_License_Installation/
    Your account manager should be able to provide specifics.

    Can you please share the common issues that are encountered while performing the above connection?

    Licencing and Firewalls tend to be the most common issues around getting a successful connection.

    Please let me know if you have any further questions.

    Thank you

    Adam


    ------------------------------
    Adam Smith
    Member of Technical Staff
    Delphix
    ------------------------------



  • 6.  RE: Data Masking for Mainframe

    Posted 09-09-2020 09:51:00 PM
    Thanks Adam for the response.
    I read in one the blog post that Delphix can connect to mainframe flat files residing on DASD via NFS server which was one time configuration on the z/os.
    Could you please confirm if this is rolled out and the process of using the same

    ------------------------------
    Bhupinder Kwatra
    Delphix Community Members
    ------------------------------



  • 7.  RE: Data Masking for Mainframe

    Posted 09-10-2020 07:48:00 AM
    Also,can you please help with the detailed steps that need to be done for a flat file residing on DASD.
    1.) Any conversion needed for that PS file to HFS before doing OCOPY/OPUT ?
    2.) Copy the DASD file to USS ?
    3.) Do we need to create directory and empty file on USS before copying?
    4.) Which connector to use in delphix for USS connection ?


    ------------------------------
    Bhupinder Kwatra
    Delphix Community Members
    ------------------------------



  • 8.  RE: Data Masking for Mainframe
    Best Answer

    Posted 09-10-2020 06:20:00 PM
    Hi Bhupinder, DB2 Z/OS masking is similar to masking any other relational DBMS data once you have the connector enabled as detailed in the link Adam provided.  There are fewer options on the job creation dialogue for the convenience check boxes for DB2 (indexes, constraints, triggers) but a masking inventory will be applied in exactly the same manner and data produced by the algorithms will be identical to the other DBMS's.    

    Mainframe file masking is different mainly because mainframe data employs EBCDIC encoding.  The File - Mainframe connector is included in the base product and performs the conversion of the data into a format that can be masked consistently by the masking engine (ME) so data produced by the algorithms will be consistent with masked data produced on other platforms.  Delphix File masking setup is different from DB masking since metadata must be provided by the user rather than the DBMS; an extra step to provide the file format is required.  The connector determines the type of file format required; fixed, delimited, XML for ASCII data and copybook for EBCDIC data.  

    It's possible to convert mainframe data from EBCDIC to ASCII (many file transfer products support this) which allows more flexibility in the definition of the record types.  ASCII file masking functionality allow definition of multiple record types (in the inventory) which support variable formats - supporting application of algorithms to different positions within the file.  Processing of various record types in a mainframe file is supported via redefines clauses in the copybook but this is not as flexible in that the redefines do not always exist in the copybook. 

    USS can be exploited for masking EBCDIC data since USS simulates an HFS directory (required for Delphix file connectors) where data does not have to be converted to ASCII.  This method also allows the data to be masked on the mainframe Sysplex (obviating need to move data off mainframe; OCOPY will support this, HFS directory must exist prior to use  https://www.ibm.com/support/knowledgecenter/SSLTBW_2.4.0/com.ibm.zos.v2r4.bpxa500/tsoocopy.htm

    If an NFS server is running on Z/OS it can be configured to handle the connection from Delphix directly to mainframe disk obviating the need to move the files to HFS https://www-01.ibm.com/servers/resourcelink/svc00100.nsf/pages/zosv2r3sc236883/$file/idan400_v2r3.pdf
    I've tested this and it works; security on the mainframe was not active during my testing, that would have to be worked out with the security team managing access to mainframe data.  There are also third party products that manage the Delphix mainframe file connectors https://dovetail.com/products/sftp.html






    ------------------------------
    Robert Patten
    Principal Data Privacy Specialist
    Delphix Community Members
    ------------------------------



  • 9.  RE: Data Masking for Mainframe

    Posted 09-23-2020 06:48:00 AM
    Edited by Bhupinder Kwatra 09-26-2020 11:34:23 PM


  • 10.  RE: Data Masking for Mainframe

    Posted 09-23-2020 09:37:00 AM
    I/P FIle :
    12345679      ABC
    23456778      BCD
    34567890      CDE
    O/P File :
    12345679      ZZZ
    23456778    ZZZ
    34567890  ZZZ

    This is what was observed in the output file , the masked char for each line is shifted to the left.

    ------------------------------
    Bhupinder Kwatra
    Delphix Community Members
    ------------------------------



  • 11.  RE: Data Masking for Mainframe

    Posted 09-23-2020 02:59:00 PM
    OCOPY should not change the format of the file or length of the records.  Were the records of variable length prior to shipping the file to USS?  If so, the masking engine must be told of the different record positions to apply the algorithms correctly.  The output you shared leads me to believe that the input records did not match exactly with the file format / copybook.  This is common for files that contain variable length records.  The input records must align exactly with the file format.

    ------------------------------
    Robert Patten
    Principal Data Privacy Specialist
    Delphix
    ------------------------------



  • 12.  RE: Data Masking for Mainframe

    Posted 09-23-2020 07:01:00 PM
    Edited by Bhupinder Kwatra 09-26-2020 11:35:53 PM


  • 13.  RE: Data Masking for Mainframe

    Posted 09-24-2020 01:48:00 AM
    Edited by Bhupinder Kwatra 09-26-2020 11:31:52 PM


  • 14.  RE: Data Masking for Mainframe

    Posted 09-24-2020 08:54:00 AM
    Is it possible to share a recorded session of file masking showing all the steps.

    ------------------------------
    Bhupinder Kwatra
    Delphix Community Members
    ------------------------------