Delphix Products

 View Only
Expand all | Collapse all

JSON File Masking using JSON connector - File format gets changed after masking

  • 1.  JSON File Masking using JSON connector - File format gets changed after masking

    Posted 03-30-2023 04:56:00 AM

    Hello All,

    Hello Team,
    We are using the JSON file connector to mask the JSON file as it is nested JSON file, structure of the file is one records/line.
    When we run masking job on the file, structure if the file will get change to PRETTY PRINT format.

    Support team confirmed that , format will get change after masking.

    My question is :

    If we would like to convert the masked JSON file back to one line /record format then what should need to be done?

    Dose any one have script or linux command to convert file ?

    Or any postscript after masking job that needs to be run after masking job to convert the file back to original format ?



    ------------------------------
    PANKAJ ASEGAONKAR
    Delphix masking analyst
    Infosys
    ------------------------------


  • 2.  RE: JSON File Masking using JSON connector - File format gets changed after masking

    Posted 04-03-2023 08:33:00 AM

    Hi Pankaj, thanks for reaching out to the community.  Our professional services team developed a plugin to configure the output as a single line, or you can reference one of these two links below as an example using boto3 to write back to DynamoDB as a single line JSON from pretty print.  If you would like to use the Professional Services plugin, please engage your Regional Sales Manager and Technical Account Manager for more information.

    https://medium.com/@NotSoCoolCoder/handling-json-data-for-dynamodb-using-python-6bbd19ee884e

    https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/dynamodb/service-resource/batch_write_item.html



    ------------------------------
    Robert Henning
    Principal Solutions Engineer
    Delphix
    ------------------------------