Delphix Products

Hi All,

Could you please let me know, can we run data profiler to identify the sensitive elements in a Parque file.

Kindly let us know the possible solutions to achieve this.

Looking forward to hearing back from you.

Thanks

Vinoth

Hi Vinoth,

Thanks for reaching out to the community. Do you mean Apache Parquet formatted files?

Best regards.

Hi All,

Could you please let me know, can we run data profiler to identify the sensitive elements in a Parque file.

Kindly let us know the possible solutions to achieve this.

Looking forward to hearing back from you.

Thanks

Vinoth

Hi Luke,

Yes. It's Apache Parquet formatted files.

Could you please let us know the feasibility

Thanks

Vinoth.

Hi Vinoth,

Thanks for reaching out to the community. Do you mean Apache Parquet formatted files?

Best regards.

Hi All,

Could you please let me know, can we run data profiler to identify the sensitive elements in a Parque file.

Kindly let us know the possible solutions to achieve this.

Looking forward to hearing back from you.

Thanks

Vinoth

Hello Vinoth,

Unfortunately this is not available as an integrated Masking solution.
The Compliance Engine requires data in human readable format and Parquets are binary.

It's possible to use pre-post scripts in order to workaround this but as stated, there's currently no out the box solution.

I hope this helps. 

Hi Luke,

Yes. It's Apache Parquet formatted files.

Could you please let us know the feasibility

Thanks

Vinoth.

Hi Vinoth,

Thanks for reaching out to the community. Do you mean Apache Parquet formatted files?

Best regards.

Hi All,

Could you please let me know, can we run data profiler to identify the sensitive elements in a Parque file.

Kindly let us know the possible solutions to achieve this.

Looking forward to hearing back from you.

Thanks

Vinoth

Hi Luke,

Thanks for the update.

Could you please let us know any feasible approach in-place that can be used to approach the Paraquet file.

If there are any documents provided kindly let us know.

Thanks

Vinoth Gopi

Hello Vinoth,

Unfortunately this is not available as an integrated Masking solution.
The Compliance Engine requires data in human readable format and Parquets are binary.

It's possible to use pre-post scripts in order to workaround this but as stated, there's currently no out the box solution.

I hope this helps. 

Hi Luke,

Yes. It's Apache Parquet formatted files.

Could you please let us know the feasibility

Thanks

Vinoth.

Hi Vinoth,

Thanks for reaching out to the community. Do you mean Apache Parquet formatted files?

Best regards.

Hi All,

Could you please let me know, can we run data profiler to identify the sensitive elements in a Parque file.

Kindly let us know the possible solutions to achieve this.

Looking forward to hearing back from you.

Thanks

Vinoth

HI Vinoth,

Parquet are compressed file formats.

Enable hive table on it or import into PostgreSQL as table format whichever is suitable in your available tool stacks. Basically, covert into table format that delphix support. Once you are successful with this You can automate this conversion from file to table and table to parquet again using hookscirpts as Luke recommended.

You can also utilize sqoop for this export and import and later configure sqoop bash scripts in hooks.

Regards,

Madhav

Hi Luke,

Thanks for the update.

Could you please let us know any feasible approach in-place that can be used to approach the Paraquet file.

If there are any documents provided kindly let us know.

Thanks

Vinoth Gopi

Hello Vinoth,

Unfortunately this is not available as an integrated Masking solution.
The Compliance Engine requires data in human readable format and Parquets are binary.

It's possible to use pre-post scripts in order to workaround this but as stated, there's currently no out the box solution.

I hope this helps. 

Hi Luke,

Yes. It's Apache Parquet formatted files.

Could you please let us know the feasibility

Thanks

Vinoth.

Hi Vinoth,

Thanks for reaching out to the community. Do you mean Apache Parquet formatted files?

Best regards.

Hi All,

Could you please let me know, can we run data profiler to identify the sensitive elements in a Parque file.

Kindly let us know the possible solutions to achieve this.

Looking forward to hearing back from you.

Thanks

Vinoth