Delphix Products

Hi there, we are trying to add a plan to make sure that the masked data after running masking is actually masked going forward. We are using manual testing to compare the masked data at the moment. The masking job runs for 12 hours for the entire dataset and the logs are over written to mine. Is there a location We could get the entire log for the masking run, Does Delphix masking engine provides a certifying provision to get a report of the success of the process? I have been trying to explore the certify process but can't get anything for the version 5.2.6 or 5.3. We would like to know the rows failures or column failures in a rule if possible..

#Masking

Hi Madhu,
I believe you will find some good answers provided by one of our tech services experts here https://community.delphix.com/delphix/topics/how-do-i-know-that-my-data-is-masked.

Thanks,
Michael

Hello Madu: On the monitor tab in the masking UI, for each masking job there is a masking report provided. Certification is not included in this report. If your certification process is comparing a before and after, keep in mind developers may add new records routinely. 
Thanks Jack     

Thanks Michael/John,
The issue is we have 315 odd jobs to go through, also the log file gets over written due to the length of the process. For instance I had a job that seem to have executed fine, but had a closer look, the majority of rows were left unmasked due to an algorithm issue. The test team pointed it out, but I would like to have an input from the logs to point this. It's not practical to go into each job for the dataset and manually certify the runs in our particular case..

Hi Again, Are you able to say where the runtime logs can be found after they get overwritten? 

It may very well happen that rows are left unmasked not because of an error in the algorithm but because of logic. In such a case, the logs will show all rows masked because all rows have been processed, however based on logic they may not have actually masked.

In short, if you are looking for a confirmation of data actually is masked or not, I am not sure logs are the right source to give you that information.

If you are taking a backup of your tables before masking, then may be its just easier to join the backup table with the table masked on the primary key and look for before and after values that are same and not null- ideally if everything is masked you should have 0 rows from the join