Best setting to mask giant tables?

  • 0
  • 1
  • Question
  • Updated 11 months ago
  • Acknowledged
I am trying to mask tables of more than 1 million lines, I tried several configurations, but the masking is very slow, there are some recommended settings for streams, theads .. I tried to use LK but there were no gains.
Photo of Rodrigo Pelucio

Rodrigo Pelucio

  • 120 Points 100 badge 2x thumb

Posted 11 months ago

  • 0
  • 1
Photo of Gianpiero Piccolo

Gianpiero Piccolo

  • 1,220 Points 1k badge 2x thumb
Hi Rodrigo,

Tables containing 1 or 2 milions of rows are not giant.
We are masking oracle table with hundreds of milions of rows. The mean spead is rough 500k rows per minute.
What is your speed, what is your database? Did you disable triggers, indexes?

Regards.
Gianpiero
Photo of Rodrigo Pelucio

Rodrigo Pelucio

  • 120 Points 100 badge 2x thumb
Hi, Gianpiero
This Bank I am masking does not contain constraints and also triggers.
 
Speed ​​is low 3840 rows per min...
Btree indexes exist in the field I'm masking, I'm using a credit card algorithm from Delphix itself.


Thanks
Photo of Gianpiero Piccolo

Gianpiero Piccolo

  • 1,220 Points 1k badge 2x thumb
Try to drop index, then mask, then re-create it.
Photo of Mouhssine SAIDI

Mouhssine SAIDI

  • 4,632 Points 4k badge 2x thumb
Hi,

Is it a partitioned table ? How many streams / threads did you configure for the job and what memory configuration you set for the job ?

Regards,

Mouhssine