Time taken for dSource Creation

  • 0
  • 1
  • Question
  • Updated 2 years ago
  • Answered

Question 1:

For a 1TB Production Size data, what is the time taken for creating dSource based on the recommended hardware configuration.

Question 2:

For a 1TB Production Size data, what is the time taken for applying a Masking (Masking Columns 200) on a vDB based on the recommended hardware configuration.

Photo of Ramesh

Ramesh

  • 518 Points 500 badge 2x thumb

Posted 2 years ago

  • 0
  • 1
Photo of Ranzo Taylor

Ranzo Taylor, Employee

  • 1,572 Points 1k badge 2x thumb
Official Response
Ramesh, the time to create a dSource varies greatly, and typically depends on the following.
  •     write rate of storage attached to the Delphix Engine
  •     network connection to the Delphix Engine
  •     read rate of your database
Whichever is slowest will determine the rate of dSource Creation.  They are all possible bottlenecks.

We've observed rates as high as 300 MB/s, which would lead to a load time of ~ 1 hour per TB.  Your mileage may vary, especially if your network connection to the Delphix Engine is low bandwidth or high latency, or your storage cannot write this quickly.

For Masking, what's important is the amount of data masked, not the total size of the production database.  The number of columns masked is slightly relevant, since it can affect Delphix's ability to parallelize the job.  But mostly it's a pure database IO exercise, with the biggest factors being things like the size of your redo logs and the write rate of your database. If you follow the hardware recommendations, the Delphix masking component will only contribute a few % of overhead; it will run about as fast as any other set of bulk operations which follow the pattern "read, generate update statement, write".