View Only

May 2023 Change in Functionality

  Thread closed by the administrator, not accepting new replies.
  • 1.  May 2023 Change in Functionality

    Posted 05-31-2023 09:03:00 AM
    Edited by Michael Torok 05-31-2023 09:03:22 AM
    No replies, thread closed.

    This update covers new offerings, new features and functionality changes. Going forward, we will send this at the end of each month to give you a consolidated view of what has changed. 


    Three Key Highlights

    A quick overview of key, new May functionality:

    1. Expanded Data Discovery: Continuous Compliance can now automatically discover banking numbers and US Driver’s Licenses, facilitating better adherence to regulatory requirements.

    2. Oracle Table Space Subsetting: The Oracle Staging Push Continuous Data connector now allows you to drop table spaces, enabling you to limit the data delivered to downstream users. 

    3. DCT Developer Experience: Data Control Tower is the successor to Delphix Self Service, providing a unified experience across a modern user interface, APIs and DevOps integrations. Developers can quickly provision, refresh and teardown compliant data from any connected Continuous Data Engine.

    Data Control Tower (DCT)

    • Provision VDB User Interface: This UI-based wizard facilitates self-service provisioning of virtual databases across any connected Delphix engine. This makes it even easier to control the use of ephemeral data across your organization. Note, this release supports Oracle Single Tenant databases and additional sources will be added soon. 

    • Refresh VDB User Interface: DCT expands the concept of Refresh to simplify common VDB operations through APIs. Now, it is also available through the UI. Operations include: Refresh to Parent (normal refresh), Self-refresh (rewind/rollback), Refresh to Relative (related VDB), and Refresh to Bookmark.

    • VDB Template Import: Centralize VDB templates in DCT by first importing and then removing them from connected engines. 

    • Infrastructure Connection Management: Managing database infrastructure has been made easier with the ability to view, create, and edit configurations such as OS, IP Address, and authentication type directly from the UI. Existing environments are sourced from connected Continuous Data Engines and available operations include enable, disable, refresh, edit, and delete. A new Infrastructure wizard allows the user to quickly and consistently add UNIX environments from the UI.

    • ServiceNow Integration: Our ServiceNow integration now supports the “Utah” version and non-user-identifying telemetry monitoring through the DCT API Usage Report. With the full release of “Utah,” we anticipate ServiceNow will deprecate San Diego support. At this point, we will do the same. Please read this ServiceNow KB article for more details.

    • Terraform Integration: The Terraform integration now features improved monitoring capabilities of DCT objects and adds provisioning support for PostgreSQL, SAP HANA, Oracle Real Applications Clusters (RAC) and Oracle with Transparent Data Encryption (TDE).


    Continuous Compliance

    • IBAN Discovery and Masking: Supports automatically discovering and masking International Bank Account Numbers. 

    • New US Driver's License Classifier: Supports automatically discovering and masking US Driver’s Licenses. 

    • Oracle Source Sizing: Measures the size of connected Oracle databases. This information will be available via a new utilization PDF report as well as through the GET /billing-usage API

    • New Features for the Postgres Connector: The connector will now provide more automated control of indexes, constraints and triggers. This will automatically upgrade and allow you to choose these features.

    • User-controlled Automated Sensitive Data Discovery (ASDD) Set Upgrade: With the 11.0 release, we will begin shipping the standard ASDD discovery set independent of Continuous Compliance. You can use a new API endpoint to control when to adopt new ASDD discovery sets. This will allow you to upgrade to newer releases of the software without impacting existing workflows as well as to easily create and distribute your own classifier sets. 

    Hyperscale Compliance

    • Performance and Usability Improvements: We have added a number of important performance and usability improvements. These include better status reporting on the post-load phase, the ability to more seamlessly process Microsoft SQL Server tables that do not have a primary or unique key by which to split, and more efficient index handling (drop and recreate). Lastly, we have introduced the ability to cancel post-load operations. 

    • Hyperscale Compliance Kubernetes Support: Hyperscale now supports running in Kubernetes in addition to Docker Compose.

    Continuous Data

    • Staging Push Read-only Oracle Databases: We now support staging-push ingestion from read-only databases.

    • Partial Ingestion via Oracle Staging Push: Partial ingestion enables the ability to ingest only selected Oracle tablespaces with Staging Push. This feature allows you to subset the Oracle database by choosing only specific tablespaces.

    • MongoDB: Supports MongoDB Enterprise 6.0 and Mongo Atlas including cluster-to-cluster sync to enable ingestion of large, sharded databases.

    • MySQL/Linux: Supports MySQL v8 across all certified editions.

    • PostgreSQL: Supports point-in-time (PIT) provisioning using external logs and ingestion using the “pg_dumpall” utility.

    Compliance Services for Salesforce

    • Large Table Masking: Masking of large Salesforce Objects (Larger than 70 million records) is now possible through Delphix Compliance Services. Leveraging optimized API selection and driver configurations prevents read and update timeouts that are typical with large Salesforce objects.

    • Configurable Metadata Components: We now offer the option to select which metadata components to disable as part of masking, allowing users to customize their sandbox metadata while masking.

    • Custom Filters: We now have the option to add Salesforce Object Query Language (SOQL) filters to masking jobs. This enables users to partition large tables into smaller masking jobs. Also, instead of reseeding data when masking fails, custom filters can be used to specifically mask any records that failed to be masked.


    May Product Version Releases 

    This section includes all the software products that were shipped in May and their release dates. Most of these are available now on the Delphix download site except where otherwise noted:

    • MongoDB Connector 1.2.0 (April 28, 2023)

    • DCT ServiceNow Spoke 4.1.0 (May 5, 2023) (available on the ServiceNow Marketplace)

    • Hyperscale Compliance 8 (May 8, 2023)

    • Data Control Tower 7 (May 9, 2023)

    • MySQL/Linux Connector 4 (May 18, 2023)

    • PostgreSQL Connector 4 (May 24, 2023)

    • Continuous Data 11 (May 25, 2023)

    • Continuous Compliance 11 (May 25, 2023)

    • Hyperscale Compliance 9 (May 30, 2023)

    • DCT Terraform Provider 2.0.0 (May 31, 2023) (hosted on the Terraform Registry)


    End of Life and Deprecations

    Support for ESXi 6.0 has reached end-of-life for both Continuous Data and Continuous Compliance.

    #productannouncement #Product_Announcement #2023_11 # 

    Michael Torok
    Digital Customer Experience, Senior Director