Delphix Products

 View Only
Expand all | Collapse all

Bookmark creation automation and notify self service user about expired bookmarks

  • 1.  Bookmark creation automation and notify self service user about expired bookmarks

    Posted 03-02-2024 07:04:00 PM

    We know that using Delphix tool kit , we can create bookmark and delete bookmark, however

    1. How to schedule to create bookmark for all the containers in the Delphix engine
    2. How to report ( using email notification ) report the Delphix self service user to remind to delete the bookmark ( what is the dxtoolkit file name to achieve this)

    Please share any documents available in delphix to acheive this. Appreciate any help and support from the Delphix community.



    ------------------------------
    PETER SURESH JAYARAJ
    DBA
    Israel Discount Bank of New York
    ------------------------------



  • 2.  RE: Bookmark creation automation and notify self service user about expired bookmarks

    Posted 03-05-2024 03:05:00 AM

    Hi Peter.

    1. There is no feature in DXToolkit to schedule bookmark creation. If you want to schedule an action you will have to use some external tool, i.e. crontab, to execute that script that: retrieves all the containers in a given engine (dx_get_js_containers) and creates a bookmark for each of them (dx_ctl_js_bookmarks).
    2. Again, there is no DXToolkit feature to send notifications via email. If you want to do this you will need an external tool. In any case, you can agree with the end users on the expire date for the bookmarks and set one upon bookmark creation with the -expireat parameter.


    ------------------------------
    Jose Manuel Rodriguez Prieto
    Technical Account Manager
    Delphix
    ------------------------------



  • 3.  RE: Bookmark creation automation and notify self service user about expired bookmarks

    Posted 03-07-2024 03:07:00 PM

    Hi Jose,

    Appreciate your response on my questions and is very helpful to focus further on the available opportunities to make it happen. Thank you so much.

     -expireat   > Will  this parameter remove the bookmarks created automatically after certain condition ( time)

    Thanks,
    Peter



    ------------------------------
    PETER SURESH JAYARAJ
    DBA
    Israel Discount Bank of New York
    ------------------------------



  • 4.  RE: Bookmark creation automation and notify self service user about expired bookmarks

    Posted 03-07-2024 06:09:00 PM
    Edited by PETER SURESH JAYARAJ 03-07-2024 06:10:47 PM

    In addition,

    I am using dxtoolkit2-v2.4.13-win64-installer. ( Is any latest version available)

     help command shows that bookmark creation time (Shown above), however when I run the command against the Delphix engine, the bookmark creation time shows as NA.

    .\dx_get_js_bookmarks -help

    EXAMPLES
        List all bookmarks

         dx_get_js_bookmarks -d Landshark5

         Appliance            Bookmark name                  Bookmark time                  Template name                  Container name                 Branch name
         -------------------- ------------------------------ ------------------------------ ------------------------------ ------------------------------ --------------------
         Landshark5           Before insert                  2016-10-25 08:41:34 IST        Oracle dSource template        Dev container                  default
         Landshark5           BookmarkNOW                    2016-11-08 16:46:35 GMT        Oracle dSource template        Dev container                  default

    Actual command output,

    .\dx_get_js_bookmarks -d < Engine_Name> 

    Use of uninitialized value in string eq at C:\Users\...\AppData\Local\Temp\7\par-4442412d53514c2d41646d696e2d554154\cache-b962869b006bc53eb3f769c7ae52fa114d6f7c17\inc\lib/Engine.pm line 1059.

    Appliance            Bookmark name                  Bookmark time                  Template name                  Container name                 Branch name          Branch full name
    -------------------- ------------------------------ ------------------------------ ------------------------------ ------------------------------ -------------------- ------------------------------
    <Engine_Name>  Test                           N/A                            N/A                            Appli_ENV-Appli-3        default              N/A/Applit_ENV-Appli-3/de

    Could anyone explain what was the reason and how to mitigate?

    Thanks,

    Peter



    ------------------------------
    PETER SURESH JAYARAJ
    DBA
    Israel Discount Bank of New York
    ------------------------------



  • 5.  RE: Bookmark creation automation and notify self service user about expired bookmarks

    Posted 03-07-2024 06:24:00 PM

    on the other hand, when use below dx command, bookmark name is encrypted, bookmark creation time is coming though.

    .\dx_get_bookmarks -d <Engine_Name>

    Appliance            Bookmark name        Timestamp                                Timeflow name                            Database name
    -------------------- -------------------- ---------------------------------------- ---------------------------------------- ----------------------------------------
    <Engine_Name>     157-47df5da2-c97f-42 2023-02-14 21:00:35 EST                  DB_PROVISION@2023-02-14T20:24:35          <DBNAME>

    Thanks,

    Peter



    ------------------------------
    PETER SURESH JAYARAJ
    DBA
    Israel Discount Bank of New York
    ------------------------------



  • 6.  RE: Bookmark creation automation and notify self service user about expired bookmarks

    Posted 03-11-2024 03:31:00 AM

    In order to determine what is happening you have to execute the command with the "-debug 3" flag and provide here the resulting output and the generated log files.

    In any case, there is a newer version of dxToolkit that you should try first: https://github.com/delphix/dxtoolkit/releases

    You can keep an eye in the public dxToolkit Github repository for new releases: https://github.com/delphix/dxtoolkit/releases



    ------------------------------
    Jose Manuel Rodriguez Prieto
    Technical Account Manager
    Delphix
    ------------------------------



  • 7.  RE: Bookmark creation automation and notify self service user about expired bookmarks

    Posted 03-11-2024 03:12:00 AM
      |   view attached

    Hi Peter,

    Are you aware that you can create a bookmark in the container template that all the containers can access - I'm not sure if this is what you want to achieve but it's a good way to create a common point in time that all of the containers can restore to.  Often this is done as a common Before End-of-day or After End-of-day backup; points in time that developers generally tend to be interested in!

    To automate this you can place the bookmark creation script in the dSource pre-sync Hook API point.  It depends how often you sync of course as it may create too many bookmarks for your needs, in which case you'll need to take Jose's external tool approach.

    Add dSource Hook script GUI frame
    Here's a diagrammatic view of the concept:
    Automatic Bookmarking diagram using Goodnotes
    I've attached a sample template courtesy of Diego, Carlos & Mouhssine.
    Regards,
    Gary


    ------------------------------
    Gary Hallam
    Director, Channel Business EMEA, APAC
    ------------------------------

    Attachment(s)



  • 8.  RE: Bookmark creation automation and notify self service user about expired bookmarks

    Posted 03-19-2024 09:06:00 PM
    Edited by PETER SURESH JAYARAJ 03-19-2024 09:07:20 PM

    Hi Gary,

    Thank you for your response on this thread. Appreciate your valuable input.

    It seems bookmark at template level also a viable option I could try with, could you help me to navigate to that screen that you have posted as I coudn't see that either from an admin console or from self-service portal. All I can see from dataset --> config--> hooks ( for pre and post refresh)

    Thanks,
    Peter



    ------------------------------
    PETER SURESH JAYARAJ
    DBA
    Israel Discount Bank of New York
    ------------------------------



  • 9.  RE: Bookmark creation automation and notify self service user about expired bookmarks

    Posted 03-11-2024 03:27:00 AM

    Yes. The parameter accepts a timestamp after which the bookmard will automatically be deleted provided there are no dependencies, i.e. no VDBs, branches, etc. have been created out of it.



    ------------------------------
    Jose Manuel Rodriguez Prieto
    Technical Account Manager
    Delphix
    ------------------------------



  • 10.  RE: Bookmark creation automation and notify self service user about expired bookmarks

    Posted 03-19-2024 08:57:00 PM

    Thank you Jose. Apologies for the delayed response. I will tty to make use of the parameter in the script.

    Scheduling, notification I can use any external tool like crontab, PowerShell by combination of scripts.

    Is there any dx tool kit parameter to take bookmark for all containers in the engine. Appreciate your help. 

    Thanks,
    Peter



    ------------------------------
    PETER SURESH JAYARAJ
    DBA
    Israel Discount Bank of New York
    ------------------------------



  • 11.  RE: Bookmark creation automation and notify self service user about expired bookmarks

    Posted 03-20-2024 04:25:00 AM

    No, there is no parameter or command for dxToolkit to bookmark all the containers in a given engine but if you feel like this is a valuable feature you can open a bug in the GitHub repository.



    ------------------------------
    Jose Manuel Rodriguez Prieto
    Technical Account Manager
    Delphix
    ------------------------------