Delphix Products

 View Only

  • 1.  masking-initializer-1.1 restore fail with OutOfMemoryError

    Posted 10-21-2019 10:07:00 AM
    Hi guys,
    I don't know if this right place to post this discussion, please advice me the correct community.

    I'm checking the tool dlpx-masking-initializer-1.1.0 against Masking Engine 5.3.5.0 if it can replicate "Environments".
    The tool work fine to create YAML file, but restore failed with java.lang.OutOfMemoryError: Java heap space error.
    I've added DEFAULT_JVM_OPTS="-Xms1m -Xmx8m" in dlpx-masking-initializer but same error appears.
    Can anyone advice me what I can do to restore YAML file?
    I'm attaching error message for reference.

    #masking

    $ ./dlpx-masking-initializer-1.1.0/bin/dlpx-masking-initializer -f ./99182_backup.yaml -s -rException in thread "main" java.lang.OutOfMemoryError: Java heap space at java.util.regex.Matcher.<init>(Matcher.java:225) at java.util.regex.Pattern.matcher(Pattern.java:1093) at org.yaml.snakeyaml.resolver.Resolver.resolve(Resolver.java:114) at org.yaml.snakeyaml.composer.Composer.composeScalarNode(Composer.java:167) at org.yaml.snakeyaml.composer.Composer.composeNode(Composer.java:150) at org.yaml.snakeyaml.composer.Composer.composeValueNode(Composer.java:246) at org.yaml.snakeyaml.composer.Composer.composeMappingChildren(Composer.java:237) at org.yaml.snakeyaml.composer.Composer.composeMappingNode(Composer.java:225) at org.yaml.snakeyaml.composer.Composer.composeNode(Composer.java:154) at org.yaml.snakeyaml.composer.Composer.composeSequenceNode(Composer.java:199) at org.yaml.snakeyaml.composer.Composer.composeNode(Composer.java:152) at org.yaml.snakeyaml.composer.Composer.composeValueNode(Composer.java:246) at org.yaml.snakeyaml.composer.Composer.composeMappingChildren(Composer.java:237) at org.yaml.snakeyaml.composer.Composer.composeMappingNode(Composer.java:225) at org.yaml.snakeyaml.composer.Composer.composeNode(Composer.java:154) at org.yaml.snakeyaml.composer.Composer.composeSequenceNode(Composer.java:199) at org.yaml.snakeyaml.composer.Composer.composeNode(Composer.java:152) at org.yaml.snakeyaml.composer.Composer.composeValueNode(Composer.java:246) at org.yaml.snakeyaml.composer.Composer.composeMappingChildren(Composer.java:237) at org.yaml.snakeyaml.composer.Composer.composeMappingNode(Composer.java:225) at org.yaml.snakeyaml.composer.Composer.composeNode(Composer.java:154) at org.yaml.snakeyaml.composer.Composer.composeSequenceNode(Composer.java:199) at org.yaml.snakeyaml.composer.Composer.composeNode(Composer.java:152) at org.yaml.snakeyaml.composer.Composer.composeValueNode(Composer.java:246) at org.yaml.snakeyaml.composer.Composer.composeMappingChildren(Composer.java:237) at org.yaml.snakeyaml.composer.Composer.composeMappingNode(Composer.java:225) at org.yaml.snakeyaml.composer.Composer.composeNode(Composer.java:154) at org.yaml.snakeyaml.composer.Composer.composeSequenceNode(Composer.java:199) at org.yaml.snakeyaml.composer.Composer.composeNode(Composer.java:152) at org.yaml.snakeyaml.composer.Composer.composeValueNode(Composer.java:246) at org.yaml.snakeyaml.composer.Composer.composeMappingChildren(Composer.java:237) at org.yaml.snakeyaml.composer.Composer.composeMappingNode(Composer.java:225)​

    ------------------------------
    Hideki Masu
    Community Member
    Delphix Community Members
    ------------------------------


  • 2.  RE: masking-initializer-1.1 restore fail with OutOfMemoryError

    Posted 10-21-2019 11:05:00 AM
    Hi,

    As i don't know the size and structure of your environment, its hard to predict exact value that it will need. But for sure limit of 8MB for java is too low.
    Try to give command without upper memory limit: DEFAULT_JVM_OPTS="-Xms1m"
    Or give higher upper limit like 128MB: DEFAULT_JVM_OPTS="-Xms1m -Xmx128m"

    Regards
    Karol Kobus

    ------------------------------
    Karol Kobus
    Consultant
    Spica Solutions
    ------------------------------

    Original Message


  • 3.  RE: masking-initializer-1.1 restore fail with OutOfMemoryError

    Posted 10-21-2019 07:55:00 PM
    Thank you for suggestion.
    Unfortunately restore job failed with same error.
    I will try scale mode (-c option) instead.
    Thank you for your help!

    ------------------------------
    Hideki Masu
    Community Member
    Delphix Community Members
    ------------------------------

    Original Message


  • 4.  RE: masking-initializer-1.1 restore fail with OutOfMemoryError

    Posted 10-22-2019 01:51:00 AM
    Hi,

    If it crashed with out of memory on 128MB or on no limit, than prior to start of proces check the amount of free memory in your Delphix engine, and host, form which you are initiating dxtoolkit.

    Regards
    Karol Kobus

    ------------------------------
    Karol Kobus
    Consultant
    Spica Solutions
    ------------------------------

    Original Message


  • 5.  RE: masking-initializer-1.1 restore fail with OutOfMemoryError

    Posted 10-23-2019 02:50:00 AM
    Hi Hideki,

    in general java out of memory error message points out an issue with the jvm haven't enough RAM.

    As best practice the values of xms and xmx in jvm params. should be always identical.

    i suggest updating your jvm options with "-xms1024m -xmx1024m"

    regards,

    Mouhssine

    ------------------------------
    Mouhssine SAIDI
    Community Member
    Delphix Community Members
    ------------------------------

    Original Message


Related Content