Delphix Products

 View Only

  • 1.  GC overhead limit exceeded

    Posted 01-31-2019 06:37:00 AM
    While performing masking on oracle database, I am facing "GC overhead limit exceeded" issue.

    Can you please help me to resolve it?
    #Masking


  • 2.  RE: GC overhead limit exceeded

    Posted 01-31-2019 01:15:00 PM
    Ashok can you provide a little more information abut the masking job you are running?  and perhaps post a snippet of the actual error?


  • 3.  RE: GC overhead limit exceeded

    Posted 02-01-2019 03:19:00 AM
    Hi David,

    We allocated Min :10GB to Max:25GB memory size in Masking job. In database few tables has more than 20Million. While running the masking job, after processing few records I am facing "GC overhead limited exceeded" issue.

    ERROR (version 4.4.0-stable, build 17588 from 2012-11-29 13.29.40 by buildguy) : Caused by: java.lang.reflect.InvocationTargetException
    2019/01/31 11:51:30 - Get All Lookups Values.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-29 13.29.40 by buildguy) : at sun.reflect.GeneratedMethodAccessor49.invoke(Unknown Source)
    2019/01/31 11:51:30 - Get All Lookups Values.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-29 13.29.40 by buildguy) : at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    2019/01/31 11:51:30 - Get All Lookups Values.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-29 13.29.40 by buildguy) : at java.lang.reflect.Method.invoke(Method.java:498)
    2019/01/31 11:51:30 - Get All Lookups Values.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-29 13.29.40 by buildguy) : at org.codehaus.janino.ScriptEvaluator.evaluate(ScriptEvaluator.java:1026)
    2019/01/31 11:51:30 - Get All Lookups Values.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-29 13.29.40 by buildguy) : at org.codehaus.janino.ScriptEvaluator.evaluate(ScriptEvaluator.java:464)
    2019/01/31 11:51:30 - Get All Lookups Values.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-29 13.29.40 by buildguy) : at org.pentaho.di.trans.steps.janino.Janino.calcFields(Janino.java:201)
    2019/01/31 11:51:30 - Get All Lookups Values.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-29 13.29.40 by buildguy) : ... 3 more
    2019/01/31 11:51:30 - Get All Lookups Values.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-29 13.29.40 by buildguy) : Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded


  • 4.  RE: GC overhead limit exceeded

    Posted 02-01-2019 01:48:00 PM

    Hello Ashok:

          I agree 10GB-25GB memory should be more than enough for your masking jobs to run. If you are running multiple masking jobs with similar min/max values, please check that you are not exceeding the total memory on the masking engine. For your reference please see our KB article on this topic.

    There may also be a table(s) setting causing this issue, I would suggest isolating the table(s) to help determine the cause. Also, our Delphix Support team can help you with this specific issue.    

    Thanks Jack