GC overhead limit exceeded

  • 0
  • 1
  • Problem
  • Updated 4 months ago
  • (Edited)
While performing masking on oracle database, I am facing "GC overhead limit exceeded" issue.

Can you please help me to resolve it?
Photo of Ashok Kumar

Ashok Kumar

  • 240 Points 100 badge 2x thumb

Posted 4 months ago

  • 0
  • 1
Photo of David Wells

David Wells

  • 152 Points 100 badge 2x thumb
Ashok can you provide a little more information abut the masking job you are running?  and perhaps post a snippet of the actual error?
Photo of Ashok Kumar

Ashok Kumar

  • 240 Points 100 badge 2x thumb
Hi David,

We allocated Min :10GB to Max:25GB memory size in Masking job. In database few tables has more than 20Million. While running the masking job, after processing few records I am facing "GC overhead limited exceeded" issue.

ERROR (version 4.4.0-stable, build 17588 from 2012-11-29 13.29.40 by buildguy) : Caused by: java.lang.reflect.InvocationTargetException
2019/01/31 11:51:30 - Get All Lookups Values.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-29 13.29.40 by buildguy) : at sun.reflect.GeneratedMethodAccessor49.invoke(Unknown Source)
2019/01/31 11:51:30 - Get All Lookups Values.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-29 13.29.40 by buildguy) : at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2019/01/31 11:51:30 - Get All Lookups Values.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-29 13.29.40 by buildguy) : at java.lang.reflect.Method.invoke(Method.java:498)
2019/01/31 11:51:30 - Get All Lookups Values.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-29 13.29.40 by buildguy) : at org.codehaus.janino.ScriptEvaluator.evaluate(ScriptEvaluator.java:1026)
2019/01/31 11:51:30 - Get All Lookups Values.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-29 13.29.40 by buildguy) : at org.codehaus.janino.ScriptEvaluator.evaluate(ScriptEvaluator.java:464)
2019/01/31 11:51:30 - Get All Lookups Values.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-29 13.29.40 by buildguy) : at org.pentaho.di.trans.steps.janino.Janino.calcFields(Janino.java:201)
2019/01/31 11:51:30 - Get All Lookups Values.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-29 13.29.40 by buildguy) : ... 3 more
2019/01/31 11:51:30 - Get All Lookups Values.0 - ERROR (version 4.4.0-stable, build 17588 from 2012-11-29 13.29.40 by buildguy) : Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
(Edited)
Photo of John Hanratty

John Hanratty, Employee

  • 690 Points 500 badge 2x thumb

Hello Ashok:

      I agree 10GB-25GB memory should be more than enough for your masking jobs to run. If you are running multiple masking jobs with similar min/max values, please check that you are not exceeding the total memory on the masking engine. For your reference please see our KB article on this topic.

There may also be a table(s) setting causing this issue, I would suggest isolating the table(s) to help determine the cause. Also, our Delphix Support team can help you with this specific issue.    

Thanks Jack