I have been notified of errors when i execute profiling job against a ruleset:
1) The job have been running for long time although i have tried to force change status in stop without result. I think the following excerpt is related to the issue:
2017-02-02 16:12:05,653 INFO com.dmsuite.jobs.monitor.MonitorGroupThread - We are forcefully ending the job, deue to transformation logs are not updated properly. Monitor result may be not proper
2017-02-02 16:12:05,683 ERROR com.dmsuite.manager.monitor.MonitorManagerImpl - Exception in updateJobStatusForceFully :-
javax.xml.bind.UnmarshalException
- with linked exception:
[java.io.FileNotFoundException: /var/delphix/dmsuite/output/edma/Profiler/1_Response.xml (No such file or directory)]
at com.sun.xml.bind.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal0(UnmarshallerImpl.java:196)
at com.sun.xml.bind.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal(UnmarshallerImpl.java:167)
at javax.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:157)
at javax.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:162)
at javax.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:171)
at javax.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(AbstractUnmarshallerImpl.java:189)
at com.dmsuite.manager.monitor.MonitorManagerImpl.updateJobStatusForceFully(MonitorManagerImpl.java:5284)
at com.dmsuite.manager.monitor.MonitorManagerImpl$$FastClassByCGLIB$$f4167a94.invoke(<generated>)
at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:149)
at org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:688)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:110)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:621)
at com.dmsuite.manager.monitor.MonitorManagerImpl$$EnhancerByCGLIB$$95ab465.updateJobStatusForceFully(<generated>)
at com.dmsuite.jobs.monitor.MonitorGroupThread.updateRunningJobsDetails(MonitorGroupThread.java:222)
at com.dmsuite.jobs.monitor.MonitorGroupThread.run(MonitorGroupThread.java:151)
Caused by: java.io.FileNotFoundException: /var/delphix/dmsuite/output/edma/Profiler/1_Response.xml (No such file or directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.<init>(FileInputStream.java:138)
at java.io.FileInputStream.<init>(FileInputStream.java:93)
at sun.net.
www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90) at sun.net.
www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188) at org.apache.xerces.impl.XMLEntityManager.setupCurrentEntity(Unknown Source)
at org.apache.xerces.impl.XMLVersionDetector.determineDocVersion(Unknown Source)
at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source)
at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source)
at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source)
at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source)
at com.sun.xml.bind.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal0(UnmarshallerImpl.java:194)
... 16 more
2) The following log excerpt notify data type conversion issue between oracle and java:
2017-02-02 16:07:18,132 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] INFO 02-02 16:07:18,132 - null - Finished job entry [INT_ASSEGNATARI] (result=[true])
2017-02-02 16:07:18,177 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] INFO 02-02 16:07:18,177 - Modified Java Script Value - Optimization level not specified. Using default of 9.
2017-02-02 16:07:18,182 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] ERROR 02-02 16:07:18,182 - Table input - Unexpected error
2017-02-02 16:07:18,183 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] ERROR 02-02 16:07:18,183 - Table input - org.pentaho.di.core.exception.KettleDatabaseException:
2017-02-02 16:07:18,183 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] Couldn't get row from result set
2017-02-02 16:07:18,183 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1]
2017-02-02 16:07:18,183 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] Unable to get value 'Integer(38)' from database resultset, index 9
2017-02-02 16:07:18,183 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] Numeric Overflow
2017-02-02 16:07:18,183 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1]
2017-02-02 16:07:18,183 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1]
2017-02-02 16:07:18,183 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] at org.pentaho.di.core.database.Database.getRow(Database.java:2758)
2017-02-02 16:07:18,183 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] at org.pentaho.di.core.database.Database.getRow(Database.java:2730)
2017-02-02 16:07:18,183 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] at org.pentaho.di.trans.steps.tableinput.TableInput.processRow(TableInput.java:153)
2017-02-02 16:07:18,183 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] at org.pentaho.di.trans.step.RunThread.run(RunThread.java:50)
2017-02-02 16:07:18,183 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] at java.lang.Thread.run(Thread.java:745)
2017-02-02 16:07:18,184 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] Caused by: org.pentaho.di.core.exception.KettleDatabaseException:
2017-02-02 16:07:18,184 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] Unable to get value 'Integer(38)' from database resultset, index 9
2017-02-02 16:07:18,184 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] Numeric Overflow
2017-02-02 16:07:18,184 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1]
2017-02-02 16:07:18,184 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] at org.pentaho.di.core.database.BaseDatabaseMeta.getValueFromResultSet(BaseDatabaseMeta.java:1900)
2017-02-02 16:07:18,184 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] at org.pentaho.di.core.database.DatabaseMeta.getValueFromResultSet(DatabaseMeta.java:2613)
2017-02-02 16:07:18,184 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] at org.pentaho.di.core.database.Database.getRow(Database.java:2750)
2017-02-02 16:07:18,184 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] ... 4 more
2017-02-02 16:07:18,184 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] Caused by: java.sql.SQLException: Numeric Overflow
2017-02-02 16:07:18,184 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] at oracle.jdbc.driver.NumberCommonAccessor.throwOverflow(NumberCommonAccessor.java:4380)
2017-02-02 16:07:18,184 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] at oracle.jdbc.driver.NumberCommonAccessor.getLong(NumberCommonAccessor.java:645)
2017-02-02 16:07:18,184 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] at oracle.jdbc.driver.OracleResultSetImpl.getLong(OracleResultSetImpl.java:971)
2017-02-02 16:07:18,184 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] at org.pentaho.di.core.database.BaseDatabaseMeta.getValueFromResultSet(BaseDatabaseMeta.java:1864)
2017-02-02 16:07:18,184 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1] ... 6 more
2017-02-02 16:07:18,184 INFO com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_1]
Luigi