Error on profiling job data level concrete case

  • 0
  • 1
  • Problem
  • Updated 2 years ago
  • In Progress

I have open some threads on Delphix Community regarding  a profiling job at data level that have remained hanged up. The job status was running while the monitor notified that no processing was occuring rather it was waiting after completing successfully only a little subset of tables. I have obtained delphix log and the most inherent chunk  seems to be the following:




2017-04-20 10:38:24,775 INFO  com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_73] Unexpected error occurred while launching entry [GEONORM_DTT_201010_GEO.0]
2017-04-20 10:38:24,775 INFO  com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_73] GC overhead limit exceeded
2017-04-20 10:38:24,775 INFO  com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_73]
2017-04-20 10:38:24,775 INFO  com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_73]
2017-04-20 10:38:24,775 INFO  com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_73]
2017-04-20 10:38:24,775 INFO  com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_73]  at org.pentaho.di.job.Job.execute(Job.java:733)
2017-04-20 10:38:24,775 INFO  com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_73]  at org.pentaho.di.job.Job.execute(Job.java:728)
2017-04-20 10:38:24,775 INFO  com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_73]  ... 13 more
2017-04-20 10:38:24,775 INFO  com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_73] Caused by: org.pentaho.di.core.exception.KettleException:


This is the hot piece "GC overhead limit exceeded"


Anyone can suggest possible solutions?

Thanks in advance

Luigi De Pietri

Photo of luigidep

luigidep

  • 622 Points 500 badge 2x thumb

Posted 2 years ago

  • 0
  • 1
Photo of Mouhssine SAIDI

Mouhssine SAIDI

  • 4,782 Points 4k badge 2x thumb
Hi,

Can you please specify :

version of engine you are using
did you specify the min and max values for jvm memory
total memory you have allowed to the engine

Regards,

Mouhssine
Photo of Tony Slack

Tony Slack, Employee

  • 110 Points 100 badge 2x thumb
This means you ran out of memory while running the job.  You need to increase the job memory (min/max) to a larger value to get the job to succeed.  I typically will iteratively double the memory until it succeeds.

By default the jobs run with 1 GB of memory.  i.e. the same as specifying 1024 in the min and max memory boxes.  So I would try 2048, 4096, 8192, ...  until I could get the job to succeed or I exceed the the memory on the box.  Also note, other running jobs can affect the amount of available memory.  So if you have 2 masking jobs at 2 GB each currently running and the box has 64 GB total, your profile job shouldn't exceed ~58 GB or everything will break down.  We have plans for a new feature called our guard rails feature to help prevent you from scheduling too much memory use at the same time.  It is not committed to any specific release at this time, but we do intend to make this easier.

Just a note, when doing data level profiling it can require much more memory than column level profiling so you are more likely to encounter this scenario.
(Edited)
Photo of luigidep

luigidep

  • 622 Points 500 badge 2x thumb

Hello

     Delphix VM

 is equipped with 256 GB of random access memory.

When i runned the job that was failed i specified 1 for "No. Of Streams"  and no value for either "MIN Memory" and "MAX Memory"

I have to profile some heavy schemas:

   1) one schema that occupies 1125,696961 Giga Byte and is composed of 2910  tables

          In this schema each table doesn't exceed 10 percent of total schema size

  2) one schema that occupies 991,77179 Giga Byte and is composed of 931 tables

          In this schema one table occupies 30,9 percent of total schema size,

         another table occupies 19,7 percent of total schema size

        and all other tables doesn't exceed 10 percent of total schema size.


As a general rule if i have 256 GB total random access memory available for Delphix VM

  how can i profile a table that exceeds in size the total random access memory available?


For example if i have to profile a table that occupies 307 GB i will try to set 4 for "No. Of Streams" and (1024 MB * 100) for either "MIN Memory" and "MAX Memory"

Luigi

Photo of Mouhssine SAIDI

Mouhssine SAIDI

  • 4,782 Points 4k badge 2x thumb
Hi Luigi,

You can try with this setting

N° of stream : 10
Min : 8192
Max : 8192

You can increase number of stream to profile more tables at the same time.

Regards,

Mouhssine
Photo of luigidep

luigidep

  • 622 Points 500 badge 2x thumb

Thank you for your reply.

I will follow your suggestion next time.

If the profiling job exceeds the java heap memory this may results in a swapping activity that consumes disk space and cause  an interruption of service.

Luigi

Photo of Mouhssine SAIDI

Mouhssine SAIDI

  • 4,782 Points 4k badge 2x thumb
Hi,

Okay, keep in sync.

Regards,

Mouhssine
Photo of luigidep

luigidep

  • 622 Points 500 badge 2x thumb

Hi,

   i have tried

N° of stream : 10
Min : 8192
Max : 8192

The total number of tables to process was 199

After some time the number of tables completed was 183

while 16 tables remained in queue and the job was running for a lot without stopping.

So i stopped it.

I don't know why that was happened also because the size of tables that stayed on queue did not differ a lot from that one processed successfully. Maybe delphix log can help me.


Luigi



Photo of Mouhssine SAIDI

Mouhssine SAIDI

  • 4,782 Points 4k badge 2x thumb
Hi,

would you indecate the number of lines in the 16 remaining tables and numbre/type of columnes you are profilig.

Regards,

Mouhssine
Photo of luigidep

luigidep

  • 622 Points 500 badge 2x thumb

As requested


TABLE_NAME                CNT
------------------ ----------
GEONORM_DTT_201206     331986

CREATE TABLE "GEONORM"."GEONORM_DTT_201208"
   ( "CODICEFISCALE" VARCHAR2(50),
 "PROV_RESIDENZA" VARCHAR2(2),
 "COMUNE_RESIDENZA" VARCHAR2(22),
 "CAP_RESIDENZA" VARCHAR2(5),
 "INDIRIZZO" VARCHAR2(34),
 "NUMERO_CIVICO" VARCHAR2(4000)
   ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS NOLOGGING
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
  TABLESPACE "USERS"


TABLE_NAME                CNT
------------------ ----------
GEONORM_DTT_201207     287564

CREATE TABLE "GEONORM"."GEONORM_DTT_201207"
   ( "CODICEFISCALE" VARCHAR2(50),
 "PROV_RESIDENZA" VARCHAR2(2),
 "COMUNE_RESIDENZA" VARCHAR2(22),
 "CAP_RESIDENZA" VARCHAR2(5),
 "INDIRIZZO" VARCHAR2(34),
 "NUMERO_CIVICO" VARCHAR2(4000)
   ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS NOLOGGING
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
  TABLESPACE "USERS"

TABLE_NAME                CNT
------------------ ----------
GEONORM_DTT_201208     194314

 CREATE TABLE "GEONORM"."GEONORM_DTT_201208"
   ( "CODICEFISCALE" VARCHAR2(50),
 "PROV_RESIDENZA" VARCHAR2(2),
 "COMUNE_RESIDENZA" VARCHAR2(22),
 "CAP_RESIDENZA" VARCHAR2(5),
 "INDIRIZZO" VARCHAR2(34),
 "NUMERO_CIVICO" VARCHAR2(4000)
   ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS NOLOGGING
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
  TABLESPACE "USERS"

TABLE_NAME                CNT
------------------ ----------
GEONORM_DTT_201209     783957

 CREATE TABLE "GEONORM"."GEONORM_DTT_201209"
   ( "CODICEFISCALE" VARCHAR2(50),
 "PROV_RESIDENZA" VARCHAR2(2),
 "COMUNE_RESIDENZA" VARCHAR2(22),
 "CAP_RESIDENZA" VARCHAR2(5),
 "INDIRIZZO" VARCHAR2(34),
 "NUMERO_CIVICO" VARCHAR2(4000)
   ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS NOLOGGING
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
  TABLESPACE "USERS"


TABLE_NAME               CNT
----------------- ----------
GEONORM_TA_201206     331986

  CREATE TABLE "GEONORM"."GEONORM_TA_201206"
   ( "CODICEFISCALE" VARCHAR2(50),
 "PROVINCIATA" VARCHAR2(255) NOT NULL ENABLE,
 "COMUNETA" VARCHAR2(255) NOT NULL ENABLE,
 "FRAZIONETA" VARCHAR2(255),
 "CAPTA" VARCHAR2(50) NOT NULL ENABLE,
 "INCIRIZZOTA" VARCHAR2(300),
 "NUMEROCIVICOTA" VARCHAR2(50)
   ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS NOLOGGING
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
  TABLESPACE "USERS"


TABLE_NAME               CNT
----------------- ----------
GEONORM_TA_201207     287564

  CREATE TABLE "GEONORM"."GEONORM_TA_201207"
   ( "CODICEFISCALE" VARCHAR2(50),
 "PROVINCIATA" VARCHAR2(255) NOT NULL ENABLE,
 "COMUNETA" VARCHAR2(255) NOT NULL ENABLE,
 "FRAZIONETA" VARCHAR2(255),
 "CAPTA" VARCHAR2(50) NOT NULL ENABLE,
 "INCIRIZZOTA" VARCHAR2(300),
 "NUMEROCIVICOTA" VARCHAR2(50)
   ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS NOLOGGING
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
  TABLESPACE "USERS"


TABLE_NAME               CNT
----------------- ----------
GEONORM_TA_201208     194314

  CREATE TABLE "GEONORM"."GEONORM_TA_201208"
   ( "CODICEFISCALE" VARCHAR2(50),
 "PROVINCIATA" VARCHAR2(255) NOT NULL ENABLE,
 "COMUNETA" VARCHAR2(255) NOT NULL ENABLE,
 "FRAZIONETA" VARCHAR2(255),
 "CAPTA" VARCHAR2(50) NOT NULL ENABLE,
 "INCIRIZZOTA" VARCHAR2(300),
 "NUMEROCIVICOTA" VARCHAR2(50)
   ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS NOLOGGING
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
  TABLESPACE "USERS"


TABLE_NAME               CNT
----------------- ----------
GEONORM_TA_201209     783957

CREATE TABLE "GEONORM"."GEONORM_TA_201209"
   ( "CODICEFISCALE" VARCHAR2(50),
 "PROVINCIATA" VARCHAR2(255) NOT NULL ENABLE,
 "COMUNETA" VARCHAR2(255) NOT NULL ENABLE,
 "FRAZIONETA" VARCHAR2(255),
 "CAPTA" VARCHAR2(50) NOT NULL ENABLE,
 "INCIRIZZOTA" VARCHAR2(300),
 "NUMEROCIVICOTA" VARCHAR2(50)
   ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS NOLOGGING
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
  TABLESPACE "USERS"
 
TABLE_NAME                    CNT
---------------------- ----------
GEONORM_DTT_201205_GEO     852425

  CREATE TABLE "GEONORM"."GEONORM_DTT_201205_GEO"
   ( "OBJECTID" VARCHAR2(20),
 "PGAX" BINARY_DOUBLE,
 "PGAY" BINARY_DOUBLE,
 "PGRX" BINARY_DOUBLE,
 "PGRY" BINARY_DOUBLE,
 "PUTX" BINARY_DOUBLE,
 "PUTY" BINARY_DOUBLE,
 "QUALITA" VARCHAR2(20),
 "PROV_RESIDENZA" VARCHAR2(2),
 "COMUNE_RESIDENZA" VARCHAR2(255),
 "INDIRIZZO" VARCHAR2(255),
 "NUMERO_CIVICO" VARCHAR2(255),
 "CDXMATCOD" VARCHAR2(255),
 "DSXCNY" VARCHAR2(255),
 "DSXREG" VARCHAR2(255),
 "DSXCNL" VARCHAR2(255),
 "DSXDS1" VARCHAR2(255),
 "DSXDUG" VARCHAR2(255),
 "DSXVIA" VARCHAR2(255),
 "NRPNUMCIV" VARCHAR2(20),
 "DSXESP" VARCHAR2(255),
 "CDXZIP" VARCHAR2(5),
 "CDXISTAT" VARCHAR2(11),
 "SGN_LOC" VARCHAR2(20),
 "SGN_STR" VARCHAR2(20),
 "SGN_MCZ" VARCHAR2(20),
 "CODICEFISCALE" VARCHAR2(50),
 "CAP_RESIDENZA" VARCHAR2(5)
   ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS LOGGING
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
  TABLESPACE "USERS"


TABLE_NAME                    CNT
---------------------- ----------
GEONORM_DTT_201207_GEO     287390

 CREATE TABLE "GEONORM"."GEONORM_DTT_201207_GEO"
   ( "FID" VARCHAR2(20),
 "PGAX" BINARY_DOUBLE,
 "PGAY" BINARY_DOUBLE,
 "PGRX" BINARY_DOUBLE,
 "PGRY" BINARY_DOUBLE,
 "PUTX" BINARY_DOUBLE,
 "PUTY" BINARY_DOUBLE,
 "QUALITA" VARCHAR2(20),
 "PROV_RESIDENZA" VARCHAR2(2),
 "COMUNE_RESIDENZA" VARCHAR2(255),
 "INDIRIZZO" VARCHAR2(255),
 "NUMERO_CIVICO" VARCHAR2(255),
 "CDXMATCOD" VARCHAR2(255),
 "DSXCNY" VARCHAR2(255),
 "DSXREG" VARCHAR2(255),
 "DSXCNL" VARCHAR2(255),
 "DSXDS1" VARCHAR2(255),
 "DSXDUG" VARCHAR2(255),
 "DSXVIA" VARCHAR2(255),
 "NRPNUMCIV" VARCHAR2(20),
 "DSXESP" VARCHAR2(255),
 "CDXZIP" VARCHAR2(5),
 "CDXISTAT" VARCHAR2(11),
 "SGN_LOC" VARCHAR2(20),
 "SGN_STR" VARCHAR2(20),
 "SGN_MCZ" VARCHAR2(20),
 "CODICEFISCALE" VARCHAR2(50),
 "CAP_RESIDENZA" VARCHAR2(5)
   ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS LOGGING
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
  TABLESPACE "USERS"
 

TABLE_NAME                    CNT
---------------------- ----------
GEONORM_DTT_201208_GEO     192767

 CREATE TABLE "GEONORM"."GEONORM_DTT_201208_GEO"
   ( "FID" VARCHAR2(20),
 "PGAX" BINARY_DOUBLE,
 "PGAY" BINARY_DOUBLE,
 "PGRX" BINARY_DOUBLE,
 "PGRY" BINARY_DOUBLE,
 "PUTX" BINARY_DOUBLE,
 "PUTY" BINARY_DOUBLE,
 "QUALITA" VARCHAR2(20),
 "PROV_RESIDENZA" VARCHAR2(2),
 "COMUNE_RESIDENZA" VARCHAR2(255),
 "INDIRIZZO" VARCHAR2(255),
 "NUMERO_CIVICO" VARCHAR2(255),
 "DSXCNY" VARCHAR2(255),
 "DSXREG" VARCHAR2(255),
 "DSXCNL" VARCHAR2(255),
 "DSXDS1" VARCHAR2(255),
 "DSXDUG" VARCHAR2(255),
 "DSXVIA" VARCHAR2(255),
 "NRPNUMCIV" VARCHAR2(20),
 "DSXESP" VARCHAR2(255),
 "CDXZIP" VARCHAR2(5),
 "CDXISTAT" VARCHAR2(11),
 "SGN_LOC" VARCHAR2(20),
 "SGN_STR" VARCHAR2(20),
 "SGN_MCZ" VARCHAR2(20),
 "CODICEFISCALE" VARCHAR2(50),
 "CAP_RESIDENZA" VARCHAR2(5)
   ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS LOGGING
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
  TABLESPACE "USERS"


TABLE_NAME                    CNT
---------------------- ----------
GEONORM_DTT_201209_GEO     777893

  CREATE TABLE "GEONORM"."GEONORM_DTT_201209_GEO"
   ( "OBJECTID" VARCHAR2(20),
 "PGAX" BINARY_DOUBLE,
 "PGAY" BINARY_DOUBLE,
 "PGRX" BINARY_DOUBLE,
 "PGRY" BINARY_DOUBLE,
 "PUTX" BINARY_DOUBLE,
 "PUTY" BINARY_DOUBLE,
 "QUALITA" VARCHAR2(20),
 "PROV_RESIDENZA" VARCHAR2(2),
 "COMUNE_RESIDENZA" VARCHAR2(255),
 "INDIRIZZO" VARCHAR2(255),
 "NUMERO_CIVICO" VARCHAR2(255),
 "CDXMATCOD" VARCHAR2(255),
 "DSXCNY" VARCHAR2(255),
 "DSXREG" VARCHAR2(255),
 "DSXCNL" VARCHAR2(255),
 "DSXDS1" VARCHAR2(255),
 "DSXDUG" VARCHAR2(255),
 "DSXVIA" VARCHAR2(255),
 "NRPNUMCIV" VARCHAR2(20),
 "DSXESP" VARCHAR2(255),
 "CDXZIP" VARCHAR2(5),
 "CDXISTAT" VARCHAR2(11),
 "SGN_LOC" VARCHAR2(20),
 "SGN_STR" VARCHAR2(20),
 "SGN_MCZ" VARCHAR2(20),
 "CODICEFISCALE" VARCHAR2(50),
 "CAP_RESIDENZA" VARCHAR2(5)
   ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS LOGGING
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
  TABLESPACE "USERS"


TABLE_NAME                   CNT
--------------------- ----------
GEONORM_TA_201205_GEO     852037

  CREATE TABLE "GEONORM"."GEONORM_TA_201205_GEO"
   ( "OBJECTID" VARCHAR2(20),
 "PGAX" BINARY_DOUBLE,
 "PGAY" BINARY_DOUBLE,
 "PGRX" BINARY_DOUBLE,
 "PGRY" BINARY_DOUBLE,
 "PUTX" BINARY_DOUBLE,
 "PUTY" BINARY_DOUBLE,
 "QUALITA" VARCHAR2(20),
 "PROVINCIATA" VARCHAR2(2),
 "COMUNETA" VARCHAR2(255),
 "INCIRIZZOTA" VARCHAR2(255),
 "NUMEROCIVICOTA" VARCHAR2(255),
 "CDXMATCOD" VARCHAR2(255),
 "DSXCNY" VARCHAR2(255),
 "DSXREG" VARCHAR2(255),
 "DSXCNL" VARCHAR2(255),
 "DSXDS1" VARCHAR2(255),
 "DSXDUG" VARCHAR2(255),
 "DSXVIA" VARCHAR2(255),
 "NRPNUMCIV" VARCHAR2(20),
 "DSXESP" VARCHAR2(255),
 "CDXZIP" VARCHAR2(5),
 "CDXISTAT" VARCHAR2(11),
 "SGN_LOC" VARCHAR2(20),
 "SGN_STR" VARCHAR2(20),
 "SGN_MCZ" VARCHAR2(20),
 "CODICEFISCALE" VARCHAR2(50),
 "FRAZIONETA" VARCHAR2(255),
 "CAPTA" VARCHAR2(50)
   ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS LOGGING
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
  TABLESPACE "USERS"


TABLE_NAME                   CNT
--------------------- ----------
GEONORM_TA_201207_GEO     287293

  CREATE TABLE "GEONORM"."GEONORM_TA_201207_GEO"
   ( "FID" VARCHAR2(20),
 "PGAX" BINARY_DOUBLE,
 "PGAY" BINARY_DOUBLE,
 "PGRX" BINARY_DOUBLE,
 "PGRY" BINARY_DOUBLE,
 "PUTX" BINARY_DOUBLE,
 "PUTY" BINARY_DOUBLE,
 "QUALITA" VARCHAR2(20),
 "PROVINCIATA" VARCHAR2(2),
 "COMUNETA" VARCHAR2(255),
 "INCIRIZZOTA" VARCHAR2(255),
 "NUMEROCIVICOTA" VARCHAR2(255),
 "CDXMATCOD" VARCHAR2(255),
 "DSXCNY" VARCHAR2(255),
 "DSXREG" VARCHAR2(255),
 "DSXCNL" VARCHAR2(255),
 "DSXDS1" VARCHAR2(255),
 "DSXDUG" VARCHAR2(255),
 "DSXVIA" VARCHAR2(255),
 "NRPNUMCIV" VARCHAR2(20),
 "DSXESP" VARCHAR2(255),
 "CDXZIP" VARCHAR2(5),
 "CDXISTAT" VARCHAR2(11),
 "SGN_LOC" VARCHAR2(20),
 "SGN_STR" VARCHAR2(20),
 "SGN_MCZ" VARCHAR2(20),
 "CODICEFISCALE" VARCHAR2(50),
 "FRAZIONETA" VARCHAR2(255),
 "CAPTA" VARCHAR2(50)
   ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS LOGGING
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
  TABLESPACE "USERS"


TABLE_NAME                   CNT
--------------------- ----------
GEONORM_TA_201208_GEO     192416

 CREATE TABLE "GEONORM"."GEONORM_TA_201208_GEO"
   ( "FID" VARCHAR2(20),
 "PGAX" BINARY_DOUBLE,
 "PGAY" BINARY_DOUBLE,
 "PGRX" BINARY_DOUBLE,
 "PGRY" BINARY_DOUBLE,
 "PUTX" BINARY_DOUBLE,
 "PUTY" BINARY_DOUBLE,
 "QUALITA" VARCHAR2(20),
 "PROVINCIATA" VARCHAR2(2),
 "COMUNETA" VARCHAR2(255),
 "INCIRIZZOTA" VARCHAR2(255),
 "NUMEROCIVICOTA" VARCHAR2(255),
 "DSXCNY" VARCHAR2(255),
 "DSXREG" VARCHAR2(255),
 "DSXCNL" VARCHAR2(255),
 "DSXDS1" VARCHAR2(255),
 "DSXDUG" VARCHAR2(255),
 "DSXVIA" VARCHAR2(255),
 "NRPNUMCIV" VARCHAR2(20),
 "DSXESP" VARCHAR2(255),
 "CDXZIP" VARCHAR2(5),
 "CDXISTAT" VARCHAR2(11),
 "SGN_LOC" VARCHAR2(20),
 "SGN_STR" VARCHAR2(20),
 "SGN_MCZ" VARCHAR2(20),
 "CODICEFISCALE" VARCHAR2(50),
 "FRAZIONETA" VARCHAR2(255),
 "CAPTA" VARCHAR2(50)
   ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS LOGGING
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
  TABLESPACE "USERS"
 

TABLE_NAME                   CNT
--------------------- ----------
GEONORM_TA_201209_GEO     776655

  CREATE TABLE "GEONORM"."GEONORM_TA_201209_GEO"
   ( "OBJECTID" VARCHAR2(20),
 "PGAX" BINARY_DOUBLE,
 "PGAY" BINARY_DOUBLE,
 "PGRX" BINARY_DOUBLE,
 "PGRY" BINARY_DOUBLE,
 "PUTX" BINARY_DOUBLE,
 "PUTY" BINARY_DOUBLE,
 "QUALITA" VARCHAR2(20),
 "PROVINCIATA" VARCHAR2(2),
 "COMUNETA" VARCHAR2(255),
 "INCIRIZZOTA" VARCHAR2(255),
 "NUMEROCIVICOTA" VARCHAR2(255),
 "CDXMATCOD" VARCHAR2(255),
 "DSXCNY" VARCHAR2(255),
 "DSXREG" VARCHAR2(255),
 "DSXCNL" VARCHAR2(255),
 "DSXDS1" VARCHAR2(255),
 "DSXDUG" VARCHAR2(255),
 "DSXVIA" VARCHAR2(255),
 "NRPNUMCIV" VARCHAR2(20),
 "DSXESP" VARCHAR2(255),
 "CDXZIP" VARCHAR2(5),
 "CDXISTAT" VARCHAR2(11),
 "SGN_LOC" VARCHAR2(20),
 "SGN_STR" VARCHAR2(20),
 "SGN_MCZ" VARCHAR2(20),
 "CODICEFISCALE" VARCHAR2(50),
 "FRAZIONETA" VARCHAR2(255),
 "CAPTA" VARCHAR2(50)
   ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS LOGGING
  STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
  PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
  TABLESPACE "USERS"

Photo of Mouhssine SAIDI

Mouhssine SAIDI

  • 4,782 Points 4k badge 2x thumb
Hi,

May be there was a miss.

Please confirm numbre and type of columnes you need to profile in your job.

Regards,

Mouhssine
Photo of luigidep

luigidep

  • 622 Points 500 badge 2x thumb

Hello,

    I confirm the number and type of columns.

Regards,

Luigi

Photo of Mouhssine SAIDI

Mouhssine SAIDI

  • 4,782 Points 4k badge 2x thumb
Hi,

Cloud you please create a separate job with only those 16 tables, with the following configuration just to give it a check why it stucks.

Streams : 16
Min         : 12288
Max        : 12288

Regards,

Mouhssine
Photo of luigidep

luigidep

  • 622 Points 500 badge 2x thumb

Hi,

    It seems that also

Streams : 16
Min         : 12288
Max        : 12288

is not able to complete the profiling task successful

Total tables are 199 and 12 still remain in processing status.

Luigi