Delphix Products

Expand all | Collapse all

Error on profiling job data level concrete case

Mouhssine Saidi

Mouhssine Saidi04-27-2017 02:41:00 PM

  • 1.  Error on profiling job data level concrete case

    Posted 04-20-2017 03:03:00 PM

    I have open some threads on Delphix Community regarding  a profiling job at data level that have remained hanged up. The job status was running while the monitor notified that no processing was occuring rather it was waiting after completing successfully only a little subset of tables. I have obtained delphix log and the most inherent chunk  seems to be the following:




    2017-04-20 10:38:24,775 INFO  com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_73] Unexpected error occurred while launching entry [GEONORM_DTT_201010_GEO.0]
    2017-04-20 10:38:24,775 INFO  com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_73] GC overhead limit exceeded
    2017-04-20 10:38:24,775 INFO  com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_73]
    2017-04-20 10:38:24,775 INFO  com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_73]
    2017-04-20 10:38:24,775 INFO  com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_73]
    2017-04-20 10:38:24,775 INFO  com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_73]  at org.pentaho.di.job.Job.execute(Job.java:733)
    2017-04-20 10:38:24,775 INFO  com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_73]  at org.pentaho.di.job.Job.execute(Job.java:728)
    2017-04-20 10:38:24,775 INFO  com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_73]  ... 13 more
    2017-04-20 10:38:24,775 INFO  com.dmsuite.dmsApplicator.profiling.ProfilingRunServiceImpl - [JOB_ID_73] Caused by: org.pentaho.di.core.exception.KettleException:


    This is the hot piece "GC overhead limit exceeded"


    Anyone can suggest possible solutions?

    Thanks in advance

    Luigi De Pietri



  • 2.  RE: Error on profiling job data level concrete case

    Posted 04-20-2017 03:17:00 PM
    Hi, Can you please specify : version of engine you are using did you specify the min and max values for jvm memory total memory you have allowed to the engine Regards, Mouhssine


  • 3.  RE: Error on profiling job data level concrete case

    Posted 04-20-2017 04:30:00 PM
    This means you ran out of memory while running the job.  You need to increase the job memory (min/max) to a larger value to get the job to succeed.  I typically will iteratively double the memory until it succeeds.

    By default the jobs run with 1 GB of memory.  i.e. the same as specifying 1024 in the min and max memory boxes.  So I would try 2048, 4096, 8192, ...  until I could get the job to succeed or I exceed the the memory on the box.  Also note, other running jobs can affect the amount of available memory.  So if you have 2 masking jobs at 2 GB each currently running and the box has 64 GB total, your profile job shouldn't exceed ~58 GB or everything will break down.  We have plans for a new feature called our guard rails feature to help prevent you from scheduling too much memory use at the same time.  It is not committed to any specific release at this time, but we do intend to make this easier.

    Just a note, when doing data level profiling it can require much more memory than column level profiling so you are more likely to encounter this scenario.


  • 4.  RE: Error on profiling job data level concrete case

    Posted 04-26-2017 01:05:00 PM

    Hello

         Delphix VM

     is equipped with 256 GB of random access memory.

    When i runned the job that was failed i specified 1 for "No. Of Streams"  and no value for either "MIN Memory" and "MAX Memory"

    I have to profile some heavy schemas:

       1) one schema that occupies 1125,696961 Giga Byte and is composed of 2910  tables

              In this schema each table doesn't exceed 10 percent of total schema size

      2) one schema that occupies 991,77179 Giga Byte and is composed of 931 tables

              In this schema one table occupies 30,9 percent of total schema size,

             another table occupies 19,7 percent of total schema size

            and all other tables doesn't exceed 10 percent of total schema size.


    As a general rule if i have 256 GB total random access memory available for Delphix VM

      how can i profile a table that exceeds in size the total random access memory available?


    For example if i have to profile a table that occupies 307 GB i will try to set 4 for "No. Of Streams" and (1024 MB * 100) for either "MIN Memory" and "MAX Memory"

    Luigi



  • 5.  RE: Error on profiling job data level concrete case

    Posted 04-26-2017 01:13:00 PM
    Hi Luigi,

    You can try with this setting

    N° of stream : 10
    Min : 8192
    Max : 8192

    You can increase number of stream to profile more tables at the same time.

    Regards,

    Mouhssine


  • 6.  RE: Error on profiling job data level concrete case

    Posted 04-27-2017 07:47:00 AM

    Thank you for your reply.

    I will follow your suggestion next time.

    If the profiling job exceeds the java heap memory this may results in a swapping activity that consumes disk space and cause  an interruption of service.

    Luigi



  • 7.  RE: Error on profiling job data level concrete case

    Posted 04-27-2017 02:41:00 PM
    Hi,

    Okay, keep in sync.

    Regards,

    Mouhssine


  • 8.  RE: Error on profiling job data level concrete case

    Posted 04-27-2017 03:13:00 PM

    Hi,

       i have tried

    N° of stream : 10
    Min : 8192
    Max : 8192

    The total number of tables to process was 199

    After some time the number of tables completed was 183

    while 16 tables remained in queue and the job was running for a lot without stopping.

    So i stopped it.

    I don't know why that was happened also because the size of tables that stayed on queue did not differ a lot from that one processed successfully. Maybe delphix log can help me.


    Luigi





  • 9.  RE: Error on profiling job data level concrete case

    Posted 04-27-2017 04:01:00 PM
    Hi,

    would you indecate the number of lines in the 16 remaining tables and numbre/type of columnes you are profilig.

    Regards,

    Mouhssine


  • 10.  RE: Error on profiling job data level concrete case

    Posted 04-28-2017 08:22:00 AM

    As requested


    TABLE_NAME                CNT
    ------------------ ----------
    GEONORM_DTT_201206     331986

    CREATE TABLE "GEONORM"."GEONORM_DTT_201208"
       ( "CODICEFISCALE" VARCHAR2(50),
     "PROV_RESIDENZA" VARCHAR2(2),
     "COMUNE_RESIDENZA" VARCHAR2(22),
     "CAP_RESIDENZA" VARCHAR2(5),
     "INDIRIZZO" VARCHAR2(34),
     "NUMERO_CIVICO" VARCHAR2(4000)
       ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS NOLOGGING
      STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
      PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
      TABLESPACE "USERS"


    TABLE_NAME                CNT
    ------------------ ----------
    GEONORM_DTT_201207     287564

    CREATE TABLE "GEONORM"."GEONORM_DTT_201207"
       ( "CODICEFISCALE" VARCHAR2(50),
     "PROV_RESIDENZA" VARCHAR2(2),
     "COMUNE_RESIDENZA" VARCHAR2(22),
     "CAP_RESIDENZA" VARCHAR2(5),
     "INDIRIZZO" VARCHAR2(34),
     "NUMERO_CIVICO" VARCHAR2(4000)
       ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS NOLOGGING
      STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
      PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
      TABLESPACE "USERS"

    TABLE_NAME                CNT
    ------------------ ----------
    GEONORM_DTT_201208     194314

     CREATE TABLE "GEONORM"."GEONORM_DTT_201208"
       ( "CODICEFISCALE" VARCHAR2(50),
     "PROV_RESIDENZA" VARCHAR2(2),
     "COMUNE_RESIDENZA" VARCHAR2(22),
     "CAP_RESIDENZA" VARCHAR2(5),
     "INDIRIZZO" VARCHAR2(34),
     "NUMERO_CIVICO" VARCHAR2(4000)
       ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS NOLOGGING
      STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
      PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
      TABLESPACE "USERS"

    TABLE_NAME                CNT
    ------------------ ----------
    GEONORM_DTT_201209     783957

     CREATE TABLE "GEONORM"."GEONORM_DTT_201209"
       ( "CODICEFISCALE" VARCHAR2(50),
     "PROV_RESIDENZA" VARCHAR2(2),
     "COMUNE_RESIDENZA" VARCHAR2(22),
     "CAP_RESIDENZA" VARCHAR2(5),
     "INDIRIZZO" VARCHAR2(34),
     "NUMERO_CIVICO" VARCHAR2(4000)
       ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS NOLOGGING
      STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
      PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
      TABLESPACE "USERS"


    TABLE_NAME               CNT
    ----------------- ----------
    GEONORM_TA_201206     331986

      CREATE TABLE "GEONORM"."GEONORM_TA_201206"
       ( "CODICEFISCALE" VARCHAR2(50),
     "PROVINCIATA" VARCHAR2(255) NOT NULL ENABLE,
     "COMUNETA" VARCHAR2(255) NOT NULL ENABLE,
     "FRAZIONETA" VARCHAR2(255),
     "CAPTA" VARCHAR2(50) NOT NULL ENABLE,
     "INCIRIZZOTA" VARCHAR2(300),
     "NUMEROCIVICOTA" VARCHAR2(50)
       ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS NOLOGGING
      STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
      PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
      TABLESPACE "USERS"


    TABLE_NAME               CNT
    ----------------- ----------
    GEONORM_TA_201207     287564

      CREATE TABLE "GEONORM"."GEONORM_TA_201207"
       ( "CODICEFISCALE" VARCHAR2(50),
     "PROVINCIATA" VARCHAR2(255) NOT NULL ENABLE,
     "COMUNETA" VARCHAR2(255) NOT NULL ENABLE,
     "FRAZIONETA" VARCHAR2(255),
     "CAPTA" VARCHAR2(50) NOT NULL ENABLE,
     "INCIRIZZOTA" VARCHAR2(300),
     "NUMEROCIVICOTA" VARCHAR2(50)
       ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS NOLOGGING
      STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
      PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
      TABLESPACE "USERS"


    TABLE_NAME               CNT
    ----------------- ----------
    GEONORM_TA_201208     194314

      CREATE TABLE "GEONORM"."GEONORM_TA_201208"
       ( "CODICEFISCALE" VARCHAR2(50),
     "PROVINCIATA" VARCHAR2(255) NOT NULL ENABLE,
     "COMUNETA" VARCHAR2(255) NOT NULL ENABLE,
     "FRAZIONETA" VARCHAR2(255),
     "CAPTA" VARCHAR2(50) NOT NULL ENABLE,
     "INCIRIZZOTA" VARCHAR2(300),
     "NUMEROCIVICOTA" VARCHAR2(50)
       ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS NOLOGGING
      STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
      PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
      TABLESPACE "USERS"


    TABLE_NAME               CNT
    ----------------- ----------
    GEONORM_TA_201209     783957

    CREATE TABLE "GEONORM"."GEONORM_TA_201209"
       ( "CODICEFISCALE" VARCHAR2(50),
     "PROVINCIATA" VARCHAR2(255) NOT NULL ENABLE,
     "COMUNETA" VARCHAR2(255) NOT NULL ENABLE,
     "FRAZIONETA" VARCHAR2(255),
     "CAPTA" VARCHAR2(50) NOT NULL ENABLE,
     "INCIRIZZOTA" VARCHAR2(300),
     "NUMEROCIVICOTA" VARCHAR2(50)
       ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS NOLOGGING
      STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
      PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
      TABLESPACE "USERS"
     
    TABLE_NAME                    CNT
    ---------------------- ----------
    GEONORM_DTT_201205_GEO     852425

      CREATE TABLE "GEONORM"."GEONORM_DTT_201205_GEO"
       ( "OBJECTID" VARCHAR2(20),
     "PGAX" BINARY_DOUBLE,
     "PGAY" BINARY_DOUBLE,
     "PGRX" BINARY_DOUBLE,
     "PGRY" BINARY_DOUBLE,
     "PUTX" BINARY_DOUBLE,
     "PUTY" BINARY_DOUBLE,
     "QUALITA" VARCHAR2(20),
     "PROV_RESIDENZA" VARCHAR2(2),
     "COMUNE_RESIDENZA" VARCHAR2(255),
     "INDIRIZZO" VARCHAR2(255),
     "NUMERO_CIVICO" VARCHAR2(255),
     "CDXMATCOD" VARCHAR2(255),
     "DSXCNY" VARCHAR2(255),
     "DSXREG" VARCHAR2(255),
     "DSXCNL" VARCHAR2(255),
     "DSXDS1" VARCHAR2(255),
     "DSXDUG" VARCHAR2(255),
     "DSXVIA" VARCHAR2(255),
     "NRPNUMCIV" VARCHAR2(20),
     "DSXESP" VARCHAR2(255),
     "CDXZIP" VARCHAR2(5),
     "CDXISTAT" VARCHAR2(11),
     "SGN_LOC" VARCHAR2(20),
     "SGN_STR" VARCHAR2(20),
     "SGN_MCZ" VARCHAR2(20),
     "CODICEFISCALE" VARCHAR2(50),
     "CAP_RESIDENZA" VARCHAR2(5)
       ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS LOGGING
      STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
      PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
      TABLESPACE "USERS"


    TABLE_NAME                    CNT
    ---------------------- ----------
    GEONORM_DTT_201207_GEO     287390

     CREATE TABLE "GEONORM"."GEONORM_DTT_201207_GEO"
       ( "FID" VARCHAR2(20),
     "PGAX" BINARY_DOUBLE,
     "PGAY" BINARY_DOUBLE,
     "PGRX" BINARY_DOUBLE,
     "PGRY" BINARY_DOUBLE,
     "PUTX" BINARY_DOUBLE,
     "PUTY" BINARY_DOUBLE,
     "QUALITA" VARCHAR2(20),
     "PROV_RESIDENZA" VARCHAR2(2),
     "COMUNE_RESIDENZA" VARCHAR2(255),
     "INDIRIZZO" VARCHAR2(255),
     "NUMERO_CIVICO" VARCHAR2(255),
     "CDXMATCOD" VARCHAR2(255),
     "DSXCNY" VARCHAR2(255),
     "DSXREG" VARCHAR2(255),
     "DSXCNL" VARCHAR2(255),
     "DSXDS1" VARCHAR2(255),
     "DSXDUG" VARCHAR2(255),
     "DSXVIA" VARCHAR2(255),
     "NRPNUMCIV" VARCHAR2(20),
     "DSXESP" VARCHAR2(255),
     "CDXZIP" VARCHAR2(5),
     "CDXISTAT" VARCHAR2(11),
     "SGN_LOC" VARCHAR2(20),
     "SGN_STR" VARCHAR2(20),
     "SGN_MCZ" VARCHAR2(20),
     "CODICEFISCALE" VARCHAR2(50),
     "CAP_RESIDENZA" VARCHAR2(5)
       ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS LOGGING
      STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
      PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
      TABLESPACE "USERS"
     

    TABLE_NAME                    CNT
    ---------------------- ----------
    GEONORM_DTT_201208_GEO     192767

     CREATE TABLE "GEONORM"."GEONORM_DTT_201208_GEO"
       ( "FID" VARCHAR2(20),
     "PGAX" BINARY_DOUBLE,
     "PGAY" BINARY_DOUBLE,
     "PGRX" BINARY_DOUBLE,
     "PGRY" BINARY_DOUBLE,
     "PUTX" BINARY_DOUBLE,
     "PUTY" BINARY_DOUBLE,
     "QUALITA" VARCHAR2(20),
     "PROV_RESIDENZA" VARCHAR2(2),
     "COMUNE_RESIDENZA" VARCHAR2(255),
     "INDIRIZZO" VARCHAR2(255),
     "NUMERO_CIVICO" VARCHAR2(255),
     "DSXCNY" VARCHAR2(255),
     "DSXREG" VARCHAR2(255),
     "DSXCNL" VARCHAR2(255),
     "DSXDS1" VARCHAR2(255),
     "DSXDUG" VARCHAR2(255),
     "DSXVIA" VARCHAR2(255),
     "NRPNUMCIV" VARCHAR2(20),
     "DSXESP" VARCHAR2(255),
     "CDXZIP" VARCHAR2(5),
     "CDXISTAT" VARCHAR2(11),
     "SGN_LOC" VARCHAR2(20),
     "SGN_STR" VARCHAR2(20),
     "SGN_MCZ" VARCHAR2(20),
     "CODICEFISCALE" VARCHAR2(50),
     "CAP_RESIDENZA" VARCHAR2(5)
       ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS LOGGING
      STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
      PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
      TABLESPACE "USERS"


    TABLE_NAME                    CNT
    ---------------------- ----------
    GEONORM_DTT_201209_GEO     777893

      CREATE TABLE "GEONORM"."GEONORM_DTT_201209_GEO"
       ( "OBJECTID" VARCHAR2(20),
     "PGAX" BINARY_DOUBLE,
     "PGAY" BINARY_DOUBLE,
     "PGRX" BINARY_DOUBLE,
     "PGRY" BINARY_DOUBLE,
     "PUTX" BINARY_DOUBLE,
     "PUTY" BINARY_DOUBLE,
     "QUALITA" VARCHAR2(20),
     "PROV_RESIDENZA" VARCHAR2(2),
     "COMUNE_RESIDENZA" VARCHAR2(255),
     "INDIRIZZO" VARCHAR2(255),
     "NUMERO_CIVICO" VARCHAR2(255),
     "CDXMATCOD" VARCHAR2(255),
     "DSXCNY" VARCHAR2(255),
     "DSXREG" VARCHAR2(255),
     "DSXCNL" VARCHAR2(255),
     "DSXDS1" VARCHAR2(255),
     "DSXDUG" VARCHAR2(255),
     "DSXVIA" VARCHAR2(255),
     "NRPNUMCIV" VARCHAR2(20),
     "DSXESP" VARCHAR2(255),
     "CDXZIP" VARCHAR2(5),
     "CDXISTAT" VARCHAR2(11),
     "SGN_LOC" VARCHAR2(20),
     "SGN_STR" VARCHAR2(20),
     "SGN_MCZ" VARCHAR2(20),
     "CODICEFISCALE" VARCHAR2(50),
     "CAP_RESIDENZA" VARCHAR2(5)
       ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS LOGGING
      STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
      PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
      TABLESPACE "USERS"


    TABLE_NAME                   CNT
    --------------------- ----------
    GEONORM_TA_201205_GEO     852037

      CREATE TABLE "GEONORM"."GEONORM_TA_201205_GEO"
       ( "OBJECTID" VARCHAR2(20),
     "PGAX" BINARY_DOUBLE,
     "PGAY" BINARY_DOUBLE,
     "PGRX" BINARY_DOUBLE,
     "PGRY" BINARY_DOUBLE,
     "PUTX" BINARY_DOUBLE,
     "PUTY" BINARY_DOUBLE,
     "QUALITA" VARCHAR2(20),
     "PROVINCIATA" VARCHAR2(2),
     "COMUNETA" VARCHAR2(255),
     "INCIRIZZOTA" VARCHAR2(255),
     "NUMEROCIVICOTA" VARCHAR2(255),
     "CDXMATCOD" VARCHAR2(255),
     "DSXCNY" VARCHAR2(255),
     "DSXREG" VARCHAR2(255),
     "DSXCNL" VARCHAR2(255),
     "DSXDS1" VARCHAR2(255),
     "DSXDUG" VARCHAR2(255),
     "DSXVIA" VARCHAR2(255),
     "NRPNUMCIV" VARCHAR2(20),
     "DSXESP" VARCHAR2(255),
     "CDXZIP" VARCHAR2(5),
     "CDXISTAT" VARCHAR2(11),
     "SGN_LOC" VARCHAR2(20),
     "SGN_STR" VARCHAR2(20),
     "SGN_MCZ" VARCHAR2(20),
     "CODICEFISCALE" VARCHAR2(50),
     "FRAZIONETA" VARCHAR2(255),
     "CAPTA" VARCHAR2(50)
       ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS LOGGING
      STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
      PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
      TABLESPACE "USERS"


    TABLE_NAME                   CNT
    --------------------- ----------
    GEONORM_TA_201207_GEO     287293

      CREATE TABLE "GEONORM"."GEONORM_TA_201207_GEO"
       ( "FID" VARCHAR2(20),
     "PGAX" BINARY_DOUBLE,
     "PGAY" BINARY_DOUBLE,
     "PGRX" BINARY_DOUBLE,
     "PGRY" BINARY_DOUBLE,
     "PUTX" BINARY_DOUBLE,
     "PUTY" BINARY_DOUBLE,
     "QUALITA" VARCHAR2(20),
     "PROVINCIATA" VARCHAR2(2),
     "COMUNETA" VARCHAR2(255),
     "INCIRIZZOTA" VARCHAR2(255),
     "NUMEROCIVICOTA" VARCHAR2(255),
     "CDXMATCOD" VARCHAR2(255),
     "DSXCNY" VARCHAR2(255),
     "DSXREG" VARCHAR2(255),
     "DSXCNL" VARCHAR2(255),
     "DSXDS1" VARCHAR2(255),
     "DSXDUG" VARCHAR2(255),
     "DSXVIA" VARCHAR2(255),
     "NRPNUMCIV" VARCHAR2(20),
     "DSXESP" VARCHAR2(255),
     "CDXZIP" VARCHAR2(5),
     "CDXISTAT" VARCHAR2(11),
     "SGN_LOC" VARCHAR2(20),
     "SGN_STR" VARCHAR2(20),
     "SGN_MCZ" VARCHAR2(20),
     "CODICEFISCALE" VARCHAR2(50),
     "FRAZIONETA" VARCHAR2(255),
     "CAPTA" VARCHAR2(50)
       ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS LOGGING
      STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
      PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
      TABLESPACE "USERS"


    TABLE_NAME                   CNT
    --------------------- ----------
    GEONORM_TA_201208_GEO     192416

     CREATE TABLE "GEONORM"."GEONORM_TA_201208_GEO"
       ( "FID" VARCHAR2(20),
     "PGAX" BINARY_DOUBLE,
     "PGAY" BINARY_DOUBLE,
     "PGRX" BINARY_DOUBLE,
     "PGRY" BINARY_DOUBLE,
     "PUTX" BINARY_DOUBLE,
     "PUTY" BINARY_DOUBLE,
     "QUALITA" VARCHAR2(20),
     "PROVINCIATA" VARCHAR2(2),
     "COMUNETA" VARCHAR2(255),
     "INCIRIZZOTA" VARCHAR2(255),
     "NUMEROCIVICOTA" VARCHAR2(255),
     "DSXCNY" VARCHAR2(255),
     "DSXREG" VARCHAR2(255),
     "DSXCNL" VARCHAR2(255),
     "DSXDS1" VARCHAR2(255),
     "DSXDUG" VARCHAR2(255),
     "DSXVIA" VARCHAR2(255),
     "NRPNUMCIV" VARCHAR2(20),
     "DSXESP" VARCHAR2(255),
     "CDXZIP" VARCHAR2(5),
     "CDXISTAT" VARCHAR2(11),
     "SGN_LOC" VARCHAR2(20),
     "SGN_STR" VARCHAR2(20),
     "SGN_MCZ" VARCHAR2(20),
     "CODICEFISCALE" VARCHAR2(50),
     "FRAZIONETA" VARCHAR2(255),
     "CAPTA" VARCHAR2(50)
       ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS LOGGING
      STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
      PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
      TABLESPACE "USERS"
     

    TABLE_NAME                   CNT
    --------------------- ----------
    GEONORM_TA_201209_GEO     776655

      CREATE TABLE "GEONORM"."GEONORM_TA_201209_GEO"
       ( "OBJECTID" VARCHAR2(20),
     "PGAX" BINARY_DOUBLE,
     "PGAY" BINARY_DOUBLE,
     "PGRX" BINARY_DOUBLE,
     "PGRY" BINARY_DOUBLE,
     "PUTX" BINARY_DOUBLE,
     "PUTY" BINARY_DOUBLE,
     "QUALITA" VARCHAR2(20),
     "PROVINCIATA" VARCHAR2(2),
     "COMUNETA" VARCHAR2(255),
     "INCIRIZZOTA" VARCHAR2(255),
     "NUMEROCIVICOTA" VARCHAR2(255),
     "CDXMATCOD" VARCHAR2(255),
     "DSXCNY" VARCHAR2(255),
     "DSXREG" VARCHAR2(255),
     "DSXCNL" VARCHAR2(255),
     "DSXDS1" VARCHAR2(255),
     "DSXDUG" VARCHAR2(255),
     "DSXVIA" VARCHAR2(255),
     "NRPNUMCIV" VARCHAR2(20),
     "DSXESP" VARCHAR2(255),
     "CDXZIP" VARCHAR2(5),
     "CDXISTAT" VARCHAR2(11),
     "SGN_LOC" VARCHAR2(20),
     "SGN_STR" VARCHAR2(20),
     "SGN_MCZ" VARCHAR2(20),
     "CODICEFISCALE" VARCHAR2(50),
     "FRAZIONETA" VARCHAR2(255),
     "CAPTA" VARCHAR2(50)
       ) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 NOCOMPRESS LOGGING
      STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645
      PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT)
      TABLESPACE "USERS"



  • 11.  RE: Error on profiling job data level concrete case

    Posted 04-28-2017 08:31:00 AM
    Hi,

    May be there was a miss.

    Please confirm numbre and type of columnes you need to profile in your job.

    Regards,

    Mouhssine


  • 12.  RE: Error on profiling job data level concrete case

    Posted 04-28-2017 09:40:00 AM

    Hello,

        I confirm the number and type of columns.

    Regards,

    Luigi



  • 13.  RE: Error on profiling job data level concrete case

    Posted 04-28-2017 10:55:00 AM
    Hi,

    Cloud you please create a separate job with only those 16 tables, with the following configuration just to give it a check why it stucks.

    Streams : 16
    Min         : 12288
    Max        : 12288

    Regards,

    Mouhssine


  • 14.  RE: Error on profiling job data level concrete case

    Posted 05-05-2017 02:56:00 PM

    Hi,

        It seems that also

    Streams : 16
    Min         : 12288
    Max        : 12288

    is not able to complete the profiling task successful

    Total tables are 199 and 12 still remain in processing status.

    Luigi