Delphix Products

Expand all | Collapse all

search for exact match doesn't produce results

  • 1.  search for exact match doesn't produce results

    Posted 03-03-2017 02:39:00 PM

    Hello,

       if i want profiles some tables by searching exact match with this regular expression

    \b[C][o][l][o][m][b][o]\b the job returns without errors but doesn't match anything at data level.

    But if i query directly that same regular expression returns some data

    Luigi


    #Masking


  • 2.  RE: search for exact match doesn't produce results

    Posted 03-07-2017 01:43:00 PM
    Hi luigidep, It's a syntax type in my advice. You're looking to profile value "Colombo", i suggest to change the regexp to spmething like ([C][o][l][o][m][b][o]) You can find some good samples here https://docs.delphix.com/pages/viewpage.action?pageId=70323469 Regards, Mouhssine


  • 3.  RE: search for exact match doesn't produce results

    Posted 03-07-2017 01:50:00 PM
    It would be supposed with respect to this warning that Delphix when performs search at level data by default examine a subset of all rows for each table. And if Delphix doesn't find correspondence within for example the first thousand rows for each table infer that the current expression doesn't match. This scenario happens when the distribution of first name and last name values in the columns is skewed, not uniform and so we have to manually profile them we have no choice.


  • 4.  RE: search for exact match doesn't produce results

    Posted 03-07-2017 04:28:00 PM

    Hi Mouhssine,

       also if i specify that synatx for catch the name Delphix profiler doesn't recognize it.

    Neither if i edit ruleset with sql filter that match only one row containing that string.

    Probably the skewed distribution of the name value in the column or probabily the relative position of the name in the column field that requires multiline matching regular expression.


    Also is strange in general that profiling job returns succeeded without produce results as in this case and returns failed but with profiling report compiled.


    Luigi



  • 5.  RE: search for exact match doesn't produce results
    Best Answer

    Posted 03-10-2017 01:04:00 PM

    Hello,

        I have solved my problem.

    The job status failed was due to setting to twenty the number of streams dedicated to profile job.

    Now i have updated it to two and jobs have succeeded.

    Also the search for exact match produce result

    Thank you for your attention.

    I would like to know the value of parameter NO_OF_ROWS that is read by kettle to determine the subset row to profile for each tables in rule set. This parameter could impact the profile job activity

    Luigi



  • 6.  RE: search for exact match doesn't produce results

    Posted 03-10-2017 03:53:00 PM
    Hi, Glad that's it working now. But just to my personal known what matching regexp did you use yours or the one provided by me. Regards, Mouhssine


  • 7.  RE: search for exact match doesn't produce results

    Posted 03-10-2017 04:25:00 PM

    Hello i used this expression

    ([cC][oO][lL][oO][mM][bB][oO]|[fF][eE][rR][rR][aA][rR][iI]|[rR][oO][sS][sS][iI]|[bB][iI][aA][nN][cC][hH][iI]|[sS][aA][lL][aA]|[vV][iI][lL][lL][aA]|[cC][aA][tT][tT][aA][nN][eE][oO]|[bB][rR][aA][mM][bB][iI][lL][lL][aA]|[rR][iI][vV][aA]|[fF][uU][mM][aA][gG][aA][lL][lL][iI]|[gG][aA][lL][lL][iI]|[lL][oO][cC][aA][tT][eE][lL][lL][iI]|[pP][oO][zZ][zZ][iI]|[mM][aA][rR][iI][aA][nN][iI]|[rR][oO][tT][aA]|[gG][aA][tT][tT][iI]|[bB][eE][rR][eE][tT][tT][aA]|[bB][aA][rR][bB][iI][eE][rR][iI]|[pP][aA][gG][aA][nN][iI]|[fF][eE][rR][rR][aA][rR][iI][oO])


    Regards,

      Luigi



  • 8.  RE: search for exact match doesn't produce results

    Posted 03-10-2017 04:55:00 PM
    Hi, Okay, so there is no \b and the expression is a variante of the one provided. Great Regards, Mouhssine


  • 9.  RE: search for exact match doesn't produce results

    Posted 03-11-2017 02:45:00 PM
    I'm interested in NO_OF_ROWS too. What is the default number and how can one modify it?
    Thank you
    Gianpiero


  • 10.  RE: search for exact match doesn't produce results

    Posted 03-11-2017 03:30:00 PM
    Hi, You have to contact support that will help you with that, I think they will provide and load a new configuration masking file to define this. Regards, Mouhssine