search for exact match doesn't produce results

Hello,

if i want profiles some tables by searching exact match with this regular expression

\b[C][o][l][o][m][b][o]\b the job returns without errors but doesn't match anything at data level.

But if i query directly that same regular expression returns some data

Luigi

luigidep

622 Points

Posted 2 years ago

2 years ago

Mouhssine SAIDI

5,234 Points

Hi luigidep,

It's a syntax type in my advice.

You're looking to profile value "Colombo", i suggest to change the regexp to spmething like

([C][o][l][o][m][b][o])

You can find some good samples here https://docs.delphix.com/pages/viewpa...

Regards,

Mouhssine

Comment

2 years ago

luigidep

622 Points

It would be supposed with respect to this warning that Delphix when performs search at level data by default examine a subset of all rows for each table. And if Delphix doesn't find correspondence within for example the first thousand rows for each table infer that the current expression doesn't match. This scenario happens when the distribution of first name and last name values in the columns is skewed, not uniform and so we have to manually profile them we have no choice.

Comment

2 years ago

luigidep

622 Points

Hi Mouhssine,

also if i specify that synatx for catch the name Delphix profiler doesn't recognize it.

Neither if i edit ruleset with sql filter that match only one row containing that string.

Probably the skewed distribution of the name value in the column or probabily the relative position of the name in the column field that requires multiline matching regular expression.

Also is strange in general that profiling job returns succeeded without produce results as in this case and returns failed but with profiling report compiled.

Luigi

Comment

2 years ago

luigidep

622 Points

Hello,

I have solved my problem.

The job status failed was due to setting to twenty the number of streams dedicated to profile job.

Now i have updated it to two and jobs have succeeded.

Also the search for exact match produce result

Thank you for your attention.

I would like to know the value of parameter NO_OF_ROWS that is read by kettle to determine the subset row to profile for each tables in rule set. This parameter could impact the profile job activity

Luigi

(Edited)

Comment

1 person likes this

2017-03-11T15:44:46+00:00

Gianpiero Piccolo

1,578 Points

I'm interested in NO_OF_ROWS too. What is the default number and how can one modify it?
Thank you
Gianpiero

2017-03-11T16:29:45+00:00

Mouhssine SAIDI

5,234 Points

Hi,

You have to contact support that will help you with that, I think they will provide and load a new configuration masking file to define this.

Regards,

Mouhssine

2 years ago

Mouhssine SAIDI

5,234 Points

Hi,

Glad that's it working now.

But just to my personal known what matching regexp did you use yours or the one provided by me.

Regards,

Mouhssine