SL Algorithm Issue

  • 0
  • 1
  • Problem
  • Updated 1 year ago
  • In Progress

I have a COUNTY column in a customer table that I have linked to a COUNTY SL Algorithm using a file of 90 different UK counties ...  but this is not working when I run the masking.

Before

After

Why are some not replaced and set to NULL (the SL file has no NULL values, see below)  ... it only ever seems to want to replace W MIDLANDS with NORTH YORKSHIRE?

BATH AND NORTH EAST SOMERSET
BEDFORD
BLACKBURN WITH DARWEN
BLACKPOOL
BOURNEMOUTH
BRACKNELL FOREST
BRIGHTON & HOVE
BRISTOL
BUCKINGHAMSHIRE
CAMBRIDGESHIRE
CENTRAL BEDFORDSHIRE
CHESHIRE EAST
CHESHIRE WEST AND CHESTER
CORNWALL
COUNTY DURHAM
CUMBRIA
DARLINGTON
DERBY
DERBYSHIRE
DEVON
DORSET
EAST RIDING OF YORKSHIRE
EAST SUSSEX
ESSEX
GLOUCESTERSHIRE
GREATER LONDON
GREATER MANCHESTER
HALTON
HAMPSHIRE
HARTLEPOOL
HEREFORDSHIRE
HERTFORDSHIRE
HULL
ISLE OF WIGHT
ISLES OF SCILLY
KENT
LANCASHIRE
LEICESTER
LEICESTERSHIRE
LINCOLNSHIRE
LUTON
MEDWAY
MERSEYSIDE
MIDDLESBROUGH
MILTON KEYNES
NORFOLK
NORTH EAST LINCOLNSHIRE
NORTH LINCOLNSHIRE
NORTH SOMERSET
NORTH YORKSHIRE
NORTHAMPTONSHIRE
NORTHUMBERLAND
NOTTINGHAM
NOTTINGHAMSHIRE
OXFORDSHIRE
PETERBOROUGH
PLYMOUTH
POOLE
PORTSMOUTH
READING
REDCAR AND CLEVELAND
RUTLAND
SHROPSHIRE
SLOUGH
SOMERSET
SOUTH GLOUCESTERSHIRE
SOUTH YORKSHIRE
SOUTHAMPTON
SOUTHEND-ON-SEA
STAFFORDSHIRE
STOCKTON-ON-TEES
STOKE-ON-TRENT
SUFFOLK
SURREY
SWINDON
TELFORD AND WREKIN
THURROCK
TORBAY
TYNE AND WEAR
WARRINGTON
WARWICKSHIRE
WEST BERKSHIRE
WEST MIDLANDS
WEST SUSSEX
WEST YORKSHIRE
WILTSHIRE
WINDSOR AND MAIDENHEAD
WOKINGHAM
WORCESTERSHIRE
YORK



Photo of Robert Middlebrook

Robert Middlebrook

  • 90 Points 75 badge 2x thumb

Posted 1 year ago

  • 0
  • 1
Photo of Hims

Hims, Employee

  • 2,096 Points 2k badge 2x thumb
Hi Robert,
1) Extra CRLF character in the end sometimes gets translated to a NULL ( which is a valid value for masking), try re -uploading lookup file with no empty line at end and in UTF-8 encoding with no special characters.

2) Since masking will convert a value to another value in lookup it is possible that a value gets masked to itself, try sorting the SL lookup list.

NULLS, Blanks, empties are valid values in masking and are distinctly preserved, white-spaces are treated as word strings.

--Hims
Photo of Robert Middlebrook

Robert Middlebrook

  • 90 Points 75 badge 2x thumb
I have already done as you have suggested, the file is sorted, in UTF-8 and has no embedded NULLs or extra CRLF at the end of the file. I have tried this several times with different files and always get the same/similar result.

I should say that other columns using SL are working as expected, it is just this one related to the column of COUNTY.

Anyone got any further ideas?
(Edited)
Photo of Robert Middlebrook

Robert Middlebrook

  • 90 Points 75 badge 2x thumb
Can anyone offer any further suggestions on how to resolve this issue?
Photo of Mouhssine SAIDI

Mouhssine SAIDI

  • 4,682 Points 4k badge 2x thumb
Hi,

Could you upload a tar ball of the engine logs please

Regards,

Mouhssine
Photo of Mouhssine SAIDI

Mouhssine SAIDI

  • 4,682 Points 4k badge 2x thumb
Hi again,

Will be also helpful if you can upload the masking job configuration screens (ruleset, inventory and job def itself)

Regards,

Mouhssine