Delphix Products

Expand all | Collapse all

SL Algorithm Issue

  • 1.  SL Algorithm Issue

    Posted 07-07-2017 09:51:00 AM

    I have a COUNTY column in a customer table that I have linked to a COUNTY SL Algorithm using a file of 90 different UK counties ...  but this is not working when I run the masking.

    Before

    After

    Why are some not replaced and set to NULL (the SL file has no NULL values, see below)  ... it only ever seems to want to replace W MIDLANDS with NORTH YORKSHIRE?

    BATH AND NORTH EAST SOMERSET
    BEDFORD
    BLACKBURN WITH DARWEN
    BLACKPOOL
    BOURNEMOUTH
    BRACKNELL FOREST
    BRIGHTON & HOVE
    BRISTOL
    BUCKINGHAMSHIRE
    CAMBRIDGESHIRE
    CENTRAL BEDFORDSHIRE
    CHESHIRE EAST
    CHESHIRE WEST AND CHESTER
    CORNWALL
    COUNTY DURHAM
    CUMBRIA
    DARLINGTON
    DERBY
    DERBYSHIRE
    DEVON
    DORSET
    EAST RIDING OF YORKSHIRE
    EAST SUSSEX
    ESSEX
    GLOUCESTERSHIRE
    GREATER LONDON
    GREATER MANCHESTER
    HALTON
    HAMPSHIRE
    HARTLEPOOL
    HEREFORDSHIRE
    HERTFORDSHIRE
    HULL
    ISLE OF WIGHT
    ISLES OF SCILLY
    KENT
    LANCASHIRE
    LEICESTER
    LEICESTERSHIRE
    LINCOLNSHIRE
    LUTON
    MEDWAY
    MERSEYSIDE
    MIDDLESBROUGH
    MILTON KEYNES
    NORFOLK
    NORTH EAST LINCOLNSHIRE
    NORTH LINCOLNSHIRE
    NORTH SOMERSET
    NORTH YORKSHIRE
    NORTHAMPTONSHIRE
    NORTHUMBERLAND
    NOTTINGHAM
    NOTTINGHAMSHIRE
    OXFORDSHIRE
    PETERBOROUGH
    PLYMOUTH
    POOLE
    PORTSMOUTH
    READING
    REDCAR AND CLEVELAND
    RUTLAND
    SHROPSHIRE
    SLOUGH
    SOMERSET
    SOUTH GLOUCESTERSHIRE
    SOUTH YORKSHIRE
    SOUTHAMPTON
    SOUTHEND-ON-SEA
    STAFFORDSHIRE
    STOCKTON-ON-TEES
    STOKE-ON-TRENT
    SUFFOLK
    SURREY
    SWINDON
    TELFORD AND WREKIN
    THURROCK
    TORBAY
    TYNE AND WEAR
    WARRINGTON
    WARWICKSHIRE
    WEST BERKSHIRE
    WEST MIDLANDS
    WEST SUSSEX
    WEST YORKSHIRE
    WILTSHIRE
    WINDSOR AND MAIDENHEAD
    WOKINGHAM
    WORCESTERSHIRE
    YORK





    #Masking


  • 2.  RE: SL Algorithm Issue

    Posted 07-07-2017 04:15:00 PM
    Hi Robert,
    1) Extra CRLF character in the end sometimes gets translated to a NULL ( which is a valid value for masking), try re -uploading lookup file with no empty line at end and in UTF-8 encoding with no special characters.

    2) Since masking will convert a value to another value in lookup it is possible that a value gets masked to itself, try sorting the SL lookup list.

    NULLS, Blanks, empties are valid values in masking and are distinctly preserved, white-spaces are treated as word strings.

    --Hims


  • 3.  RE: SL Algorithm Issue

    Posted 07-08-2017 04:23:00 PM
    I have already done as you have suggested, the file is sorted, in UTF-8 and has no embedded NULLs or extra CRLF at the end of the file. I have tried this several times with different files and always get the same/similar result.

    I should say that other columns using SL are working as expected, it is just this one related to the column of COUNTY.

    Anyone got any further ideas?


  • 4.  RE: SL Algorithm Issue

    Posted 07-11-2017 12:55:00 PM
    Can anyone offer any further suggestions on how to resolve this issue?



  • 5.  RE: SL Algorithm Issue

    Posted 07-11-2017 06:33:00 PM
    Hi, Could you upload a tar ball of the engine logs please Regards, Mouhssine


  • 6.  RE: SL Algorithm Issue

    Posted 07-11-2017 06:37:00 PM
    Hi again, Will be also helpful if you can upload the masking job configuration screens (ruleset, inventory and job def itself) Regards, Mouhssine