Redact/Mask Value

Redact/Mask all values with a pattern specified by regex in a key

The Redact/Mask value action will hide all values with a pattern specified by `regex` in the `key` by replacing it with a certain character such as "*"(default). When applied to your processing rule, the Redact/Mask value action will conceal every occurrence of the specified regex pattern in the values of Key by replacing it with your preferred character for every record in your pipeline.

\

For example, given the following sample website log data.

{"timestamp":"2023-03-28T09:08:41.64283645Z","user_id":3,"page_id":30,"action":"purchase"}
{"timestamp":"2023-03-28T09:08:42.643343109Z","user_id":4,"page_id":10,"action":"purchase"}
{"timestamp":"2023-03-28T09:08:48.643600498Z","user_id":1,"page_id":50,"action":"click"}
{"timestamp":"2023-03-28T09:08:50.643773688Z","user_id":5,"page_id":40,"action":"purchase"}
{"timestamp":"2023-03-28T09:08:51.643932272Z","user_id":1,"page_id":30,"action":"purchase"}
{"timestamp":"2023-03-28T09:08:56.644080944Z","user_id":2,"page_id":40,"action":"click"}
{"timestamp":"2023-03-28T09:09:03.64425954Z","user_id":3,"page_id":30,"action":"click"}
{"timestamp":"2023-03-28T09:09:03.644317046Z","user_id":1,"page_id":20,"action":"view"}
{"timestamp":"2023-03-28T09:09:10.64447719Z","user_id":2,"page_id":50,"action":"purchase"}
{"timestamp":"2023-03-28T09:09:17.644810963Z","user_id":2,"page_id":10,"action":"view"}
{"timestamp":"2023-03-28T09:09:20.644994805Z","user_id":1,"page_id":50,"action":"view"}

For the key action, to conceal every occurrence of the purchase value in every record of your pipeline by replacing it with “*”, from the actions drop-down menu of your processing rules tab, select Redact/Mask Value. For the key input box, add the “action” key, add “purchase” in the regex input box, and in the replacement characters input box, add “*”. Then click apply

Your Processing rule will now replace any occurrence of the value “Purchase” in the key “action” with the character “*”.

\

Last updated