Function: Dedup
Overview
Function will limit count of duplicated rows
Description
You can use this function to limit the number of events with a repeated value for a given field. It is convenient to use it to delete duplicate events. You can set multiple conditions at once to detect recurring events.
To do this, simply specify the name of the field that will be used to select duplicates, and the number of duplicate entries. The first N entries will be used, and the rest will be ignored
Function Schema
Examples
The function receives events containing user names. We want to get a list of unique user names. To do this, set Field name = 'name' and Number of duplicate entries = 1 in the function parameters. After processing the events, the second event containing the name 'John' will be ignored
Updated over 3 years ago