Function: Dedup

Overview

Function will limit count of duplicated rows

Description

You can use this function to limit the number of events with a repeated value for a given field. It is convenient to use it to delete duplicate events. You can set multiple conditions at once to detect recurring events.
To do this, simply specify the name of the field that will be used to select duplicates, and the number of duplicate entries. The first N entries will be used, and the rest will be ignored

Function Schema

Examples

The function receives events containing user names. We want to get a list of unique user names. To do this, set Field name = 'name' and Number of duplicate entries = 1 in the function parameters. After processing the events, the second event containing the name 'John' will be ignored