polars drop-duplicates

For dataframe.

Drops duplicate values in dataframe.

warning This command requires a plugin The polars drop-duplicates command resides in the polars plugin. To use this command, you must install and register nu_plugin_polars. See the Plugins chapter in the book for more information.

Command Type

plugin

Signature

> polars drop-duplicates {flags} (subset)

Flags

  • --maintain, -m: Maintain order.
  • --last, -l: Keeps last duplicate value (by default keeps first).

Parameters

  • subset: Subset of columns to drop duplicates.

Input/output types:

input output
polars_dataframe polars_dataframe
polars_lazyframe polars_lazyframe

Examples

drop duplicates

> [[a b]; [1 2] [3 4] [1 2]] | polars into-df
                | polars drop-duplicates
                | polars sort-by a
╭───┬───┬───╮
│ # │ a │ b │
├───┼───┼───┤
│ 0 │ 1 │ 2 │
│ 1 │ 3 │ 4 │
╰───┴───┴───╯

Ported from nushell/nushell.github.io. Copyright (c) 2021 Nushell Project. MIT License.