Data Operations
About
The data operations are all functions, operations, actions that you can perform on a data resources.
They can be used in a step of a pipeline.
This section lists all data operations supported.
Because all data structures are represented logically as a data resource (file, table, …), they all share the same common data vocabulary.
List
| Data Operations | Synonym | Description |
|---|---|---|
| concat | cat | Concatenate multiple data resources into one |
| copy | Create a copy of a resource on data and metadata level | |
| delete | Delete data from a data resource | |
| diff | Compare two data resources | |
| distinct | Filter data resource duplicate | |
| drop | remove | Remove the data and metadata of a data resource |
| fill | generate | Generate data for a resource |
| insert | append | Add data into a resource |
| list | List data resources | |
| move | rename | Move or rename a data resource |
| tail, head | Print the data of a resource | |
| replace | Replace a target | |
| update | Update data of a resource | |
| upsert | Insert otherwise update the data of a data resource | |
| transfer | load, upload, download | Move data resource from one system to another |
| truncate | Delete the data, preserve the metadata |