Data Operation - Concat

About

Concat is a intermediate data operation that will concatenate multiple data resources into one.

It's an alias of the transfer operation where:

• the method is set to insert
• the target name stays the same for all sources (ie the target data uri does not have a target pattern in its path)

Cli

The concat operation is also available via the tabul data command.

Note

What if the target exists

Note that the data operation is insert therefore if the target resource exists, the data is appended.

Effect of metadata on file concatenation

Note that concatenating files that does not store any metadata (such as csv file without header) should be quicker.

Why ?

The concatenation is performed:

• physically: block by block (bytes disk operation)
• and not logically: record by record