Table of Contents

About

Operations may implement the following processing type:

  • stream
  • batch

They may support both.

Type

Operation Type Processing Type Description
Supplier batch A batch supplier:
* will end
* supplies a finite number of data resources
Supplier stream A stream supplier:
* will never end if no duration control is set
* supplies an infinite number of data resources
Intermediate batch A intermediate batch operation will execute:
* at the end for a batch execution
* at interval for a stream (The interval being known as the window)
Intermediate stream A intermediate stream operation will execute immediately.

There is 2 kind of intermediate stream operation:
* map: return 1 output for 1 input
* split: return N outputs for 1 input