Table 3 Example: mapping of component category \(\rightarrow\) Spark API type, as in [57]
SN | Component class | Component category | Spark API classification |
|---|---|---|---|
1 | ReadDataFrame | Input | Input |
2 | ReadDStream | Input | Input |
3 | TransformDataFrame | Transformation | Transformation Type A |
4 | TransformDStream | Transformation | Transformation Type A |
5 | TransformDataFrames | Transformation | Transformation Type B |
6 | ActionOnDataFrame | Action | Action |