Skip to main content

Table 2 Interoperability between different Spark data abstractions, as in [18, 57]

From: Graphical Flow-based Spark Programming

\({\frac{\hbox {Target abstraction}}{\hbox {Source abstraction}}}\)

RDD

DStream

DataFrame

S. DataFrame

RDD

–

No

Yes

No

DStream

Yes

–

No

No

DataFrame

Yes

No

–

No

Streaming DataFrame

No

No

No

–