Table 1 Spark libraries and their supported data abstractions, as in [18, 57]
\({\frac{\hbox {Data abstraction}}{\hbox {Library}}}\) | RDD | DStream | DataFrame | S. DataFrame |
|---|---|---|---|---|
Spark  Core | Yes | – | – | – |
Spark  Streaming | – | Yes | – | – |
Spark SQL | – | – | Yes | – |
Spark MLlib | Yes | – | – | – |
Spark ML | – | – | Yes | – |
Spark Structured Streaming | – | – | – | Yes |