Table 4 Comparison of high-level Spark programming with existing solutions, as in [57]
Tools | Interaction endpoint | Target framework | High-level programming | Code-snippet input not required | Generate Big Data program |
|---|---|---|---|---|---|
Lemonade | Flow-based GUI tool | Spark ML (via Python APIs) | ✓ | ✓ | ✓ |
Apache Zeppelin | Interactive shell | Multi-language back-end including Spark and Flink | ✗ | ✗ | ✗ |
Apache NiFi | Flow-based GUI tool | Interfaces with Spark and Flink | ✓ | ✗ | ✗ |
Apache Beam | Flow-based programming API | Unified Programming model for Big Data systems including Spark and Flink | ✗ | ✗ | ✗ |
Microsoft Azure | Flow-based GUI tool | Includes Spark | ✓ | ✗ | ✗ |
QryGraph | Flow-based GUI tool | Pig | ✓ | ✓ | ✓ |
Nussknacker | Flow-based GUI tool | Flink | ✓ | ✓ | ✓ |
QM-IConf | Flow-based GUI tool | Storm | ✓ | ✓ | ✓ |
Our approach prototyped in aFlux | Flow-based GUI tool | Spark, Flink [17]. Extensible | ✓ | ✓ | ✓ |