Table 1 Comparison between batch processing and streaming processing [82]
From: Big data stream analysis: a systematic literature review
Dimension | Batch processing | Streaming processing |
|---|---|---|
Input | Data chunks | Stream of new data or updates |
Data size | Known and finite | Infinite or unknown in advance |
Hardware | Multiple CPUs | Typical single limited amount of memory |
Storage | Store | Not store or store non-trivial portion in memory |
Processing | Processed in multiple rounds | A single or few passes over data |
Time | Much longer | A few seconds or even milliseconds |
Applications | Widely adopted in almost every domain | Web mining, traffic monitoring, sensor networks |