Skip to main content

Table 2 Comparison of data processing techniques

From: A survey on bandwidth-aware geo-distributed frameworks for big-data analytics

Frameworks

Resource management

Data locality

Multi-query support

Cluster architecture

Multi-cluster support

Relevant intermediate data finding

Fault-tolerance support

Heterogeneous resources

Inter-DC traffic reduction

Machine learning use

Cost-awareness

Batch processing MapReduce-based frameworks

 Medusa [43]

   

C

  

\(\checkmark\)

    

 Chrysaor [44]

   

C

  

\(\checkmark\)

    

 GeoDis [45]

 

\(\checkmark\)

 

C

   

\(\checkmark\)

   

 Li et al. (1) [46]

 

\(\checkmark\)

 

C

    

\(\checkmark\)

  

Batch processing Spark-based frameworks

 LinePro [47]

 

\(\checkmark\)

 

C

       

 Houtu [37]

\(\checkmark\)

 

\(\checkmark\)

D

\(\checkmark\)

 

\(\checkmark\)

\(\checkmark\)

   

 Tetrium [19]

\(\checkmark\)

 

\(\checkmark\)

C

 

\(\checkmark\)

 

\(\checkmark\)

\(\checkmark\)

  

 Lube [42]

 

\(\checkmark\)

 

C

   

\(\checkmark\)

 

\(\checkmark\)

 

 Harmony [48]

 

\(\checkmark\)

 

C

   

\(\checkmark\)

\(\checkmark\)

  

 Kimchi [49]

   

C

  

\(\checkmark\)

\(\checkmark\)

\(\checkmark\)

 

\(\checkmark\)

Other batch processing frameworks

 HDM-MC [50]

   

D

\(\checkmark\)

  

\(\checkmark\)

   

Geo-distributed SQL-style processing systems

 Turbo [51]

 

\(\checkmark\)

 

C

 

\(\checkmark\)

  

\(\checkmark\)

\(\checkmark\)

 

 Bohr [52]

 

\(\checkmark\)

 

C

 

\(\checkmark\)

  

\(\checkmark\)

  

Micro-batch processing frameworks

 Iridium [12]

 

\(\checkmark\)

 

C

 

\(\checkmark\)

  

\(\checkmark\)

  

 Li et al. (2) [53]

  

\(\checkmark\)

C

    

\(\checkmark\)

\(\checkmark\)

 

Native stream processing frameworks

 Sana [54]

  

\(\checkmark\)

C

 

\(\checkmark\)

\(\checkmark\)

 

\(\checkmark\)

  

 WASP [55]

\(\checkmark\)

 

\(\checkmark\)

C

  

\(\checkmark\)

\(\checkmark\)

\(\checkmark\)

  

 JetStream [56]

 

\(\checkmark\)

 

C

  

\(\checkmark\)

 

\(\checkmark\)

  
  1. C Centralised architecture, D Decentralised architecture