Exploring and cleaning big data with random sample data blocks

Journal of Big Data

Table 9 Correlation between V38 and 6 other features in clean Power data

Feature	True value	Summary of RSP-based estimates
Feature	True value	Mean ± StdDev	5th percentile	50th percentile	95th percentile
V3	0.3126873	0.3132926 ± 0.01267681	0.2956115	0.3131225	0.3356508
V15	0.3268368	0.3276999 ± 0.01238780	0.3059839	0.3286929	0.3459587
V37	0.8598520	0.8601381 ± 0.01011005	0.8427635	0.8606978	0.8760539
V39	0.5330211	0.5335060 ± 0.01609916	0.5082045	0.5346581	0.5578231
V65	0.63534	0.6340810 ± 0.01368082	0.6108725	0.6361881	0.6562849
V98	0.4790145	0.4784269 ± 0.01759861	0.4507184	0.4788393	0.5072602

RSP-based coefficients were calculated from a sample of clean RSP blocks (\(g=100\))