To keep the throughput numbers unaffected by extra benchmarking code, the memory, time and file results should not be calculated/required/communicated when running ab tests. It is only needed once, when curl is used to fetch these results in _functions.php