make: Leaned into simtime in Makefile
The value of simtime isn't actually the simtime value, but the simulated throughput, which is easy enough for our csv.py script to calculate (with a daintily placed max to avoid divide-by-zero). Throughput has the benefit of being somewhat size-agnostic, making cross-benchmark comparisons easier. I guess it's technically possible to do something similar with readed/progged/erased numbers, but conceptually that would be really confusing... --- Also renamed test/bench_time -> test/bench_runtime to hopefully prevent confusion between the two time spaces.
This commit is contained in:
+2
-2
@@ -1186,7 +1186,7 @@ def run_stage(name, runner, test_ids, stdout_, trace_, output_, **args):
|
||||
'case': case,
|
||||
**defines,
|
||||
'test_passed': '1/1',
|
||||
'test_time': '%.6f' % (
|
||||
'test_runtime': '%.6f' % (
|
||||
time.time() - last_time)})
|
||||
elif op == 'skipped':
|
||||
locals.seen_perms += 1
|
||||
@@ -1384,7 +1384,7 @@ def run(runner, test_ids=[], **args):
|
||||
output = TestOutput(args['output'],
|
||||
['suite', 'case'],
|
||||
# defines go here
|
||||
['test_passed', 'test_time'])
|
||||
['test_passed', 'test_runtime'])
|
||||
|
||||
# measure runtime
|
||||
start = time.time()
|
||||
|
||||
Reference in New Issue
Block a user