4.3 KiB
Benchmarks
These are the results of benchmarks comparing this bc (at version 2.7.0) and
GNU bc (at version 1.07.1), both compiled with clang 9 at -O2.
Note: all benchmarks were run four times, and the fastest run is the one shown.
Also, [bc] means whichever bc was being run, and the assumed working
directory is the root directory of this repository. Also, this bc was built at
-O2.
Addition
The command used was:
tests/script.sh bc add.bc 1 0 1 1 [bc]
For GNU bc:
real 2.06
user 1.11
sys 0.95
For this bc:
real 0.98
user 0.95
sys 0.02
Subtraction
The command used was:
tests/script.sh bc subtract.bc 1 0 1 1 [bc]
For GNU bc:
real 2.04
user 1.04
sys 0.99
For this bc:
real 1.02
user 1.00
sys 0.01
Multiplication
The command used was:
tests/script.sh bc multiply.bc 1 0 1 1 [bc]
For GNU bc:
real 5.96
user 4.27
sys 1.68
For this bc:
real 2.15
user 2.11
sys 0.04
Division
The command used was:
tests/script.sh bc divide.bc 1 0 1 1 [bc]
For GNU bc:
real 2.74
user 1.84
sys 0.89
For this bc:
real 1.49
user 1.48
sys 0.00
Power
The command used was:
printf '1234567890^100000; halt\n' | time -p [bc] -lq > /dev/null
For GNU bc:
real 9.60
user 9.58
sys 0.01
For this bc:
real 0.67
user 0.66
sys 0.00
Scripts
This file was downloaded, saved at ../timeconst.bc and the following
patch was applied:
--- ../timeconst.bc 2018-09-28 11:32:22.808669000 -0600
+++ ../timeconst.bc 2019-06-07 07:26:36.359913078 -0600
@@ -110,8 +110,10 @@
print "#endif /* KERNEL_TIMECONST_H */\n"
}
- halt
}
-hz = read();
-timeconst(hz)
+for (i = 0; i <= 50000; ++i) {
+ timeconst(i)
+}
+
+halt
The command used was:
time -p [bc] ../timeconst.bc > /dev/null
For GNU bc:
real 15.26
user 14.60
sys 0.64
For this bc:
real 11.24
user 11.23
sys 0.00
Because this bc is faster when doing math, it might be a better comparison to
run a script that is not running any math. As such, I put the following into
../test.bc:
for (i = 0; i < 100000000; ++i) {
y = i
}
i
y
halt
The command used was:
time -p [bc] ../test.bc > /dev/null
For GNU bc:
real 14.89
user 14.88
sys 0.00
For this bc:
real 22.19
user 22.18
sys 0.00
However, when I put the following into ../test2.bc:
i = 0
while (i < 100000000) {
++i
}
i
halt
the results were surprising.
The command used was:
time -p [bc] ../test2.bc > /dev/null
For GNU bc:
real 42.92
user 32.70
sys 10.19
For this bc:
real 28.50
user 28.44
sys 0.02
I have no idea why the performance of both bc's fell off a cliff, especially
the dismal showing by the GNU bc.
Note that, when running the benchmarks, the optimization used is not the one I
recommend, which is -O3 -flto -march=native. This bc separates its code into
modules that, when optimized at link time, removes a lot of the inefficiency
that comes from function overhead. This is most keenly felt with one function:
bc_vec_item(), which should turn into just one instruction (on x86_64) when
optimized at link time and inlined. There are other functions that matter as
well.
When compiling both bc's with the recommended optimizations, the results are
as follows.
For the first script, the command was:
time -p [bc] ../timeconst.bc > /dev/null
For GNU bc:
real 14.01
user 13.41
sys 0.59
For this bc:
real 9.40
user 9.39
sys 0.00
For the second script, the command was:
time -p [bc] ../test.bc > /dev/null
For GNU bc:
real 12.58
user 12.58
sys 0.00
For this bc:
real 17.99
user 17.98
sys 0.00
For the third script, the command was:
time -p [bc] ../test2.bc > /dev/null
For GNU bc:
real 39.74
user 27.28
sys 12.44
For this bc:
real 23.31
user 23.27
sys 0.02
This is more competitive.
In addition, when compiling with the above recommendation, this bc gets even
faster when doing math.
Recommended Compiler
When I ran these benchmarks with my bc compiled under clang vs. gcc, it
performed much better under clang. I recommend compiling this bc with
clang.