Bench Testing
|
19th Dec, 2014, 02:03 AM
Post: #1
|
|||
|
|||
Bench Testing
With Xbian now being supported on 3 different hardware (Cubox-i, Hummingboard and of course RPi) it dawned on me that we should have a standard to work with, so that with future upgrades and possibly new hardware (Banana Pi?) we would have standard performance details for all possible configurations.
So I had a look around and came up with Sysbench. Full details are available in the link including installing and running the CPU and I/O tests. For the CPU use sysbench --test=cpu --cpu-max-prime=2000 run (As 20000 might take the RPi a while) For the I/O use sysbench --test=fileio --file-total-size=1G prepare (As no one has 150G spare!!!) For the execution use ... sysbench --test=fileio --file-total-size=1G --file-test-mode=rndrw --init-rng=on --max-time=300 --max-requests=0 run To clear the file run sysbench --test=fileio --file-total-size=1G cleanup CPU is total time I/O is Kb/sec value So if users could run the test on their machine, we will get a benchmark for different machines, which will assist in seeing if upgrades are faster, or if someone's machine is running slow (or faster for that matter). I don't have a basis yet for the norm, but I guess 10% either way is acceptable. My results Because the forum doesn't do formatting: Use Model, Xbian Version, SD Card(speed), CPU result, I/O result So: Cubox-i4 Pro, RC3 (20141218), Kingston 4g(10), 23.9741s, 729.01Kb/sec Please read before you post How to post a log file If you liked my help, click on "Thanks" to show your appreciation.
|
|||
19th Dec, 2014, 02:10 AM
Post: #2
|
|||
|
|||
RE: Bench Testing
Already did this once for a Dutch forum. Once single threaded, once with all supported cores.
Radxa Rock Pro - 1 Thread Code: # sysbench --test=cpu --cpu-max-prime=20000 --num-threads=1 run Radxa Rock Pro - 4 Threads Code: # sysbench --test=cpu --cpu-max-prime=20000 --num-threads=4 run HummingBoard i2eX Dual Core - 1 Thread Code: root@cubox:~# sysbench --test=cpu --cpu-max-prime=20000 run HummingBoard i2eX Dual Core - 2 Threads Code: root@cubox:~# sysbench --test=cpu --cpu-max-prime=20000 --num-threads=2 run Hummingboard i1 Single Core - 1 thread Code: root@pi:~# sysbench --test=cpu --cpu-max-prime=20000 --num-threads=1 run Hummingboard i1 Single Core - 2 threads Code: root@cubox:~# sysbench --test=cpu --cpu-max-prime=20000 --num-threads=2 run Raspberry Pi Model B OC (arm=950, core=450, sdram=500, overvolt=2) Code: root@pi:~# sysbench --test=cpu --cpu-max-prime=20000 run Just because i can: Raspberry Pi Model B OC (arm=950, core=450, sdram=500, overvolt=2) - 2 Threads Code: root@pi:~# sysbench --test=cpu --cpu-max-prime=20000 --num-threads=2 run Raspberry Pi Model B No OC Code: root@pi:~# sysbench --test=cpu --cpu-max-prime=20000 run Raspberry Pi Model B No OC - 2 Threads Code: root@pi:~# sysbench --test=cpu --cpu-max-prime=20000 --num-threads=2 run BananaPi Pro - 1 Thread Code: root@bananapi:~# sysbench --test=cpu --cpu-max-prime=20000 run BananaPi Pro - 2 Threads Code: # sysbench --test=cpu --cpu-max-prime=20000 --num-threads=2 run Raspberry Pi 2 - 1 Thread Code: # sysbench --test=cpu --cpu-max-prime=20000 run Raspberry Pi 2 - 4 Threads Code: # sysbench --test=cpu --cpu-max-prime=20000 --num-threads=4 run Raspberry Pi 2 OC - 1 Thread Code: # sysbench --test=cpu --cpu-max-prime=20000 run Raspberry Pi 2 OC - 4 Threads Code: # sysbench --test=cpu --cpu-max-prime=20000 --num-threads=4 run Hummingboard 2 Edge - 1 Thread Code: # sysbench --test=cpu --cpu-max-prime=20000 run Hummingboard 2 Edge - 4 Thread Code: # sysbench --test=cpu --cpu-max-prime=20000 --num-threads=4 run ClearFog Pro - 1 Thread Code: # sysbench --test=cpu --cpu-max-prime=20000 run ClearFog Pro - 2 Threads Code: # sysbench --test=cpu --cpu-max-prime=20000 --num-threads=2 run Conclusion: Code: Intel 4460 4T : 6.9527 ** Default Turbo OC pilight - modular domotica solution
|
|||
19th Dec, 2014, 02:25 AM
Post: #3
|
|||
|
|||
RE: Bench Testing
So now you can add to your list.
Cubox-i4 Pro 302.6553s Threads 4! Cubox-i4 Pro 155.7358s Please read before you post How to post a log file If you liked my help, click on "Thanks" to show your appreciation.
|
|||
19th Dec, 2014, 02:30 AM
Post: #4
|
|||
|
|||
RE: Bench Testing
Better you do it in the First Post.
pilight - modular domotica solution
|
|||
19th Dec, 2014, 02:35 AM
Post: #5
|
|||
|
|||
RE: Bench Testing
No I wanted a standard benchmark that was applicable to Xbian on the 3 platforms. Unless it is now running on an Intel G620T!! Also I'm mainly interested on the Xbian version, to see if any upgrades affect the performance - for the better or the worse.
Please read before you post How to post a log file If you liked my help, click on "Thanks" to show your appreciation.
|
|||
19th Dec, 2014, 02:51 AM
Post: #6
|
|||
|
|||
RE: Bench Testing
G620 was to put things into perspective.
I did the test again on a Hummingboard i1 Single Core and the results are not significantly different (+/- 3 points) between now (latest XBian fully updated) and may (unusable XBian). So i think all results will still stand. pilight - modular domotica solution
|
|||
19th Dec, 2014, 03:07 AM
Post: #7
|
|||
|
|||
RE: Bench Testing
It would seem that, not surprisingly that the hummingboard and the Cubox-i fair the same with duel threads but ramp it up to 4 and the CB wins.
So in perspective, it is NOT a fair comparison, as the thread count on multi cores machines makes a difference, I wonder if a RPi is run with thread=8 (or 4) gives the same results as thread=1. If so, then I need to change the test to thread=max (if that option exists) Please read before you post How to post a log file If you liked my help, click on "Thanks" to show your appreciation.
|
|||
19th Dec, 2014, 03:17 AM
Post: #8
|
|||
|
|||
RE: Bench Testing
No, the more threads you use on a single core machine the worse it's going to perform. So indeed, especially the cores are the thing that count most.
pilight - modular domotica solution
|
|||
3rd Jan, 2015, 01:10 AM
Post: #9
|
|||
|
|||
RE: Bench Testing
Just added the Radxa Rock Pro
pilight - modular domotica solution
|
|||
13th Jan, 2015, 05:15 PM
Post: #10
|
|||
|
|||
RE: Bench Testing
@IriDium,
prime number computation is the most CPU only test ever. it is from 99.9% dependent on CPU frequency and CPU internal architecture (nr of math units, pipes in that case so CPU can do X multiplications in one clock tick even if being single core). that's why 5000 primes it takes 90s on CortexA9(1ghz) core, 4s on i5(3.4ghz) and only 3s on i7(being only at 2ghz). there is no involvement of memory, not even internal processor caches. but try that : sysbench --test=threads run on 3.17 on RPI and 3.14 cubox, 3.10 cubox, 3.0.35 cubox. this test can make use of effective scheduler/locks handling. and RPI on 3.17 gives ~~ as 3.14 cubox (with lower freq and inferior CPU design). so context switching and wasted time on internal management in kernel translated to user feel - responsiveness. we used to use 2.4 kernels... in last century. don't remember it much but remember 3.0.35 on cubox. pain (but most Androids run it). Please read rules and do a search before you post! . FAQs . How to post log file? . Looking for answers? Please start here |
|||
6th Feb, 2015, 01:17 AM
Post: #11
|
|||
|
|||
RE: Bench Testing
Raspberry Pi 2 Single thread
Code: pi@raspberrypi ~ $ sysbench --test=cpu --cpu-max-prime=20000 --num-threads=1 run Raspberry Pi 2 multiple threads Code: pi@raspberrypi ~ $ sysbench --test=cpu --cpu-max-prime=20000 --num-threads=4 run Please read before you post How to post a log file If you liked my help, click on "Thanks" to show your appreciation.
|
|||
6th Feb, 2015, 01:22 AM
Post: #12
|
|||
|
|||
RE: Bench Testing
Why is your faster?
pilight - modular domotica solution
|
|||
6th Feb, 2015, 02:29 AM
Post: #13
|
|||
|
|||
RE: Bench Testing
No idea but I ran it in Raspbian will a full upgrade. I also deleted/removed a lot of the unwanted programs.
Try upgrading and run it again. I know there was talk of some optimization of the code, so it may have been reflected in the upgrade. That is a bit of a difference between the two. Please read before you post How to post a log file If you liked my help, click on "Thanks" to show your appreciation.
|
|||
6th Feb, 2015, 07:01 PM
Post: #14
|
|||
|
|||
RE: Bench Testing
Just rerun the test and the results are similar to my first run.
otal time: 195.8444s Please read before you post How to post a log file If you liked my help, click on "Thanks" to show your appreciation.
|
|||
8th Feb, 2015, 06:30 AM
Post: #15
|
|||
|
|||
RE: Bench Testing
I noticed that mine was slower because i had it downclocked with XBian default OC
pilight - modular domotica solution
|
|||
« Next Oldest | Next Newest »
|