UCL
 

Personal Miscellaneous TCP/IP GRID Quality of Service Multi-Cast

 

lan wan

 

Comparision of iperf statistics and web100 statistics for the same connection

AIM

This experiment is to show the accuracy of iperf statistics. (of course, this assumes that web100 is correct). Special consideration of the 4gb limit in iperf is explored and the results presented.

Method

This experiment is composed of two runs. The first run investigates the accuracy of the amount of data that is transferred. We will do this by using the -n option in iperf and comparing the amount of data transfered by iperf with that reported in web100. We will also look into the reported values of throughput for these various values by dividing it by the duration of the experiment.

The second part of this experiment will investigate the reported values of the throughput when iperf transfers more than 4gb. The only way this is possible is through defining a duration in which the test should be sent.

Run 1

conducted on 9th July 2002.

By varying the amount of data sent into the network with iperf, we passively monitor the amount of data send into the network for various data sizes.

The data sizes have been decided to be {64,128,256,512,1024,2048,3072,4096}mbytes. As we can get about 900mbit/sec, this is about 112mbytes/sec. So for the largest transfer size of 4gb, it should take about 35 seconds. We need to set web100 trap rates, this was chosen to be 10ms. This would generate a lot of information.

A future tests will investigate into the performance affects of monitoring with web100.

This will be repeated three times to make sure the results are okay. Each test will have the reciever (pc56) set with a buffer of 2048m and the sender with a socket buffer size of 2048m also.

The web100 variable to compare against are:

Data Size: DataBytesOut
Duration: CurrTime - Delta
Recievers window: CurrentRwinRcvd
Socket buffer size on sender: Sndbuf
Socket buffer size on reciever: Rcvbuf

Test 1

results here.

iperf web100
kbytes duration path_utilisation calc_utilisation kbytes duration calc_utilisation
65536 0.6 939.091175 894.7848533 65544.48438 0.557301 963.4657322
131072 1.1 940.584252 976.1289309 131074.8281 1.138685 942.9868594
262144 2.3 939.826838 933.6885426 262197.7344 2.289134 938.3128467
524288 4.6 941.001763 933.6885426 524344.5625 4.55729 942.5405572
1048576 9.1 941.199519 943.9488563 1048711.75 9.128664 941.1066785
2097152 18.2 941.414434 943.9488563 2097477.234 18.23736 942.1612286
3145728 27.4 941.495829 940.5037874 3146242.719 27.369858 941.6936088
8 0 54.251656 #DIV/0!     #DIV/0!

Test 2

results here.

iperf web100
kbytes duration path_utilisation calc_utilisation kbytes duration calc_utilisation
65536 0.6 935.533578 873.8133333 65536
0.578471 906.3341118
131072 1.1 940.546352 953.2509091 131079.0703 1.140595 919.3732767
262144 2.3 940.103317 911.8052174 262183.5938 2.288801 916.4050304
524288 4.6 940.785955 911.8052174 524353.0469 4.568781 918.1495841
1048576 9.1 941.269032 921.8250549 1048819.219 9.117357 920.2835591
2097152 18.2 941.422843 921.8250549 2097420.672 18.238268 920.0087078
3145728 27.4 941.477908 918.4607299 3146118.281 27.370833 919.5535353
8 0 51.240031 #DIV/0!      

Test 3

results here.

iperf web100
kbytes duration path_utilisation calc_utilisation kbytes duration calc_utilisation
65536 0.6 939.807918 873.8133333 65541.65625 0.571127 918.0676977
131072 1.1 940.646876 953.2509091 131074.8281 1.140363 919.5305574
262144 2.3 940.784924 911.8052174 262170.8672 2.277552 920.8865209
524288 4.6 940.832323 911.8052174 524401.125 4.568607 918.2687414
1048576 9.1 941.209007 921.8250549 1048707.508 9.117814 920.1394175
2097152 18.2 941.408811 921.8250549 2097542.281 18.238179 920.0665401
3145728 27.4 941.474984 918.4607299 3146213.023 27.368005 919.6762492
8 0 52.89427 #DIV/0!      

summarising these results:

reading iperf raw iperf calc web100 raw/calc calc/web100 calc/web100
1 939.807918 873.8133333 918.0676977   1.075524809 1.023680411 0.951796186
2 940.646876 953.2509091 919.5305574   0.986777843 1.022964238 1.036671268
3 940.784924 911.8052174 920.8865209   1.031782782 1.021607877 0.990138521
4 940.832323 911.8052174 918.2687414   1.031834766 1.024571872 0.992961185
5 941.209007 921.8250549 920.1394175   1.021027799 1.022898258 1.001831937
6 941.408811 921.8250549 920.0665401   1.021244547 1.023196443 1.001911291
7 941.474984 918.4607299 919.6762492   1.025057418 1.023702618 0.998678318
8 935.533578 873.8133333 906.3341118   1.070633215 1.03221711 0.964118333
9 940.546352 953.2509091 919.3732767   0.986672389 1.023029901 1.036848616
10 940.103317 911.8052174 916.4050304   1.031035246 1.025860057 0.99498059
11 940.785955 911.8052174 918.1495841   1.031783913 1.024654339 0.993090051
12 941.269032 921.8250549 920.2835591   1.021092915 1.022803268 1.001675023
13 941.422843 921.8250549 920.0087078   1.021259769 1.023276014 1.001974272
14 941.477908 918.4607299 919.5535353   1.025060601 1.02384241 0.998811591
15 939.091175 894.7848533 963.4657322   1.049516173 0.974701169 0.928714767
16 940.584252 976.1289309 942.9868594   0.963586082 0.997452131 1.035145847
17 939.826838 933.6885426 938.3128467   1.006574243 1.001613525 0.995071682
18 941.001763 933.6885426 942.5405572   1.007832612 0.998367397 0.990608346
19 941.199519 943.9488563 941.1066785   0.997087409 1.00009865 1.003020038
20 941.414434 943.9488563 942.1612286   0.997315085 0.99920736 1.001897369
21 941.495829 940.5037874 941.6936088   1.001054798 0.999789974 0.998736509
   
   
        ave 1.016983082 1.005433732 0.996127702
        stdev 0.026669506 0.01474472 0.02517841

It seems like on average, the reported values (iperf raw) is, on average, higher than that reported by iperf by about 0.5% - with quite a high deviation. The difference between the raw iperf value and the calculated can be attributed to the inaccurate measure/display of the test duration - although from the above results, to one decimal place, the reported duration is accurate. There also seems to be some discripency regarding the actual amonut of data that is being transfered - with a 4gb transfer sending out (according to web100) about 500 bytes more than specified. It is worth noting that this is actually a very small amount.

However, it does show that the results between the recorded iperf results and results collated with web100 are not wholly consistent, and that iperf can seem to over predict the value of path utilisatio by upto 30 out of 900mb/sec, ie about 3%.

I am currently running iperf tests with web100 passive monitoring on GridNM.

 

Run 2

For various test durations that exceed sending 4gb of data, we monitor the amount of data sent into the network with web100.

 

 

Wed, 23 July, 2003 13:07 Previous PageNext Page
 
 
    email me!
© 2001-2003, Yee-Ting Li, email: ytl@hep.ucl.ac.uk, Tel: +44 (0) 20 7679 1376, Fax: +44 (0) 20 7679 7145
Room D14, High Energy Particle Physics, Dept. of Physics & Astronomy, UCL, Gower St, London, WC1E 6BT