Competitive Mobile Broadband
Performance Research
Access Network Department
Vip mobile d.o.o.
Vip mobile d.o.o., Omladinskih brigada 21, 11070 Belgrade, Serbia, Tel +381 11 225 3333, Fax +381 11 225 3334
www.vipmobile.rs, MB: 20220023, PIB: 104704549
The measurement of the service quality of mobile operators
In the Republic of Serbia, in the period from 16 September to 14 October 2011, a measurement
of the service quality of mobile operators was undertaken. The aim of this paper is to inform the
public about the results of those measurements.
The measurements were carried out by a team of Vip Mobile Network Optimization and Quality
Engineers based on an autonomous drive test system, TEMS Automatic, developed by ASCOM.
The equipment consisted of three identical, independent Radio Test Units (“RTU”), each of which
was used to measure the quality of one mobile operator, MTS, Telenor or Vip. Each RTU had two
SIM cards corresponding to the measured operator. One SIM card was used to measure the
quality of the voice service, and the other to measure the quality of the data services.
The measurements were designed to simulate the behaviour of users as closely as possible. The
work orders were defined independently for the voice and data services. In the case of the voice
testing, the RTU was configured to perform mobile originated, and to receive mobile terminated,
calls to and from a landline number connected to the stationary part of the TEMS automatic
system. The call duration was a hundred seconds, which statistically corresponded to an average
call length in Serbia. For measuring the quality of the data service, the system was configured to
perform five pings (ICMP test). Subsequently, one FTP download of 3MB file size, corresponding
to a download average of an mp3 file from the Internet, was conducted. As the final step, an FTP
upload of 1MB file size, corresponding to sending an average picture size, was carried out.
The measurement campaign was performed in the 17 largest cities in Serbia (Belgrade, Novi
Sad, Nis, Kragujevac, Subotica, Zrenjanin, Pancevo, Cacak, Leskovac, Smederevo, Valjevo,
Kraljevo, Krusevac, Sabac, Vranje, Novi Sad, Sombor). According to the 2002 census, the
population in the 17 measured cities was 33.1% of the total population of Serbia, reflecting a
large sample, resulting in reliable results regarding the quality of the mobile services. In addition
to the above-mentioned cities, the measurements were conducted to include all highways,
important regional roads and some additional access
roads to those sites. The measurements were carried out on a stationary (the nomadic use of
Mobile Broadband) and drive tests bases. The drive test applied only to the roads. The routes in
the cities were carefully selected in order to have measurements equally distributed in all parts of
the cities, which enabled a representation of the quality of service as closely as possible to the
user.
Vip mobile d.o.o., Omladinskih brigada 21, 11070 Belgrade, Serbia, Tel +381 11 225 3333, Fax +381 11 225 3334
www.vipmobile.rs, MB: 20220023, PIB: 104704549
Measured routes
Vip mobile d.o.o., Omladinskih brigada 21, 11070 Belgrade, Serbia, Tel +381 11 225 3333, Fax +381 11 225 3334
www.vipmobile.rs, MB: 20220023, PIB: 104704549
Measurement results – voice service
Average
PESQ
Block Call
[%]
Drop Call
[%]
Call Setup
Time [sec]
Handover
Success Rate [%]
Serbia
3.90
1.23
0.44
3.69
99.51
Nis
3.93
0.00
0.00
3.51
100.00
Novi Sad
3.90
1.52
0.00
3.67
100.00
Belgrade
3.94
1.19
0.48
3.65
100.00
Kragujevac
3.89
0.00
0.00
4.09
98.11
Other cities + roads
3.88
1.33
0.55
3.69
99.45
Serbia
3.90
1.60
0.49
3.31
97.52
Nis
3.81
1.69
0.00
3.53
100.00
Novi Sad
3.92
2.14
0.55
3.14
98.59
Belgrade
3.89
0.73
1.23
3.14
99.43
Kragujevac
3.90
6.78
0.00
3.39
96.97
Other cities + roads
3.91
1.55
0.27
3.38
96.65
Serbia
3.85
2.03
0.65
4.01
98.93
Nis
3.81
0.00
1.72
4.13
100.00
Novi Sad
3.84
4.71
2.75
4.06
97.25
Belgrade
3.89
0.72
0.24
4.01
99.54
Kragujevac
3.81
0.00
0.00
4.20
100.00
Other cities + roads
3.85
2.25
0.43
3.99
99.37
Vip
Tln
mt:s
Vip mobile d.o.o., Omladinskih brigada 21, 11070 Belgrade, Serbia, Tel +381 11 225 3333, Fax +381 11 225 3334
www.vipmobile.rs, MB: 20220023, PIB: 104704549
Average PESQ
3.90
Block Call [%]
3.90
2.03
1.60
3.85
VIP
Tln
mt:s
Drop Call [%]
1.23
VIP
Tln
mt:s
Handover Success Rate [%]
0.65
99.51
0.44
0.49
98.93
97.52
VIP
Tln
mt:s
VIP
Tln
Vip mobile d.o.o., Omladinskih brigada 21, 11070 Belgrade, Serbia, Tel +381 11 225 3333, Fax +381 11 225 3334
www.vipmobile.rs, MB: 20220023, PIB: 104704549
mt:s
Call Setup Time [sec]
3.69
VIP
4.01
3.31
Tln
mt:s
Measurement results – data services
FTP DL Mean
Throughput
[Mbps]
Vip
Serbia
Nis
Novi Sad
Belgrade
Kragujevac
Other cities + roads
Tln
Serbia
Nis
Novi Sad
Belgrade
Kragujevac
Other cities + roads
mt:s
Serbia
Nis
Novi Sad
Belgrade
Kragujevac
Other cities + roads
FTP UL Mean
Throughput
[Mbps]
Average
Round Trip
Time [msec]
PS Data
Transfer Cutoff
Ratio [%]
PS Service
Access
Time [sec]
PS
Session
Time
[sec]
5,983
5,738
5,402
6,610
6,350
5,802
2,053
2,163
1,921
2,257
2,048
1,978
100
55
94
67
184
115
4.23
1.33
2.30
1.19
2.70
6.32
2.45
3.27
2.93
2.44
2.42
2.31
11.67
5.46
5.56
4.59
5.00
17.04
4,507
2,407
4,662
5,966
2,640
4,019
1,389
283
1,798
2,122
282
1,092
145
153
161
62
204
176
5.15
2.70
3.11
1.99
3.08
7.22
2.04
1.83
2.29
2.22
1.74
1.94
14.03
21.16
8.29
4.99
22.77
18.44
1,642
1,753
1,697
1,680
1,443
1,624
452
684
428
330
418
480
355
164
457
379
274
346
5.50
1.35
7.61
9.20
3.70
4.36
1.55
.71
3.00
2.29
.94
1.18
22.27
15.43
21.38
26.16
24.48
21.52
Vip mobile d.o.o., Omladinskih brigada 21, 11070 Belgrade, Serbia, Tel +381 11 225 3333, Fax +381 11 225 3334
www.vipmobile.rs, MB: 20220023, PIB: 104704549
FTP DL Mean Throughput
[Mbps]
6
FTP UL Mean Throughput
[Mbps]
2.05
5
1.39
2
VIP
Tln
mt:s
Average Round Trip Time
[msec]
354.84
0.45
VIP
Tln
mt:s
PS Data Transfer Cutoff Ratio
[%]
5.15
5.50
4.23
144.75
100.25
VIP
Tln
mt:s
VIP
Tln
Vip mobile d.o.o., Omladinskih brigada 21, 11070 Belgrade, Serbia, Tel +381 11 225 3333, Fax +381 11 225 3334
www.vipmobile.rs, MB: 20220023, PIB: 104704549
mt:s
PS Session Time [sec]
PS Service Access Time [sec]
22.27
2.45
2.04
VIP
Tln
14.03
1.55
11.67
mt:s
VIP
Tln
Vip mobile d.o.o., Omladinskih brigada 21, 11070 Belgrade, Serbia, Tel +381 11 225 3333, Fax +381 11 225 3334
www.vipmobile.rs, MB: 20220023, PIB: 104704549
mt:s
Download

Competitive Mobile Broadband Performance Research