Results and Conclusions » History » Version 19
Version 18 (GAY, Adrien, 12/15/2014 10:32 PM) → Version 19/20 (GAY, Adrien, 12/15/2014 11:04 PM)
h1. Results
In this section we present and analyze some results as well as some conclusions.
h2. Link Emulation
In order to test performance of ACM and compare it to a CCM, we generated a file containing a time series of Es/N0 values. These ranged from 25dB to 2dB and formed both a descending and ascending phase. This means that the link's Es/N0 value starts descending from 25dB down to 2dB and ascending back to 25dB afterwards. This was done in 0.5dB increments which last 10 seconds each.
Performing this with the link emulator is quite easy since there is a software variant that allows for importing of time series. This is explained in the [[Link Emulation]] section. Since the ACM client (station) reports Es/N0 estimates to the ACM controller (HUB), we went ahead and compared both the emulation input as well as the reported values:
p=. !{width: 70%}1.png(.)!
Both overlap quite nicely although there seems to be some underestimation specially around 15dB. There also some spurious values which can lead to modcod parameters being changed quite rapidly.
tip. In order to reduce spurious modcod changes, it may be of interest to refer to fade prediction values in the ACM client configuration. These options, however, are not explained in the EL470 user manual.
We can also take a look at the modcod parameters:
notice. In the lab setup, maximum achievable modcod is 16APSK 8/9 while the minimum is QPSK 1/4.
p=. !{width: 70%}3.png(.)!
This is an interesting graph because it shows that in the event of degradations in link conditions, ACM responds by adjusting modulation and coding to best match performance. As we will see further on, in the case of CCM there is an outage and nothing can really be done until link conditions get better.
h2. UDP traffic
As stated in [[Measuring Tools and Scripts]] Iperf generated traffic will only be UDP since at this point we are only interested in an estimation of available channel capacity. Due to their inherent delay in transmitting messages, satellite links have very adverse effects on the way certain transport protocols such as TCP behave. This leads to low channel utilization and thus TCP is of very little interest when we want to measure actual channel capacity. For more information on satellite links and its effects on TCP refer to "RFC2488: Enhancing TCP Over Satellite Channels using Standard Mechanisms":http://tools.ietf.org/html/rfc2488.
Now the question is what UDP datagram size to use and at what target bandwidth the HUB PC will generate traffic. Since modems are configured with a symbol rate of 512 Kbauds and the maximum achievable modulation scheme is 16APSK, an upper bound on achievable throughput is 512k x log ~2~ 16 = 2.048 Mbps. This is clearly the bottleneck since Ethernet communication between PCs and modem interfaces highly exceed this capacity. We tested this by generating traffic at 3Mbps with a UDP length of 8KB. However, results were not looking very good:
p=. !{width: 70%}0.png(.)!
The previous graph shows UDP throughput and the bitrate reported by the HUB modulator. Why weren't we getting a constant throughput? The answer is quite simple, generated UDP packets will be bigger than the link MTU and thus they will be fragmented in order to be sent. Since we are transmitting at a higher rate than the satellite link can handle, we will see losses in IP packets and throughput in the UDP layer will not be representative of channel capacity since the lower layer may discard packets for which fragments have not arrived.
To fix this, we resorted to generating UDP datagrams with a length of 1300B, this way we are under the MTU. We then proceeded run tests with ACM enabled. The first test will see modcod parameters vary according to the current Es/N0 as we saw previously. In addition to this test run, we also performed a few runs in CCM mode with different modulation and coding schemes.
notice. Running in ACM mode is mandatory since we need the ACM controller log values. However, CCM can be emulated by setting minimum and maximum modcod to the same value in the ACM controller configuration.
For CCM, 16APSK 3/4, 8PSK 3/4 and QPSK 3/4 were chosen. In the following graph we can see UDP throughput for all 4 tests. Note that CCM test runs only contain the descending portion of the time series, this is because after a certain value of Es/N0 throughput drops to zero.
p=. !{width: 70%}2.png(.)!
By removing time dependency we can plot previous values against channel conditions.
p=. !{width: 60%}4.png(.)! !{width: 60%}5.png(.)!
The hysterisis phenomenon described in section [[FlexACM]] can be clearly identified in the first graph above by comparing the ascending and descending phases of the channel emulation. If we take a look at the second graph, we can see that at some points CCM has a better throughput than ACM. While this may well be, considering throughput as the only metric to evaluate performance does not take into account the packet error rate(PER) which might be higher than the required QEF (quasi-error-free) working point by DVB-S2 (10 ^-5^ ). This is in fact what ACM seeks to do, it changes modulation and coding dynamically to ensure a certain QEF target. below.
p=. !{width: 60%}4.png(.)! !{width: 60%}5.png(.)!
h1. Conclusions
In this project, analysis on the performance of ACM in DVB-S2 was carried out. The tests performed on our setup have provided us with results that highlight the importance of ACM in DVB-S2 as well as the potential for future satellite systems. ACM improves spectral efficiency substantially when favorable link conditions occur and link availability is also improved with respect to CCM. All of this is of paramount importance in satellite systems and ACM provides designers with more flexibity. We must note also that in order for ACM to function optimally, we must have a reliable Es/N0 estimator on the terminal.
Our work has also shown the potential of software defined radio (SDR) platforms as means of channel emulation. SDR based link emulation provides a reliable testing environment for satellite links with very limited costs with respect to available off the shelf hardware solutions which typically cost well over 100K€. Its advantages are more than obvious in the academic world where institutions do not have the same financial means as their industrial counterparts.
In this section we present and analyze some results as well as some conclusions.
h2. Link Emulation
In order to test performance of ACM and compare it to a CCM, we generated a file containing a time series of Es/N0 values. These ranged from 25dB to 2dB and formed both a descending and ascending phase. This means that the link's Es/N0 value starts descending from 25dB down to 2dB and ascending back to 25dB afterwards. This was done in 0.5dB increments which last 10 seconds each.
Performing this with the link emulator is quite easy since there is a software variant that allows for importing of time series. This is explained in the [[Link Emulation]] section. Since the ACM client (station) reports Es/N0 estimates to the ACM controller (HUB), we went ahead and compared both the emulation input as well as the reported values:
p=. !{width: 70%}1.png(.)!
Both overlap quite nicely although there seems to be some underestimation specially around 15dB. There also some spurious values which can lead to modcod parameters being changed quite rapidly.
tip. In order to reduce spurious modcod changes, it may be of interest to refer to fade prediction values in the ACM client configuration. These options, however, are not explained in the EL470 user manual.
We can also take a look at the modcod parameters:
notice. In the lab setup, maximum achievable modcod is 16APSK 8/9 while the minimum is QPSK 1/4.
p=. !{width: 70%}3.png(.)!
This is an interesting graph because it shows that in the event of degradations in link conditions, ACM responds by adjusting modulation and coding to best match performance. As we will see further on, in the case of CCM there is an outage and nothing can really be done until link conditions get better.
h2. UDP traffic
As stated in [[Measuring Tools and Scripts]] Iperf generated traffic will only be UDP since at this point we are only interested in an estimation of available channel capacity. Due to their inherent delay in transmitting messages, satellite links have very adverse effects on the way certain transport protocols such as TCP behave. This leads to low channel utilization and thus TCP is of very little interest when we want to measure actual channel capacity. For more information on satellite links and its effects on TCP refer to "RFC2488: Enhancing TCP Over Satellite Channels using Standard Mechanisms":http://tools.ietf.org/html/rfc2488.
Now the question is what UDP datagram size to use and at what target bandwidth the HUB PC will generate traffic. Since modems are configured with a symbol rate of 512 Kbauds and the maximum achievable modulation scheme is 16APSK, an upper bound on achievable throughput is 512k x log ~2~ 16 = 2.048 Mbps. This is clearly the bottleneck since Ethernet communication between PCs and modem interfaces highly exceed this capacity. We tested this by generating traffic at 3Mbps with a UDP length of 8KB. However, results were not looking very good:
p=. !{width: 70%}0.png(.)!
The previous graph shows UDP throughput and the bitrate reported by the HUB modulator. Why weren't we getting a constant throughput? The answer is quite simple, generated UDP packets will be bigger than the link MTU and thus they will be fragmented in order to be sent. Since we are transmitting at a higher rate than the satellite link can handle, we will see losses in IP packets and throughput in the UDP layer will not be representative of channel capacity since the lower layer may discard packets for which fragments have not arrived.
To fix this, we resorted to generating UDP datagrams with a length of 1300B, this way we are under the MTU. We then proceeded run tests with ACM enabled. The first test will see modcod parameters vary according to the current Es/N0 as we saw previously. In addition to this test run, we also performed a few runs in CCM mode with different modulation and coding schemes.
notice. Running in ACM mode is mandatory since we need the ACM controller log values. However, CCM can be emulated by setting minimum and maximum modcod to the same value in the ACM controller configuration.
For CCM, 16APSK 3/4, 8PSK 3/4 and QPSK 3/4 were chosen. In the following graph we can see UDP throughput for all 4 tests. Note that CCM test runs only contain the descending portion of the time series, this is because after a certain value of Es/N0 throughput drops to zero.
p=. !{width: 70%}2.png(.)!
By removing time dependency we can plot previous values against channel conditions.
p=. !{width: 60%}4.png(.)! !{width: 60%}5.png(.)!
The hysterisis phenomenon described in section [[FlexACM]] can be clearly identified in the first graph above by comparing the ascending and descending phases of the channel emulation. If we take a look at the second graph, we can see that at some points CCM has a better throughput than ACM. While this may well be, considering throughput as the only metric to evaluate performance does not take into account the packet error rate(PER) which might be higher than the required QEF (quasi-error-free) working point by DVB-S2 (10 ^-5^ ). This is in fact what ACM seeks to do, it changes modulation and coding dynamically to ensure a certain QEF target. below.
p=. !{width: 60%}4.png(.)! !{width: 60%}5.png(.)!
h1. Conclusions
In this project, analysis on the performance of ACM in DVB-S2 was carried out. The tests performed on our setup have provided us with results that highlight the importance of ACM in DVB-S2 as well as the potential for future satellite systems. ACM improves spectral efficiency substantially when favorable link conditions occur and link availability is also improved with respect to CCM. All of this is of paramount importance in satellite systems and ACM provides designers with more flexibity. We must note also that in order for ACM to function optimally, we must have a reliable Es/N0 estimator on the terminal.
Our work has also shown the potential of software defined radio (SDR) platforms as means of channel emulation. SDR based link emulation provides a reliable testing environment for satellite links with very limited costs with respect to available off the shelf hardware solutions which typically cost well over 100K€. Its advantages are more than obvious in the academic world where institutions do not have the same financial means as their industrial counterparts.