Vision & Roadmap

D-Cube is one of the outcomes of the IoTBench initiative gathering academics and industrial practitioners from the low-power wireless networking community towards a better evaluation and comparison of the performance of low-power wireless communication protocols. As an increasing number of IoT systems imposing strict dependability requirements on network performance is being developed and commercialized, the demand for dependable communication protocols delivering information in a reliable, efficient, and timely manner is raising. In response to this need, many low-power wireless protocols have been proposed by both industry and academia over the last decade. However, the lack of a standardized methodology to evaluate protocol performance often leads to a high divergence across experimental setups, which makes it hard, if not impossible, to compare results obtained by different authors. As a consequence, there is an increasing need to rigorously benchmark low-power wireless systems under the exact same settings.

To address this issue, we have started a Dependability Competition Series as a first attempt to rigorously benchmark the performance of low-power wireless systems under the same settings in harsh RF environments. To support the competition, we have created D-Cube, a benchmarking infrastructure that allows to accurately measure key dependability metrics such as end-to-end delay, reliability, and power consumption, as well as to graphically visualize their evolution in real-time. The dependability competition has been co-located with the International Conference on Embedded Wireless Systems and Networks in 2016, 2017, 2018, and 2019.

Across the years, D-Cube’s hardware, software, and backend has been [and enriched] with features enabling a remote evaluation of protocol performance. These features include binary patching to decouple the traffic pattern and node identities from the firmware under test, an improved power and GPIO profiling unit, an automated computation of the performance metrics, as well as the ability to generate reproducible interference using off-the-shelf Wi-Fi devices (more info).