Vision & Roadmap

D-Cube is one of the outcomes of the IoTBench initiative gathering academics and industrial practitioners from the low-power wireless networking community towards a better evaluation and comparison of the performance of low-power wireless communication protocols. As an increasing number of IoT systems imposing strict dependability requirements on network performance is being developed and commercialized, the demand for dependable communication protocols delivering information in a reliable, efficient, and timely manner is raising. In response to this need, many low-power wireless protocols have been proposed by both industry and academia over the last decade. However, the lack of a standardized methodology to evaluate protocol performance often leads to a high divergence across experimental setups, which makes it hard, if not impossible, to compare results obtained by different authors (more info). As a consequence, there is an increasing need to rigorously benchmark low-power wireless systems under the exact same settings.

To address this issue, we have started in 2016 the EWSN Dependability Competition Series as a first attempt to rigorously benchmark the performance of low-power wireless systems in harsh RF environments. To support the competition, we have created D-Cube, a benchmarking infrastructure that allows to accurately measure key dependability metrics such as end-to-end delay, reliability, and power consumption, as well as to graphically visualize their evolution in real-time.

Across the years, D-Cube’s hardware, software, and back-end has been [and enriched] with features enabling an automatic benchmarking of protocol performance in order to support the following editions of the EWSN dependability competition. These features include binary patching to decouple the traffic pattern and node identities from the firmware under test, as well as the ability to generate reproducible Wi-Fi interference (more info).