Vision & Roadmap - Revision history

Carlo at 17:35, 25 November 2019

2019-11-25T17:35:27Z

Carlo at 15:25, 15 November 2019

2019-11-15T15:25:08Z

Carlo at 16:44, 10 November 2019

2019-11-10T16:44:33Z

Carlo at 00:32, 10 November 2019

2019-11-10T00:32:39Z

Carlo at 00:14, 10 November 2019

2019-11-10T00:14:16Z

Carlo at 00:13, 10 November 2019

2019-11-10T00:13:16Z

Carlo at 23:46, 9 November 2019

2019-11-09T23:46:32Z

Carlo at 23:46, 9 November 2019

2019-11-09T23:46:11Z

Carlo at 23:03, 9 November 2019

2019-11-09T23:03:03Z

Carlo at 23:02, 9 November 2019

2019-11-09T23:02:41Z

← Older revision		Revision as of 17:35, 25 November 2019
Line 12:		Line 12:

	<br/>		<br/>
−	In ~~2020~~, we have ~~decided to decouple~~ the availability of D-Cube from the dependability competition, i.e., the testbed facility is available (in a best-effort fashion) to any team that is willing to benchmark the performance of its solutions also beyond the timespan of the EWSN contest. In other words, D-Cube becomes a low-power wireless benchmark open to the community as a common yardstick to compare the performance of various protocols, as well as a way to raise the bar in the quality of networking experiments. We believe that D-Cube can be a useful tool to provide researchers and engineers in both academia and industry with an objective view and quantitative understanding of the strengths and weaknesses among existing protocols. For more information about how to use D-Cube, please refer to [[Testbed Access\|this page]].	+	In November 2019, we have decoupled the availability of D-Cube from the dependability competition, i.e., the testbed facility is available (in a best-effort fashion) to any team that is willing to benchmark the performance of its solutions also beyond the timespan of the EWSN contest. In other words, D-Cube becomes a low-power wireless benchmark open to the community as a common yardstick to compare the performance of various protocols, as well as a way to raise the bar in the quality of networking experiments. We believe that D-Cube can be a useful tool to provide researchers and engineers in both academia and industry with an objective view and quantitative understanding of the strengths and weaknesses among existing protocols. For more information about how to use D-Cube, please refer to [[Testbed Access\|this page]].

@@ Line 2: / Line 2: @@
 {|
 |D-Cube is one of the outcomes of the [https://www.iotbench.ethz.ch/ IoTBench initiative] gathering academics and industrial practitioners from the low-power wireless networking community towards a better evaluation and comparison of the performance of low-power wireless communication protocols.
-As an increasing number of IoT systems imposing strict dependability requirements on network performance is being developed and commercialized, the demand for dependable communication protocols delivering information in a reliable, efficient, and timely manner is raising. In response to this need, many low-power wireless protocols have been proposed by both industry and academia over the last decade. However, the lack of a standardized methodology to evaluate protocol performance often leads to a high divergence across experimental setups, which makes it hard, if not impossible, to compare results obtained by different authors. As a consequence, there is an [https://home.deib.polimi.it/mottola/papers/boano18bench.pdf increasing need to rigorously benchmark low-power wireless systems under the exact same settings].
+As an increasing number of IoT systems imposing strict dependability requirements on network performance is being developed and commercialized, the demand for dependable communication protocols delivering information in a reliable, efficient, and timely manner is raising. In response to this need, many low-power wireless protocols have been proposed by both industry and academia over the last decade. However, the lack of a standardized methodology to evaluate protocol performance often leads to a high divergence across experimental setups, which makes it hard, if not impossible, to compare results obtained by different authors. As a consequence, there is an [http://www.carloalbertoboano.com/documents/boano18benchmark.pdf increasing need to rigorously benchmark low-power wireless systems under the exact same settings].
 |[[File:empty.png|left|275px]]
 |[[File:Logo_iotbench.png|875px|right]]

← Older revision		Revision as of 16:44, 10 November 2019
Line 12:		Line 12:

	<br/>		<br/>
−	In 2020, we have decided to decouple the availability of D-Cube from the dependability competition, i.e., the testbed facility is available (in a best-effort fashion) to any team that is willing to benchmark the performance of its solutions also beyond the timespan of the EWSN contest. In other words, D-Cube becomes a low-power wireless benchmark open to the community as a common yardstick to compare the performance of various protocols, as well as a way to raise the bar in the quality of networking experiments. We believe that D-Cube can be a useful tool to provide researchers and engineers in both academia and industry with an objective view and quantitative understanding of the strengths and weaknesses among existing protocols. For more information about how to use D-Cube, please refer to ~~the~~ [[~~General Policy~~\|~~general policy~~ page]].	+	In 2020, we have decided to decouple the availability of D-Cube from the dependability competition, i.e., the testbed facility is available (in a best-effort fashion) to any team that is willing to benchmark the performance of its solutions also beyond the timespan of the EWSN contest. In other words, D-Cube becomes a low-power wireless benchmark open to the community as a common yardstick to compare the performance of various protocols, as well as a way to raise the bar in the quality of networking experiments. We believe that D-Cube can be a useful tool to provide researchers and engineers in both academia and industry with an objective view and quantitative understanding of the strengths and weaknesses among existing protocols. For more information about how to use D-Cube, please refer to [[Testbed Access\|this page]].

@@ Line 9: / Line 9: @@
 To address this issue, we have started a [https://iot.ieee.org/newsletter/march-2017/ewsn-dependability-competition-experiences-and-lessons-learned Dependability Competition Series] as a first attempt to rigorously benchmark the performance of low-power wireless systems under the same settings in harsh RF environments. To support the competition, we have created D-Cube, a benchmarking infrastructure that allows to accurately measure key dependability metrics such as end-to-end delay, reliability, and power consumption, as well as to graphically visualize their evolution in real-time. The dependability competition has been co-located with the International Conference on Embedded Wireless Systems and Networks in [http://ewsn2016.tugraz.at/cms/index.php%3Fid=49.html 2016], [http://ewsn2017.it.uu.se/dependability-competition1.html 2017], [https://ewsn2018.networks.imdea.org/competition-program.html 2018], and [http://ewsn2019.thss.tsinghua.edu.cn/call-for-competitors.html 2019].
-Across the years, D-Cube’s hardware, software, and backend has been [http://www.carloalbertoboano.com/documents/schuss18benchmark.pdf upgraded and enriched] with features enabling a remote evaluation of protocol performance. These features include binary patching to decouple the traffic pattern and node identities from the firmware under test, an improved power and GPIO profiling unit, an automated computation of the performance metrics, as well as the ability to generate reproducible interference using off-the-shelf Wi-Fi devices [[Special Features|(more info)]].
+Across the years, D-Cube’s hardware, software, and backend has been [http://www.carloalbertoboano.com/documents/schuss18benchmark.pdf upgraded and enriched] with features enabling a remote evaluation of protocol performance. These features include binary patching to decouple the traffic pattern and node identities from the firmware under test, an improved power and GPIO profiling unit, an automated computation of the performance metrics, as well as the ability to generate reproducible interference using off-the-shelf Wi-Fi devices ([[Special Features|more info]]).
 <br/>
 In 2020, we have decided to decouple the availability of D-Cube from the dependability competition, i.e., the testbed facility is available (in a best-effort fashion) to any team that is willing to benchmark the performance of its solutions also beyond the timespan of the EWSN contest. In other words, D-Cube becomes a low-power wireless benchmark open to the community as a common yardstick to compare the performance of various protocols, as well as a way to raise the bar in the quality of networking experiments. We believe that D-Cube can be a useful tool to provide researchers and engineers in both academia and industry with an objective view and quantitative understanding of the strengths and weaknesses among existing protocols. For more information about how to use D-Cube, please refer to the [[General Policy|general policy page]].

@@ Line 9: / Line 9: @@
 To address this issue, we have started a [https://iot.ieee.org/newsletter/march-2017/ewsn-dependability-competition-experiences-and-lessons-learned Dependability Competition Series] as a first attempt to rigorously benchmark the performance of low-power wireless systems under the same settings in harsh RF environments. To support the competition, we have created D-Cube, a benchmarking infrastructure that allows to accurately measure key dependability metrics such as end-to-end delay, reliability, and power consumption, as well as to graphically visualize their evolution in real-time. The dependability competition has been co-located with the International Conference on Embedded Wireless Systems and Networks in [http://ewsn2016.tugraz.at/cms/index.php%3Fid=49.html 2016], [http://ewsn2017.it.uu.se/dependability-competition1.html 2017], [https://ewsn2018.networks.imdea.org/competition-program.html 2018], and [http://ewsn2019.thss.tsinghua.edu.cn/call-for-competitors.html 2019].
-Across the years, D-Cube’s hardware, software, and backend has been [http://www.carloalbertoboano.com/documents/schuss18benchmark.pdf upgraded and enriched] with features enabling a remote evaluation of protocol performance. These features include binary patching to decouple the traffic pattern and node identities from the firmware under test, an improved power and GPIO profiling unit, an automated computation of the performance metrics, as well as the ability to generate reproducible interference using off-the-shelf Wi-Fi devices [[Testbed Capabilities|(more info)]].
+Across the years, D-Cube’s hardware, software, and backend has been [http://www.carloalbertoboano.com/documents/schuss18benchmark.pdf upgraded and enriched] with features enabling a remote evaluation of protocol performance. These features include binary patching to decouple the traffic pattern and node identities from the firmware under test, an improved power and GPIO profiling unit, an automated computation of the performance metrics, as well as the ability to generate reproducible interference using off-the-shelf Wi-Fi devices [[Special Features|(more info)]].
 <br/>
 In 2020, we have decided to decouple the availability of D-Cube from the dependability competition, i.e., the testbed facility is available (in a best-effort fashion) to any team that is willing to benchmark the performance of its solutions also beyond the timespan of the EWSN contest. In other words, D-Cube becomes a low-power wireless benchmark open to the community as a common yardstick to compare the performance of various protocols, as well as a way to raise the bar in the quality of networking experiments. We believe that D-Cube can be a useful tool to provide researchers and engineers in both academia and industry with an objective view and quantitative understanding of the strengths and weaknesses among existing protocols. For more information about how to use D-Cube, please refer to the [[General Policy|general policy page]].

← Older revision		Revision as of 23:46, 9 November 2019
Line 11:		Line 11:
	Across the years, D-Cube’s hardware, software, and backend has been [http://www.carloalbertoboano.com/documents/schuss18benchmark.pdf upgraded and enriched] with features enabling a remote evaluation of protocol performance. These features include binary patching to decouple the traffic pattern and node identities from the firmware under test, an improved power and GPIO profiling unit, an automated computation of the performance metrics, as well as the ability to generate reproducible interference using off-the-shelf Wi-Fi devices [[testbed capabilities\|(more info)]].		Across the years, D-Cube’s hardware, software, and backend has been [http://www.carloalbertoboano.com/documents/schuss18benchmark.pdf upgraded and enriched] with features enabling a remote evaluation of protocol performance. These features include binary patching to decouple the traffic pattern and node identities from the firmware under test, an improved power and GPIO profiling unit, an automated computation of the performance metrics, as well as the ability to generate reproducible interference using off-the-shelf Wi-Fi devices [[testbed capabilities\|(more info)]].

		+	<br/>
	In 2020, we have decided to decouple the availability of D-Cube from the dependability competition, i.e., the testbed facility is available (in a best-effort fashion) to any team that is willing to benchmark the performance of its solutions also beyond the timespan of the EWSN contest. In other words, D-Cube becomes a low-power wireless benchmark open to the community as a common yardstick to compare the performance of various protocols, as well as a way to raise the bar in the quality of networking experiments. We believe that D-Cube can be a useful tool to provide researchers and engineers in both academia and industry with an objective view and quantitative understanding of the strengths and weaknesses among existing protocols. For more information about how to use D-Cube, please refer to the [[general policy\|general policy page]].		In 2020, we have decided to decouple the availability of D-Cube from the dependability competition, i.e., the testbed facility is available (in a best-effort fashion) to any team that is willing to benchmark the performance of its solutions also beyond the timespan of the EWSN contest. In other words, D-Cube becomes a low-power wireless benchmark open to the community as a common yardstick to compare the performance of various protocols, as well as a way to raise the bar in the quality of networking experiments. We believe that D-Cube can be a useful tool to provide researchers and engineers in both academia and industry with an objective view and quantitative understanding of the strengths and weaknesses among existing protocols. For more information about how to use D-Cube, please refer to the [[general policy\|general policy page]].

← Older revision		Revision as of 23:46, 9 November 2019
Line 9:		Line 9:
	To address this issue, we have started a [https://iot.ieee.org/newsletter/march-2017/ewsn-dependability-competition-experiences-and-lessons-learned Dependability Competition Series] as a first attempt to rigorously benchmark the performance of low-power wireless systems under the same settings in harsh RF environments. To support the competition, we have created D-Cube, a benchmarking infrastructure that allows to accurately measure key dependability metrics such as end-to-end delay, reliability, and power consumption, as well as to graphically visualize their evolution in real-time. The dependability competition has been co-located with the International Conference on Embedded Wireless Systems and Networks in [http://ewsn2016.tugraz.at/cms/index.php%3Fid=49.html 2016], [http://ewsn2017.it.uu.se/dependability-competition1.html 2017], [https://ewsn2018.networks.imdea.org/competition-program.html 2018], and [http://ewsn2019.thss.tsinghua.edu.cn/call-for-competitors.html 2019].		To address this issue, we have started a [https://iot.ieee.org/newsletter/march-2017/ewsn-dependability-competition-experiences-and-lessons-learned Dependability Competition Series] as a first attempt to rigorously benchmark the performance of low-power wireless systems under the same settings in harsh RF environments. To support the competition, we have created D-Cube, a benchmarking infrastructure that allows to accurately measure key dependability metrics such as end-to-end delay, reliability, and power consumption, as well as to graphically visualize their evolution in real-time. The dependability competition has been co-located with the International Conference on Embedded Wireless Systems and Networks in [http://ewsn2016.tugraz.at/cms/index.php%3Fid=49.html 2016], [http://ewsn2017.it.uu.se/dependability-competition1.html 2017], [https://ewsn2018.networks.imdea.org/competition-program.html 2018], and [http://ewsn2019.thss.tsinghua.edu.cn/call-for-competitors.html 2019].

−	Across the years, D-Cube’s hardware, software, and backend has been [http://www.carloalbertoboano.com/documents/schuss18benchmark.pdf upgraded and enriched] with features enabling a remote evaluation of protocol performance. These features include binary patching to decouple the traffic pattern and node identities from the firmware under test, an improved power and GPIO profiling unit, an automated computation of the performance metrics, as well as the ability to generate reproducible interference using off-the-shelf Wi-Fi devices [[testbed capabilities\|(more info)]].	+	Across the years, D-Cube’s hardware, software, and backend has been [http://www.carloalbertoboano.com/documents/schuss18benchmark.pdf upgraded and enriched] with features enabling a remote evaluation of protocol performance. These features include binary patching to decouple the traffic pattern and node identities from the firmware under test, an improved power and GPIO profiling unit, an automated computation of the performance metrics, as well as the ability to generate reproducible interference using off-the-shelf Wi-Fi devices [[testbed capabilities\|(more info)]].
		+
		+	In 2020, we have decided to decouple the availability of D-Cube from the dependability competition, i.e., the testbed facility is available (in a best-effort fashion) to any team that is willing to benchmark the performance of its solutions also beyond the timespan of the EWSN contest. In other words, D-Cube becomes a low-power wireless benchmark open to the community as a common yardstick to compare the performance of various protocols, as well as a way to raise the bar in the quality of networking experiments. We believe that D-Cube can be a useful tool to provide researchers and engineers in both academia and industry with an objective view and quantitative understanding of the strengths and weaknesses among existing protocols. For more information about how to use D-Cube, please refer to the [[general policy\|general policy page]].

← Older revision		Revision as of 23:03, 9 November 2019
Line 9:		Line 9:
	To address this issue, we have started a [https://iot.ieee.org/newsletter/march-2017/ewsn-dependability-competition-experiences-and-lessons-learned Dependability Competition Series] as a first attempt to rigorously benchmark the performance of low-power wireless systems under the same settings in harsh RF environments. To support the competition, we have created D-Cube, a benchmarking infrastructure that allows to accurately measure key dependability metrics such as end-to-end delay, reliability, and power consumption, as well as to graphically visualize their evolution in real-time. The dependability competition has been co-located with the International Conference on Embedded Wireless Systems and Networks in [http://ewsn2016.tugraz.at/cms/index.php%3Fid=49.html 2016], [http://ewsn2017.it.uu.se/dependability-competition1.html 2017], [https://ewsn2018.networks.imdea.org/competition-program.html 2018], and [http://ewsn2019.thss.tsinghua.edu.cn/call-for-competitors.html 2019].		To address this issue, we have started a [https://iot.ieee.org/newsletter/march-2017/ewsn-dependability-competition-experiences-and-lessons-learned Dependability Competition Series] as a first attempt to rigorously benchmark the performance of low-power wireless systems under the same settings in harsh RF environments. To support the competition, we have created D-Cube, a benchmarking infrastructure that allows to accurately measure key dependability metrics such as end-to-end delay, reliability, and power consumption, as well as to graphically visualize their evolution in real-time. The dependability competition has been co-located with the International Conference on Embedded Wireless Systems and Networks in [http://ewsn2016.tugraz.at/cms/index.php%3Fid=49.html 2016], [http://ewsn2017.it.uu.se/dependability-competition1.html 2017], [https://ewsn2018.networks.imdea.org/competition-program.html 2018], and [http://ewsn2019.thss.tsinghua.edu.cn/call-for-competitors.html 2019].

−	Across the years, D-Cube’s hardware, software, and backend has been [[http://www.carloalbertoboano.com/documents/schuss18benchmark.pdf\|upgraded and enriched]] with features enabling a remote evaluation of protocol performance. These features include binary patching to decouple the traffic pattern and node identities from the firmware under test, an improved power and GPIO profiling unit, an automated computation of the performance metrics, as well as the ability to generate reproducible interference using off-the-shelf Wi-Fi devices [[testbed capabilities\|(more info)]].	+	Across the years, D-Cube’s hardware, software, and backend has been [http://www.carloalbertoboano.com/documents/schuss18benchmark.pdf upgraded and enriched] with features enabling a remote evaluation of protocol performance. These features include binary patching to decouple the traffic pattern and node identities from the firmware under test, an improved power and GPIO profiling unit, an automated computation of the performance metrics, as well as the ability to generate reproducible interference using off-the-shelf Wi-Fi devices [[testbed capabilities\|(more info)]].

@@ Line 7: / Line 7: @@
 |}
-To address this issue, we have started the [https://iot.ieee.org/newsletter/march-2017/ewsn-dependability-competition-experiences-and-lessons-learned EWSN Dependability Competition Series] as a first attempt to rigorously benchmark the performance of low-power wireless systems under the same settings in harsh RF environments. To support the competition, we have created D-Cube, a benchmarking infrastructure that allows to accurately measure key dependability metrics such as end-to-end delay, reliability, and power consumption, as well as to graphically visualize their evolution in real-time. The dependability competition has been co-located with the International Conference on Embedded Wireless Systems and Networks in [http://ewsn2016.tugraz.at/cms/index.php%3Fid=49.html 2016], [http://ewsn2017.it.uu.se/dependability-competition1.html 2017], [https://ewsn2018.networks.imdea.org/competition-program.html 2018], and [http://ewsn2019.thss.tsinghua.edu.cn/call-for-competitors.html 2019].
+To address this issue, we have started a [https://iot.ieee.org/newsletter/march-2017/ewsn-dependability-competition-experiences-and-lessons-learned Dependability Competition Series] as a first attempt to rigorously benchmark the performance of low-power wireless systems under the same settings in harsh RF environments. To support the competition, we have created D-Cube, a benchmarking infrastructure that allows to accurately measure key dependability metrics such as end-to-end delay, reliability, and power consumption, as well as to graphically visualize their evolution in real-time. The dependability competition has been co-located with the International Conference on Embedded Wireless Systems and Networks in [http://ewsn2016.tugraz.at/cms/index.php%3Fid=49.html 2016], [http://ewsn2017.it.uu.se/dependability-competition1.html 2017], [https://ewsn2018.networks.imdea.org/competition-program.html 2018], and [http://ewsn2019.thss.tsinghua.edu.cn/call-for-competitors.html 2019].
 Across the years, D-Cube’s hardware, software, and backend has been [[http://www.carloalbertoboano.com/documents/schuss18benchmark.pdf|upgraded and enriched]] with features enabling a remote evaluation of protocol performance. These features include binary patching to decouple the traffic pattern and node identities from the firmware under test, an improved power and GPIO profiling unit, an automated computation of the performance metrics, as well as the ability to generate reproducible interference using off-the-shelf Wi-Fi devices [[testbed capabilities|(more info)]].