Issues and Challenges
[Andel-Yansinac 2006 (doi) .]
Todd R. Andel, Alec Yasinac,
"On the Credibility of Manet Simulations",
IEEE Computer, vol.39, #7, July 2006, pp. 48-54
ResiliNets Keywords: simulation challenges
Keywords: manets; simulation; network architectures; wireless communications
Abstract: "Simulation is useful for evaluating protocol performance and operation. However, the lack of rigor with which it's applied threatens the credibility of the published research within the manet research community."
Notes: This paper highlights the issues involved in evaluating the performance of network protocols using simulations. While the paper presents specific instances of MANET simulations, the shortcomings illustrated do apply in general to simulations of networks and protocols in challenged environments. Various topics such as network simulation model inconsistencies, statistical validity, precision, improper simulation practices are covered. Includes recommendations to improve the creditibility of simualations.
[Kurkowski-Camp-Colagrosso 2005 .]
S. Kurkowski, T. Camp, and M. Colagrosso,
"MANET Simulation Studies: The Incredibles",
ACM SIGMOBILE Mobile Computing and Communications Review, vol.9, #4, October 2005, pp. 50-61
ResiliNets Keywords: simulation challenges
Keywords:
Abstract: " Simulation is the research tool of choice for a majority of the mobile ad hoc network (MANET) community. However, while the use of simulation has increased, the credibility of the simulation results has decreased. To determine the state of MANET simulation studies, we surveyed the 2000-2005 proceedings of the ACM International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc). From our survey, we found significant shortfalls. We present the results of our survey in this paper. We then summarize common simulation study pitfalls found in our survey. Finally, we discuss the tools available that aid the development of rigorous simulation studies. We offer these results to the community with the hope of improving the credibility of MANET simulation-based studies."
