9th International IEEE Conference
Dependable Systems, Services and Technologies
UKRAINE, KYIV, MAY 24-27, 2018

  • Information

  • Deadlines

    (23:59 UTC+0)

    Paper submission: March 4, 2018 March 14, 2018 March 19, 2018 (Extra deadline for update only)
    Notification of paper acceptance: April 25, 2018
    Final manuscript: April 30, 2018
    Registration and payment: May 3, 2018

    Program draft publication: May 7, 2018
    Conference date: May 24-27, 2018

  • Contacts

    Department 503, DESSERT’2018 Organizing Committee,
    National Aerospace University n. a. N. E. Zhukovsky “KhAI”,
    Chkalov str., 17, Kharkiv, 61070, Ukraine
    Phone: +38 (095) 564 76 69
    (contact person – Anastasiia Strielkina)

Marco Vieira

Benchmarking the Security of Software Systems: Approach and Challenges


A benchmark is a standard procedure that allows comparing systems or components according to specific characteristics (e.g., performance, dependability, security). A security benchmark should provide a metric (or small set of metrics) able to characterize the degree to which security goals are met in a given piece of code, allowing developers and administrators to make informed decisions. However, one of the biggest difficulties in designing such benchmarks is related to the fact that security assessment is, usually, much more dependent on what is unknown about the applications (e.g. unknown bugs, hidden vulnerabilities) than by what is known (e.g., known features, existing security mechanisms). In fact, security metrics are hard to define and compute because they involve making isolated estimations about the ability of an unknown individual (e.g., a hacker) to discover and maliciously exploit an unknown system characteristic (e.g., a vulnerability).
The work on performance benchmarking has started long ago. Ranging from simple benchmarks that target a very specific hardware system or component to very complex benchmarks focusing on complex systems (e.g., database management systems, operating systems), performance benchmarks have contributed to improve successive generations of systems. Research on dependability benchmarking has been boosted in the beginning of the millennium, leading to the proposal of several dependability benchmarks. Several works have been carried out by different groups and following different approaches (e.g., experimental, modeling, fault injection). Due to the increasing relevance of security aspects, security benchmarking is becoming an important research field.
In this keynote we will discuss the recent achievements in the security benchmarking domain, and the grand challenges that need to be addressed in order to effectively be able to compare alternative solutions from a security perspective. In addition to the metrics and the benchmarking procedure, we will discuss enabling techniques and tools to support the benchmark, with particular focus on vulnerability and attack injection and trustworthiness measurement.

Marco Vieira is a Full Professor at the University of Coimbra, Portugal, where he has been involved in research on dependable and secure computing since 2000. His research interests include dependability and security assessment and benchmarking, fault injection and vulnerability & attack injection, robustness and security testing, software Verification & Validation, online failure prediction, and resilience benchmarking, subjects in which he has authored or co-authored more than 150 papers in refereed conferences and journals. Marco Vieira has served on the program committee of the major conferences on the dependability area and acted as referee for many international conferences and journals. He is currently Program Committee co-chair of the IEEE/IFIP 2018 International Conference on Dependable Systems and Networks (DSN 2018), and was in the recent past Program Committee Chair of the 12th European Dependable Computing Conference (EDCC 2016), Program Committee Co-Chair of the 7th Latin America Symposium on Dependable Computing (LADC 2016), and Program Committee Co-Chair of the International Symposium on Software Reliability Engineering (ISSRE 2015). Marco Vieira is an Associate Editor of the IEEE Transactions on Dependable and Secure Computing (TDSC), and guest edited a special issue on Security and Dependability of Cloud Systems and Services of the IEEE Transactions on Services Computing (TSC), and a special issue on Software Reliability Engineering of the Journal of Systems and Software (JSS). He is the coordinator of the EUBrasilCloudFORUM (H2020-EUB-2015-689495) and DEVASSES (PIRSES-GA-2013-612569) projects, and the principal investigator at the University of Coimbra of the EUBRA-BIGSEA (H2020-EUB-2015-690116) and ATMOSPHERE (H2020-EUB-2017-777154) projects.