17.11.13 - 20.11.13, Seminar 13472

Global Measurement Framework

Diese Seminarbeschreibung wurde vor dem Seminar auf unseren Webseiten veröffentlicht und bei der Einladung zum Seminar verwendet.

Motivation

The Internet has a history of unexpected and often unpredictable behaviors due to manifold interactions of thousands of networks, and billions of components and devices and users. The resulting complexity requires measurements to understand how the network is performing, to observe how it is evolving, and to determine where failures or degradations occur. Especially with constantly evolving applications and their interaction paradigms, new phenomena occur and need to be factored into operations and management: one example is the substantial effort going into defining interfaces to assist peer-to-peer applications so that the amount of cross-ISP traffic is reduced. Measurements thus form an integral part of network operator tool sets to keep the net up and running. This Dagstuhl seminar seeks contributing to improving Internet measurements in several respects:

  • improving the expressiveness of measurement metrics (and develop appropriate new ones) beyond throughput, loss rate, and RTT so that the actual application-specific user quality of experience can be assessed;
  • expanding the reach, scale, and diversity of measurements and the corresponding data analysis to obtain a more comprehensive view on the performance of networks and applications;
  • structuring the otherwise mostly disconnected measurement activities to allow interfacing between them and/or providing defined access methods to them, for both carrying out measurements and accessing measurement results (offline and in real-time);
  • providing ways to better instrument and more broadly utilize measurement infrastructure, inside operators, for end users, and at third parties.

We will bring together researchers from industry, academia, and regulators across continents and across different backgrounds to discuss the state of the art in measurements and their exploitation, measurement and analysis techniques, privacy and anonymization. We aim at identifying and initiating next steps towards a coherent global measurement framework for the Internet.

The topics to be discussed include:

  1. Measurement infrastructures and metrics
    We will assess the (open) measurement infrastructures in operation today as well as those being set up and their measurement architectures, methods, and tools to understand how far those complement or overlap with each other and share experience about measurement results. We will discuss which metrics should be used to characterize network performance at which layers and understand how the information gathered from different infrastructures could be combined to offer richer insights.
  2. Interfaces to measurement infrastructures
    We will further discuss interfaces to diverse measurement infrastructures that would allow interaction between infrastructures as well as internal and external access to measurement data (including possible policy constraints). The seminar will cover at least interfaces for data mining and planning (non-real-time), for applications for real-time adaptation (real-time), for network operators for real-time troubleshooting & network management (real-time), for interacting with probes to carry out measurements (real-time) and control interfaces so that an operator can define what measurements are carried out (perhaps in near real-time). These interfaces might be global, so allowing operators or regulators to control measurement probes in other networks. This ties in with recent activity in the Internet Engineering Task Force and the Broadband Forum who both explore potential standardization paths for Internet measurements.
  3. Using measurement results
    Building upon item 2), which addresses access to the data, we will discuss what use cases benefit from global measurements and what their requirements on data collection and access (e.g., which timescales) would be. Besides network and data center management, information for regulators and end user applications, also the measurement infrastructures themselves could benefit, e.g., in terms of calibrating and validating their operation. We will discuss the implications of a ubiquitous, global measurement platform, where for example every broadband hub, WiFi base station and 4G mobile has an embedded measurement capability.
  4. Data protection, anonymization, and privacy preservation
    Maintaining the privacy and security of user data is undoubtedly important. Data collection and data analysis require carefully chosen anonymization methods to prevent retroactive identification of users and their behavior. This becomes even more important as measurement results might be shared across operators, because broader aggregation with other data becomes possible, and the data now leaves one security domain. But also aggregate information about operator performance requires a careful definition of sharing policies so that operators can strike a reasonable balance between being as open as possible (and thus most helpful for Internet-scale optimizations) on the one hand and not revealing too much information to their competitors or the public on the other.

Tentative Seminar Organization

The seminar will run for three days with the rough structure outlined below. Some invited talks are meant to set the scene for the group work and stir the discussion. The seminar will be structured into two theme days, the first one about creating a global measurement platform, the second on using a global measurement platform. The third day will be dedicated to a recap and a call for actions. Participants may also present ad-hoc ideas for discussion.

The organizers of the Dagstuhl seminar will produce a summary report to be published, e.g., in the IEEE Communications Magazine or in the editorial zone of ACM Computer Communications Review.

Sunday

Evening
Informal opening and discussion

Monday: Creating the global measure-ment platform

Morning
Welcome and organization Introduction of participants (1-2min each, no slides) Invited talks on today’s measurement infrastructures and their capabilities (30 mins each), specifically covering aspects relevant for creating a global measurement framework.
Afternoon
Group discussion I: Creating the global measurement platform
  • metrics and measurements
  • infrastructure and interfaces
Evening
Informal continuation and group summary preparation

Tuesday: Using the platform

Morning
Presentation and discussion of group findings Invited talks on the regulator, operator, and user views and on applications using measurement data (20 min each)
Afternoon
Group discussion II: Using the global measurement platform
  • operator use cases
  • regulator use cases
  • end user use cases
Evening
Social

Wednesday

Morning
Presentation and discussion of group results II Ad-hoc talks and discussion Call for action: Recommendations and proposed next steps for: Operators, Regulators, Standards bodies, Researchers…
Afternoon
Conclusion and seminar observations