[[PageOutline]] = 2nd GENI Instrumentation and Measurement Workshop = Tuesday, June 8, 1pm - Wednesday, June 9, 2pm [[BR]] Chicago O'Hare Hilton [[BR]] NOTE: By invitation only [[BR]] == Announcement with goals, topics and reference material == The following announcement (with figures and references) was sent to the attendees to prepare for the workshop: [[BR]] [http://groups.geni.net/geni/attachment/wiki/2ndInstMeasWork/060410b%20%20InstMeasWorkshopAgenda.pdf Announcement, v1.1 (060410)] [[BR]] [http://groups.geni.net/geni/attachment/wiki/2ndInstMeasWork/060310%20%20All%20Fig%20%20IM-ARCH-Figures.pdf Figures, v1.1 (060410)] [[BR]] == Attendees at workshop == (Attended workshop: yes or no) Paul Barford - University of Wisconsin – Madison (no)[[BR]] Bruce Maggs – Duke University and Akamai (yes)[[BR]] Harry Mussman – BBN/GPO (yes)[[BR]] Vic Thomas - BBN/GPO (yes)[[BR]] Evan Zhang – BBN/GPO (yes)[[BR]] OML (ORBIT Measurement Library) OMF (ORBIT Management Framework) Max Ott – NICTA (yes, by phone)[[BR]] Ivan Seskar – Rutgers WINLAB (yes)[[BR]] Instrumentation Tools Jim Griffioen - Univ Kentucky (yes) perfSONAR Matt Zekauskas - Internet2 (no)[[BR]] Jason Zurawski – Internet2 (yes)[[BR]] Martin Swany - Univ Delaware (yes)[[BR]] Guilherme Fernandes – Univ Delaware (yes)[[BR]] Ezra Kissel – Univ Delaware (yes)[[BR]] Scalable Sensing Service (S3) Sonia Fahmy – Purdue (yes)[[BR]] Puneet Sharma - HP Labs (yes)[[BR]] !OnTimeMeasure for network measurements Prasad Calyam - Ohio Supercomputing Ctr (yes) GENI Meta-Operations Center and !NetKarma Jon-Paul Herron - Indiana Univ[[BR]] Camilo Viecco - Indiana Univ (yes)[[BR]] Chris Small - Indiana Univ (yes)[[BR]] Beth Plale - Indiana Univ (no)[[BR]] Virtual Machine Introspection (VMI) Brian Hay – Univ Alaska (yes)[[BR]] Data-Intensive Cloud Control for GENI Michael Zink - UMass Amherst (yes)[[BR]] Experiment Management Service – Digital Object Registry Jim French - CNRI (yes)[[BR]] Giridhar Manepalli - CNRI (yes)[[BR]] Larry Lannom – CNRI (no)[[BR]] == Announcement with notes == The following announcement now includes all notes from the workshop: [http://groups.geni.net/geni/attachment/wiki/2ndInstMeasWork/062510%20InstMeasWorkshopAgenda.pdf Announcement, v1.2 (062510)] [http://groups.geni.net/geni/attachment/wiki/2ndInstMeasWork/062510%20InstMeasWorkshopAgenda.doc word version][[BR]] [http://groups.geni.net/geni/attachment/wiki/2ndInstMeasWork/Visio-062510_All_IM-ARCH-Figures.pdf Figures, v1.2 (062510)] [[BR]] == Priority topics == The following priority topics were identified at the workshop, and teams of attendees (and some non-attendees0 were identified for each topic to discuss it, and write a text summary for review by the WG at GEC8. === Topic 1 GENI I&M Use Cases === Team members: Paul Barford - University of Wisconsin – Madison (no)[[BR]] Jim Griffioen - Univ Kentucky (yes)[[BR]] Prasad Calyam* - Ohio Supercomputing Ctr (yes)[[BR]] Camilo Viecco - Indiana Univ (yes)[[BR]] Brian Hay – Univ Alaska (yes)[[BR]] *agreed to organize first writing and discussion To ensure that the GENI I&M architecture serves the needs of a wide range of users, a list of user groups and their related use cases are compiled in this Section. [[BR]] The user groups identified are:[[BR]] i. '''Experiment Researchers:''' Users that run Internet-scale experiments in slices comprising of multiple GENI resources to address research problems of the future-Internet.[[BR]] ii. '''Experiment (Opt-In) Users:''' Users within the GENI suite or general Internet users who participate or “opt-in” to a GENI experiment to utilize resources, applications or services that are hosted within the GENI experiment.[[BR]] iii. '''Central (i.e., GMOC) Operators:''' Group that monitors the GENI facility resources and processes in order to bring consistency, reliability and repeatability to GENI’s federated infrastructure.[[BR]] iv. '''Aggregate Providers and Operators:''' Groups that provide a set of network or computing components to GENI experiments along with software to manage the components, and allow users to check the availability and status of the various components.[[BR]] v. '''Archive Providers and Operators:''' Groups that catalog indexes of GENI-related measurement datasets in a repository and provide tools for users to share, annotate, search and cite the measurement datasets.[[BR]] vi. '''Researchers that use Archived Measurement Data:''' Users that utilize the measurement datasets provided by Archive Providers in order to test hypotheses, and promote reproducible research.[[BR]] The interfaces to the GENI I&M services that will drive the user actions in the use cases will be either: (i) web-page based, (ii) command-line based or (iii) custom client software based. [[BR]] The overall goals for the design of the use cases provided in the following sub-sections are for the GENI I&M system (GIMS) to: * Provide broad data gathering, analysis and archival capability that is sufficient for scientific mission, operations, and success of the infrastructure * Remove burden on researcher to become a system and network measurement infrastructure expert so that researcher can better focus on the science in the experiments * Measure details of GENI behavior with high precision and accuracy in a ubiquitous, extensible, highly available, secure, and integrated manner without adversely impacting experiments * Provide drill-down performance transparency of system and network resources at hop, link, path and slice levels in terms of availability, health status, and diagnosis of perceived as well as impending problems * Allow and make-it-easy for various user groups to access and control functions involving interactions between I & M sub-services encompassing resources such as instrumentation taps in the network, time sensors, software-based and hardware-based measurement probes, router/switch MIBs, and (short-term/long-term) measurement data archives * Provide performance transparency of the status of the individual I & M sub-service components and their interfaces with other sub-services to ensure correctness of measurements provisioned * Provide mechanisms to handle security, privacy and access control of measurement data archives to allow access only to authorized users, and also provide different data views based on authorization privileges '''3.1 For Experiment Researchers''' * A slice has been setup for me, have I got all the resources with the performance expectations that I specified in the RSpec? For example, I asked for a 2 Mbps available bandwidth connection between Nodes A and B, run a 2 Mbps UDP Iperf test so that I can check there is no packet loss * Show me a dashboard of some or all of the resource performance measurements as I run my experiments so that I can have knowledge of my experiment environment in real-time. Allow me to configure the dashboard such that it will be obvious for me to see any impending or perceived problems when measurement values cross my pre-set performance thresholds * My experiment data shows inconsistencies, let me query the status of user slice resources so that I can trace my non-intuitive results to a problem in the environment and subsequently notify GMOC about any perceived performance problems * Provide me with an archive of some or all of the slice resource performance measurements so that I can reference them during offline analysis of the data collected in my experiment after the slice expires * Setup up TCPdump passive measurement taps at hops a, b, c and provide an interface where I can view and analyze the slice components and slivers performance in an on-going manner * Setup Netflow measurements collection at hops a, b, c and provide an interface where I can view and analyze the flows in my slice in an on-going manner * Setup vendor-specific measurements collection from equipment at hops a, b, c in my slice and provide an interface where I can view and analyze the measurements in an on-going manner * Setup up active measurement capabilities on paths x, y, z using p, q, r tools; Provide capabilities for on-demand measurement with quick response times; Provide capabilities for on-going measurements with sampling patterns in {periodic, random, stratified random, adaptive} * Setup one-way delay active measurements with microsecond precision on paths x, y, and z encompassing hops a, b, and c that have Netflow measurements collection enabled so that I can know when there is short-term buildup in router queues that does not show in link utilization data, but is correlated with large flows that appear in the flow data * I am writing an event-driven experiment, at certain time points, I would like to be notified of anomalies and forecasts of system and network performance at hops a, b, c on paths x, y, z pertaining to tools p, q, r * I am running an experiment to deploy a novel IPTV system protocol, provide me with PSNR measurements of video quality between paths x, y, z (e.g., Evalvid tool that will need source and destination packet captures) * Provide access to my opt-in users who want to query measurement data within my experiment slice using web-service clients based on GIMA compliant data sharing schemas * Provide me with an archive of some or all of the slice resource performance measurements that I requested as part of my experiment * Provide me with mechanisms to share my slice measurements archive with researchers and opt-in users at different levels of permissions sharing (i.e., whitelist/blacklist, sign-in, public) '''3.2 For Experiment (Opt-In) Users''' * I am utilizing a new P2P networking service in a GENI experiment slice, show me the end-to-end delay and loss characteristics of the network paths between my computer and all the P2P servers in the GENI experiment * I have subscribed for a virtual desktop service in a GENI experiment slice, show me whether I got all the resources (e.g., CPU, Memory, Disk space) with the performance expectations that I requested in my virtual desktop computer? * My application running in the GENI experiment has poor performance, let me query the latest status of my application resources so that I can know the reason for the poor performance or I can notify the researcher who is running the GENI experiment '''3.3 For Central (i.e., GMOC) Operators''' * For a physical topology of Nodes {A, … Z} spanning multiple aggregates, show me if any slice is mis-behaving so that I can invoke “emergency shutdown” to swap it out * Experimenter called NOC about non-responsiveness of resources or unexpected behavior in a slice spanning multiple aggregates, notify status of user slice resources via a dashboard with some or all of the resource performance measurements in the user slice; Allow me to configure the dashboard such that it will be obvious for me to see any impending or perceived problems when measurement values cross pre-set performance thresholds * We would like to keep meta-data of all the experiments, send us experiment meta-data after each slice expires * Setup Netflow measurements collection at hops a, b, c spanning multiple aggregates and provide an interface where I can view and analyze the flows of all the experiment slices in an on-going manner * Setup vendor-specific measurements collection from equipment at hops a, b, c spanning multiple aggregates and provide an interface where I can view and analyze the measurements in an on-going manner * Setup up active measurement capabilities on paths x, y, z using p, q, r tools spanning multiple aggregates; Provide capabilities for looking at the measurements being collected via a weathermap interface * Provide me with an archive of some or all of the slice resource performance measurements of users X and Y so that I can analyze infrastructure problems spanning multiple aggregates that may have corrupted the users experiment environments '''3.4 For Aggregate Providers and Operators''' * I would like to have an authentication mechanism for NOC staff, researchers, and opt-in users so that measurement data access spanning across my aggregate components can be granted based on the privileges assigned to the different user roles * For a physical topology of Nodes {A, … Z} in my aggregate, show me if any slice is mis-behaving so that I can swap the experiment out and/or reallocate resources * The NOC has complained about non-responsiveness of resources or unexpected behavior in a slice using my aggregate, notify status of the user slice resources via a dashboard with some or all of the resource performance measurements in the user slice; Allow me to configure the dashboard such that it will be obvious for me to see any impending or perceived problems when measurement values cross pre-set performance thresholds * I would like to keep meta-data of all the running/expired experiments using my aggregate, so that I can track the resource utilization levels and the inherent experiment purposes over time * Setup Netflow measurements collection at hops a, b, c in my aggregate and provide an interface where I can view and analyze the flows of all the experiment slices in an on-going manner * Setup vendor-specific measurements collection from equipment at hops a, b, c in my aggregate and provide an interface where I can view and analyze the measurements in an on-going manner * Setup up active measurement capabilities on paths x, y, z using p, q, r tools in my aggregate; Provide capabilities for looking at the measurements being collected via a weathermap interface * Provide me with an archive of some or all of the slice resource performance measurements of users X and Y that are using my aggregate so that I can analyze infrastructure problems that may have corrupted my aggregate users experiment environments 3.5 For Archive Providers and Operators * I would like measurement archives corresponding to GENI experiments to be published in the repositories PQR by the experiment researchers, aggregate providers and GMOC with suitable keywords that allow me to catalog indexes for future search and retrieval purposes * I would like to have an authentication mechanism for NOC staff, aggregate providers, experiment researchers, opt-in users, and researchers that use archived measurement data so that measurement data access in my repositories can be granted based on the privileges assigned to the different user roles * I would like NOC staff, aggregate providers, and experiment researchers to provide me policies relating to the measurement archive sharing permissions (i.e., whitelist/blacklist, sign-in, public) * I would like users to use my tools and transformation libraries that deal with various data formats to: share, annotate, search and cite the measurement datasets in my repositories * I would like NOC staff, aggregate providers, and experiment researchers to contribute various tools that will allow researchers using the archived measurement data to analyze and visualize their corresponding published data sets more effectively '''3.6 For Researchers that use Archived Measurement Data''' * I would like get search results and access to measurement archives corresponding to GENI experiments published by the experiment researchers, aggregate providers and GMOC when I use different search keywords * I would like to be able to share (e.g., email, post on Twitter), annotate, search and cite the measurement datasets in repositories of several Archive Providers === Topic 2 GENI I&M Services === Team members:[[BR]] Harry Mussman* – BBN/GPO (yes)[[BR]] Evan Zhang – BBN/GPO[[BR]] Giridhar Manepalli - CNRI (yes)[[BR]] Chris Small - Indiana Univ (yes)[[BR]] Beth Plale - Indiana Univ (yes)[[BR]] *agreed to organize first writing and discussion Summarize current view of:[[BR]] Measurement Orchestration (MO) Service [[BR]] Measurement Point (MP) Service [[BR]] Measurement Information (MI) Service [[BR]] Measurement Collection (MC) Service [[BR]] Measurement Analysis and Presentation (MAP) Service[[BR]] Measurement Data Archive (MDA) Service[[BR]] Need: Basic definition of a Measurement Data Archive (MDA) Service[[BR]] Identify different types of services:[[BR]] Type 1: Dedicated service platform, with dedicated sliver, for customized information. [[BR]] (Completely dedicated to an experiment) [[BR]] Type 2: Common service platform, with dedicated slivers, for customized information. [[BR]] (Common portion, plus parts associated with different experiments)[[BR]] Type 3: Common service, for common or customized information. [[BR]] (Common service, with data provided to multiple experiments)[[BR]] === Topic 3 GENI I&M Resources === Team members: Vic Thomas - BBN/GPO (yes)[[BR]] Jim Griffioen* - Univ Kentucky (yes)[[BR]] Martin Swany - Univ Delaware (yes)[[BR]] Camilo Viecco - Indiana Univ (yes)[[BR]] Brian Hay – Univ Alaska (yes)[[BR]] Giridhar Manepalli - CNRI (yes)[[BR]] *agreed to organize first writing and discussion Significant question uncovered at workshop:[[BR]] Jim on 6/25 via email: We should involve Rob Ricci in the discussion.[[BR]] Consider these resources for I&M capabilities:[[BR]] 1. Hosts, VMs, etc. 2. Network connectivity 3. Software, e.g., I&M software that can be included in an experiment 4. I&M services 5. I&M data flows and file transfers 6. I&M data files stored in archives For each item, consider how to:[[BR]] Create[[BR]] Name[[BR]] Register and discover[[BR]] Authorize and assign[[BR]] Does each item have:[[BR]] Unique and persistent name?[[BR]] Unique and persistent identifier?[[BR]] Need to carefully consider this for all of GENI[[BR]] For each item, consider:[[BR]] Ownership[[BR]] What sort of policies the owner may want to apply[[BR]] How are each of these discovered, specified, authorized and assigned: Always by mechanisms provided by the CF? With CF plus additional mechanisms? Consider example of LS in perfSONAR [[BR]] Consider example of data file stored in archive, owned by an experimenter Need to define and then compare these options[[BR]] Need to understand interop with CF for each option[[BR]] Does CF setup secondary authorization mechanisms in some cases? If so, how?[[BR]] === Topic 4 GENI I&M Measurement Plane and Interfaces === Team members: Harry Mussman* – BBN/GPO (yes)[[BR]] Ezra Kissel – Univ Delaware (yes)[[BR]] Chris Small - Indiana Univ (yes)[[BR]] *agreed to organize first writing and discussion Consider: IP network[[BR]] Layer 2 (VLAN) connections[[BR]] Discuss:[[BR]] Which protocols are active[[BR]] Access to resources in aggregates, even when resources are in private address space, via GWs or proxies[[BR]] How to provide authentication and authorization[[BR]] How to provide QoS to protect measurement traffic[[BR]] How to provide QoS to protect other traffic when measurement traffic is large.[[BR]] Reserve bandwidth?[[BR]] Martin on 6/28: Consider XSP (extensible session protocol) to provide transport layer GW functions. === Topic 5 GENI I&M Interfaces and Protocols (APIs): Manage Services === Team members: Vic Thomas - BBN/GPO (yes)[[BR]] Ivan Seskar – Rutgers WINLAB (yes)[[BR]] Max Ott – NICTA (yes, by phone)[[BR]] Sonia Fahmy* – Purdue (yes)[[BR]] Giridhar Manepalli - CNRI (yes)[[BR]] *agreed to organize first discussion and writing Most instrumentation services follow the following steps: (1) request, (2) measure, (3) process, (4) transport, and (5) retrieve. A user of the instrumentation service will request certain measurements, which results in the provisioning and configuration of measurement probes. The probes generate a set or a stream of measurement data which may be further processed and potentially transported to a different location. Finally, the results of the requested measurements are stored in one or more repositories from which they can be retrieved and/or queried by authorized users, tools and services, either immediately (real-time) or at a later time (history).[[BR]] Depending on usage scenarios and objectives, several different architectures for instrumentation and measurement can emerge. Current GENI instrumentation projects leverage a number of popular tools to construct their service. For example, the Scalable Sensing Service project (S3) implements "sensor pods" (measurement points) as cgi scripts accessible through any web-server that supports cgi. Boa, a light-weight open source web-server, is currently used. Therefore, starting/stopping the sensor pods is simply accomplished by starting and stopping the server. This framework enables convenient third party measurements; that is, measurements between two nodes can be initiated by a third node. Periodic measurements are configured as "cron" jobs on the sensor pods. A sensing information manager ensures the liveness of the service using vxargs. The sensing information manager also collects the measurements from the sensor pods using rsync, and stores them in a data store (S3).[[BR]] In contrast, OML (OMLTridentCom,OMLwiki) takes a distributed stream-based approach. Probes are assumed to produce a stream of measurement tuples which are streamed through a configurable set of filters and caches to a repository. The repository, like S3, provides a web service interface allowing users and other services to retrieve the results (pull mode). However, users/services can also directly subscribe to a stream for operation in push mode. OML is integrated into the OMF control framework to simplify configuration of the entire distributed setup, as well as provide to support for "steerable" experiments, where the orchestration of an experiment can be influenced by the simultaneously collected measurements.[[BR]] Another instrumentation service currently in GENI is perfSONAR, which sits somewhere in the middle. Various distributed monitoring services are "wrapped" into individual web services called "Measurement Points" (MPs) which return their results using the Open Grid Forum's Network Measurement Working Group (NMWG) XML schema. A set of other services, such as the Measurement Archive, Lookup, Authentication, Topology, Transformation, and Resource Protector provide a comprehensive suite of services. perfSONAR is migrating to Representational State Transfer (REST), viewed as a lighter-weight service-oriented architecture over existing web service technologies, e.g., SOAP. XML-RPC and SNMP are also leveraged in several current measurement projects.[[BR]] APIs[[BR]] There are essentially two types of measurement APIs: one concerning itself with the configuration of the various elements and services participating in the measurement and monitoring activities, and the other facilitating the transfer of the measurement data itself.[[BR]] The provisioning and configuration of instrumentation functionality in a large federated environment serving many experimenters and spanning many countries with their respective legal frameworks is clearly a complex undertaking. However, at a fundamental level, instrumentation requires discovering, provisioning, and configuring resources, within the constraints of policies and user privileges. This is essentially functionality that the GENI control framework (CF) is (or will be) providing. What is not covered by the CF is the protocol for encoding and transporting measurement data between entities. Here, we must differentiate between two types of operations: the push or streaming, and the pull or requesting mode of operation. Both are not unique to this domain and there are several standards and widely used solutions.[[BR]] OML will soon be using the Internet Protocol Flow Information Export (IPFIX) protocol standardized by the IETF for streaming measurements from an exporter to a collector. perfSONAR, as discussed above, is using SOAP and the Open Grid Forum's Network Measurement Working Group (NMWG) XML schema for returning measurements back to a requester. In OML, once an application has been modified to integrate OML measurements, two possible configurations are possible: passing general arguments on the command line of the enhanced application, or using an XML configuration file. The XML configuration file allows the user to multiplex the measurement stream and apply different filters inside the application and between Measurement Points (OMLTridentCom,OMLwiki).[[BR]] References:[[BR]] (S3) P. Yalagandula, P. Sharma, S. Banerjee, S. Basu, and S.-J Lee. S3: A scalable sensing service for monitoring large networked systems. In Proceedings of the ACM SIGCOMM Workshop on Internet Network Management (INM), Sept. 2006.[[BR]] (OMLTridentCom) J. White, G. Jourjon, T. Rakatoarivelo, M. Ott. Measurement Architectures for Network Experiments with Disconnected Mobile Nodes. In Proceedings of TridentCom, 2009.[[BR]] (OMLwiki) http://omf.mytestbed.net/wiki/oml/Documentation === Topic 6 GENI I&M Interfaces and Protocols (APIs): Data Flows and Data File Transfers === Team members:[[BR]] Harry Mussman* – BBN/GPO (yes)[[BR]] Ivan Seskar – Rutgers WINLAB (yes)[[BR]] Max Ott – NICTA (yes, by phone)[[BR]] Ezra Kissel – Univ Delaware (yes)[[BR]] Prasad Calyam - Ohio Supercomputing Ctr (yes)[[BR]] Michael Zink - UMass Amherst (yes)[[BR]] *agreed to organize first writing and discussion Consider data flows and data file transfers between all services Define range of options: What:[[BR]] Data flows[[BR]] Data files transfers[[BR]] Type:[[BR]] Pull[[BR]] Push[[BR]] Pub/Sub[[BR]] Protocol:[[BR]] SNMP[[BR]] SCP[[BR]] FTP and gridFTP[[BR]] HTTP[[BR]] XMPP[[BR]] TCP[[BR]] SCTP[[BR]] Consider:[[BR]] Naming[[BR]] Discovery[[BR]] Connectivity [[BR]] Authentication and authorization mechanisms[[BR]] Map to current projects, giving examples:[[BR]] Consider: Minimum set required for GENI[[BR]] === Topic 7 GENI I&M Interfaces and Protocols (APIs): Registration and Discovery of Services with Available Measurement Data === Team members:[[BR]] Jason Zurawski* – Internet2 (yes)[[BR]] Prasad Calyam - Ohio Supercomputing Ctr (yes)[[BR]] *agreed to organize first writing and discussion[[BR]] Consider approach used in perfSONAR Summarize for:[[BR]] Services with data flows[[BR]] Also sources of file transfers?[[BR]] Also GUIs?[[BR]] === Topic 8 GENI I&M Interfaces and Protocols (APIs): GUIs === Team members:[[BR]] Jeremy Reed - Univ Kentucky (no)[[BR]] Zongming Fei - Univ Kentucky (no)[[BR]] Guilherme Fernandes* – Univ Delaware (yes)[[BR]] Puneet Sharma - HP Labs (yes)[[BR]] *Agreed to organize team[[BR]] This section will lay out requirements and recommendations for GUIs that allow GENI users to manage (control, configure, access), visualize and discover I&M services, including the GUI themselves, and related data. The portals used by GENI experimenters to request the deployment of an I&M system or the instantiation of a sliver in an I&M component are not covered in the present draft. Requirements are defined to ensure GUIs and other services adhere to general GENI principles that must be enforced (e.g. privacy), and will tend to evolve from recommendations deemed essential by GENI I&M community. On the other hand, recommendations try to capture best practices in the field and general principles to increase the usability and effectiveness of these GUIs. Note: This draft does not currently define any requirements or recommendations, but rather describes current practices, possible use cases and general thoughts that can hopefully inform the future definition of these requirements and recommendations by the GENI I&M WG. Many design principles must be taken into consideration when developing GUIs for I&M architectures. As usual in Computer Science, these principles can be in sharp contrast with each other and trade-offs are made depending on the overall objective of the GUI. Following the general methodology of GENI, we identify GUIs developed for other I&M frameworks and services in order to capitalize on their strengths. A discussion of some of these design principles follows. * Centralized/Remote vs Distributed/Local vs Hybrid - These principles can be seen as part of a spectrum, with GUIs that provide a visual interface to services and data residing locally on the same machine on one end (e.g. pS-Performance Toolkit web interface), and GUIs that centralize management and distributed access to remote data and services on the other (e.g. MRTG+Cacti, CACTISonar). A centralized interface is the preferred approach on many use cases, such as health and status monitoring, as it increases the effectiveness and facilitates the access by providing a single, unified location for network management. However, collecting the data on a centralized location tends to increase the network overhead generated by network management. In contrast, GUIs with local scope tend to be faster in accessing data, create little or no network overhead and are generally simpler to build. Between these two extremes we can find hybrid GUIs. For example, a centralized visualization interface might cache only common queries and request others on demand (e.g. Periscope). * Flexibility vs Usability - GENI users should be able to have as much control as possible over the configuration of I&M services dedicated to their slice. In several instances it might be hard (or impossible) to identify a single set of parameters that satisfies all experimenters. GUIs can be designed to provide great flexibility (e.g. by permitting users to select what is to be displayed, how it should be displayed, or providing an interface to all sorts of configuration parameters). Expert users certainly appreciate having great flexibility, but even experts expect sensible defaults to be defined. On the other hand, non-expert users might be overwhelmed with too many options, reducing the GUI’s usability and users’ overall experience. Having different views (e.g. normal and advanced) with varying levels of complexity can be a conciliatory bridge between flexibility and usability. * Common graphical layouts and visualization aids - [There are established ways of presenting some types of data (e.g. utilization as line/area graphs with out and in directions overlayed, one- and two-way latency tests as scatter plots, measurement meshes results in 2D matrices). GUI developers should recognize de facto standards and try to follow them. Visualization aids are commonly provided through geographical maps, network topology diagrams, etc.] * Documentation? The GENI I&M Architecture draft includes a Measurement Analysis and Presentation (MAP) Service. Many of the GUIs discussed in this section fall into this category. In contrast, network monitoring frameworks that take a middleware approach (e.g. perfSONAR) tend to view this type of service as users of the framework, sitting in a higher (external) layer. There are clear benefits of including this type of service in the architecture definition (e.g. it enables the main purpose of this section, namely to identify requirements and guide user expectations regarding GUIs). However, careful attention must be paid to the place of these services within the framework and the issues that arise. One possible concern regards the substitutability of API functionality of other components through GUIs. For example, the API for a Measurement Point Service might define Start/Stop methods through a Web Services interface. If a GENI I&M system provides a GUI that allows the user to Start/Stop the MP, must the MP implement the same functionality (through the Web Services interface) to be considered compliant? Consider now the more complex example of GUIs that are the sole interface to a given dataset. Data might be pushed or pulled into a local (or remote) database which is then accessed by the GUI to display the data to the user (e.g. MRTG+Cacti). The data is clearly available to the experimenter through the GUI, but must it also be available through the defined MDA interface? Would it suffice for the GUI to be able to export the raw data in a give format (e.g. through HTTP file download)? The access of GUIs to data raises very important issues regarding authentication and authorization in GENI. All of the GENI facilities must employ security mechanisms to ensure privacy and policy constraints are met. If a GUI has direct access to data, the GUI must likely employ the similar (same?) mechanisms as required on an equivalent MDA. On the other hand, if the GUI accesses other I&M services on demand to retrieve the d ata to be displayed, the GUI should allow the user to authenticate itself. In this case, should the user authenticate itself with the GUI, which is then trusted by the other services [this might make sense when the GUI is deployed as part of the I&M system]? Or should the GUI relay the authentication to the services by asking the user for its certificate (and password)? Both cases raise trust issues with the GUI themselves. Finally, we address the discovery of and access to the GUI themselves. Some GUIs will likely act as services of the I&M systems (i.e. deployed within the system, maybe with direct access to data), and as such should likely be discoverable as any other service of I&M system (e.g. by registering to a Lookup Service). Open issues include determining the necessary information to register in order to meaningfully describe the GUI and its capabilities. Also, it is expected that many GUIs will be developed through the years by GENI users. GENI should likely provide an archive/repository to make these GUIs available and easily discoverable by the larger GENI community. Is this repository a centralized location (maintained by GENI) or just a Lookup Service pointing to the remote locations where the GUIs can be found? === Topic 9 GENI Measurement Data Schema === Team members:[[BR]] Bruce Maggs – Duke University and Akamai (yes)[[BR]] Max Ott – NICTA (yes, by phone)[[BR]] Ivan Seskar – Rutgers WINLAB (yes)[[BR]] Martin Swany* - Univ Delaware (yes)[[BR]] Camilo Viecco - Indiana Univ (yes)[[BR]] Michael Zink - UMass Amherst (yes)[[BR]] Jim French - CNRI (yes)[[BR]] *agreed to organize first discussion and writing Consider:[[BR]] Measurement data schema[[BR]] Metadata schema[[BR]] Metadata contents[[BR]] Consider measurement data schema and/or metadata schema from:[[BR]] perfSONAR[[BR]] GMOC-provided[[BR]] Current OML[[BR]] Proposed using IPFIX[[BR]] NetCDF (as used by DI Cloud)[[BR]] Consider: Minimum set required for GENI Provide overall template for GENI metadata, considering above.[[BR]] Which items in GENI metadata template are: Required?[[BR]] Invariant?[[BR]] == Project Summaries == === Instrumentation Tools === === OMF/OML === === perfSONAR === === Scalable Sensing Service === === On Time Measure === === Data Intensive Cloud === === Digital Object Registry === == References == All references Individual references [http://groups.geni.net/geni/attachment/wiki/2ndInstMeasWork/GIMS_Design_UseCases_033110.pdf GIMS_Design_UseCases] "Use-cases for GENI Instrumentation and Measurement Architecture Design" [http://groups.geni.net/geni/attachment/wiki/2ndInstMeasWork/ref%20%20MeasPlane-1%20%20www2008-restws-pautasso-zimmermann-leymann.pdf MeasPlane-1] "RESTful Web Services vs. "Big" Web Services: Making the Right Architectural Decision" [http://groups.geni.net/geni/attachment/wiki/2ndInstMeasWork/ref%20OMF_OML-1%20%20rfc4506.pdf OMF-OML-1:] "XDR: External Data Representation Standard" [http://groups.geni.net/geni/attachment/wiki/2ndInstMeasWork/ref%20%20OMF_OML-2%20%20final-oml-paper.pdf OMF-OML-2] "ORBIT Measurements Framework and Library (OML): Motivations, Design, Implementation, and Features" [http://groups.geni.net/geni/attachment/wiki/2ndInstMeasWork/ref%20%20OMF_OML-3%20%20%20ott%20%20OML%20-%20GEC7%20-%20march.pdf OMF-OML-3] "OML Overview" Slides [http://groups.geni.net/geni/attachment/wiki/2ndInstMeasWork/ref%20%20OMF_OML-4%20%20oml_tridentcom_2009.pdf OMF-OML-4] "Measurement Architectures for Network Experiments with Disconnected Mobile Nodes" [http://groups.geni.net/geni/attachment/wiki/2ndInstMeasWork/ref%20%20InstTools-1%20%20instools-design-doc.pdf InsTools-1] "Architectural Design and Specification of the INSTOOLS Measurement System" [http://groups.geni.net/geni/attachment/wiki/2ndInstMeasWork/ref%20perfSONAR-1%20%20trident.pdf perfSONAR-1] "Scalable Framework for Representation and Exchange of Network Measurements" [http://groups.geni.net/geni/attachment/wiki/2ndInstMeasWork/ref%20%20perfSONAR-2%20%20extensible%20schema%20%20%20doc15649.pdf perfSONAR-2] "An Extensible Schema for Network Measurement and Performance Data" [http://groups.geni.net/geni/attachment/wiki/2ndInstMeasWork/ref%20%20perfSONAR-3%20%20topoSchema-OGF21.pdf perfSONAR-3] "NM-WG/perfSONAR Topology Schema" [http://groups.geni.net/geni/attachment/wiki/2ndInstMeasWork/ref%20%20GMOC-1%20%20data_exchange_format-posted.pdf GMOC-1] “GMOC Topology-Entity Data Exchange Format Specification” [[BR]] [http://groups.geni.net/geni/attachment/wiki/2ndInstMeasWork/ref%20%20GMOC-2%20%20urn-proposal.pdf GMOC-2] "Proposal: Use of URN's as GENI Identifiers" == Figures == Figure 1-1: I&M Services for Researchers [[BR]] [[Image(060310Fig1-1_SrvcsRes_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 1-2: I&M Services for Operators [[BR]] [[Image(060310Fig1-2_SrvcsOps_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 1-3: I&M Services for both Researchers and Operators [[BR]] [[Image(060310Fig1-3_SrvcsBoth_ IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 2-1: OMF/OML I&M Srvcs [[Image(060310Fig2-1_SrvcsOMFOML_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 2-2: Inst Tools I&M Srvcs [[BR]] [[Image(060310Fig2-2_SrvcsInsTools_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 2-3: perfSONAR I&M srvcs [[BR]] [[Image(060310Fig2-3_Srvcs_perfSONAR_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 2-4: Scal Sense Srvc I&M Srvcs [[BR]] [[Image(060310Fig2-4_SrvcsS3_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 2-5: !OnTimeMeas I&M Srvcs [[BR]] [[Image(060310Fig2-5_OnTimeMeas_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 2-6: DICLOUD config [[BR]] [[Image(060310Fig2-6_DICloud_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 2-7: DOR MDA Srvc and Mess[[BR]] [[Image(060310Fig2-7_DOR_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 3-1: Meas Traffic Flows[[BR]] [[Image(060310Fig3-1_MeasTrafficFlows_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 3-2: Meas Traffic Proxies[[BR]] [[Image(060310Fig3-2_measTrafPorxies_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 4-1: OMF/OML Srvcs and Mess[[BR]] [[Image(060310Fig4-1_OMLSrvcs_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 4-2: OML Component Arch[[BR]] [[Image(060310Fig4-2_OMLArch_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 4-3: OMF/OML Overview[[BR]] [[Image(060310Fig4-3_OMLOverview_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 4-4: ORBIT Network Diagram [[BR]] [[Image(060310Fig4-4_OMLNtwk_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 5-1: Inst Tools Srvcs and Mess [[BR]] [[Image(060310Fig5-1_InstToolsSrvcs_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 5-2: Inst Tools Components [[BR]] [[Image(060310Fig5-2_InstToolsComps_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 5-3: Inst Tools Topology [[BR]] [[Image(060310Fig5-3_InstToolsToplogy_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 6-1: perfSONAR Srvcs and Messages[[BR]] [[Image(060310Fig6-1_perfSONARSrvcs_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 6-2: perfSONAR Meas Data Schema [[BR]] [[Image(060310Fig6-2_perfSONARSchema_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 7-1: Scal Sens Srvc Srvcs and Messages [[BR]] [[Image(060310Fig7-1_S3Srvcs_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 8-1: !OnTimeMeas Srvcs and Mess[[BR]] [[Image(060310Fig8-1_OnTimeMeasSrvcs_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 9-1: [[BR]] [[Image(063010Fig9-1_DICloudSrvcs_IM-ARCH-Fig.jpg, 80%)]] [[BR]] Figure 10-1: DOR MDA Srvc and Mess [[BR]] [[Image(060310Fig10-1_DORSrvcs_IM-ARCH-Figures.jpg, 80%)]] [[BR]] Figure 10-2: DOR MDA Srvc File Org [[BR]] [[Image(060310Fig10-2_DORFileOrg_IM-ARCH-Figures.jpg, 80%)]] [[BR]]