Changes between Version 44 and Version 45 of 2ndInstMeasWork


Ignore:
Timestamp:
08/01/10 21:49:11 (9 years ago)
Author:
Prasad Calyam
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • 2ndInstMeasWork

    v44 v45  
    7979  *agreed to organize first writing and discussion
    8080
    81 Identify all user groups, and provide basic use cases:
    82   1. Experiment researchers
    83   2. Experiment (opt-in) users 
    84   (see http://groups.geni.net/geni/attachment/wiki/041409NYCOptInWGAgenda/071509%20%20GENI-SE-OI-Overview-01.4.pdf for  listing of opt-in issues, such as privacy)
    85   3. Central (i.e., GMOC) operators
    86   4. Cluster and aggregate providers and operators
    87   5. Archive service providers and operators
    88   6. Researchers that use archived measurement data, archived by other researchers (!DatCat model)
     81To ensure that the GENI I&M architecture serves the needs of a wide range of users, a list of user groups and their related use cases are compiled in this Section. [[BR]]
     82The user groups identified are:[[BR]]
     83i.      '''Experiment Researchers:''' Users that run Internet-scale experiments in slices comprising of multiple GENI resources to address research problems of the future-Internet.[[BR]]
     84ii.     '''Experiment (Opt-In) Users:''' Users within the GENI suite or general Internet users who participate or “opt-in” to a GENI experiment to utilize resources, applications or services that are hosted within the GENI experiment.[[BR]]
     85iii.    '''Central (i.e., GMOC) Operators:''' Group that monitors the GENI facility resources and processes in order to bring consistency, reliability and repeatability to GENI’s federated infrastructure.[[BR]]
     86iv.     '''Aggregate Providers and Operators:''' Groups that provide a set of network or computing components to GENI experiments along with software to manage the components, and allow users to check the availability and status of the various components.[[BR]]
     87v.      '''Archive Providers and Operators:''' Groups that catalog indexes of GENI-related measurement datasets in a repository and provide tools for users to share, annotate, search and cite the measurement datasets.[[BR]]
     88vi.     '''Researchers that use Archived Measurement Data:''' Users that utilize the measurement datasets provided by Archive Providers in order to test hypotheses, and promote reproducible research.[[BR]]
     89
     90The interfaces to the GENI I&M services that will drive the user actions in the use cases will be either: (i) web-page based, (ii) command-line based or (iii) custom client software based. [[BR]]
     91The overall goals for the design of the use cases provided in the following sub-sections are for the GENI I&M system (GIMS) to:
     92 * Provide broad data gathering, analysis and archival capability that is sufficient for scientific mission, operations, and success of the infrastructure
     93 * Remove burden on researcher to become a system and network measurement infrastructure expert so that researcher can better focus on the science in the experiments
     94 * Measure details of GENI behavior with high precision and accuracy in a ubiquitous, extensible, highly available, secure, and integrated manner without adversely impacting experiments
     95 * Provide drill-down performance transparency of system and network resources at hop, link, path and slice levels in terms of availability, health status, and diagnosis of perceived as well as impending problems
     96 * Allow and make-it-easy for various user groups to access and control functions involving interactions between I & M sub-services encompassing resources such as instrumentation taps in the network, time sensors, software-based and hardware-based measurement probes, router/switch MIBs, and (short-term/long-term) measurement data archives
     97 * Provide performance transparency of the status of the individual I & M sub-service components and their interfaces with other sub-services to ensure correctness of measurements provisioned
     98 * Provide mechanisms to handle security, privacy and access control of measurement data archives to allow access only to authorized users, and also provide different data views based on authorization privileges
     99
     100'''3.1  For Experiment Researchers'''
     101 * A slice has been setup for me, have I got all the resources with the performance expectations that I specified in the RSpec?  For example, I asked for a 2 Mbps available bandwidth connection between Nodes A and B, run a 2 Mbps UDP Iperf test so that I can check there is no packet loss
     102 * Show me a dashboard of some or all of the resource performance measurements as I run my experiments so that I can have knowledge of my experiment environment in real-time. Allow me to configure the dashboard such that it will be obvious for me to see any impending or perceived problems when measurement values cross my pre-set performance thresholds
     103 * My experiment data shows inconsistencies, let me query the status of user slice resources so that I can trace my non-intuitive results to a problem in the environment and subsequently notify GMOC about any perceived performance problems
     104 * Provide me with an archive of some or all of the slice resource performance measurements so that I can reference them during offline analysis of the data collected in my experiment after the slice expires
     105 * Setup up TCPdump passive measurement taps at hops a, b, c and provide an interface where I can view and analyze the slice components and slivers performance in an on-going manner
     106 * Setup Netflow measurements collection at hops a, b, c and provide an interface where I can view and analyze the flows in my slice in an on-going manner
     107 * Setup vendor-specific measurements collection from equipment at hops a, b, c in my slice and provide an interface where I can view and analyze the measurements in an on-going manner
     108 * Setup up active measurement capabilities on paths x, y, z using p, q, r tools; Provide capabilities for on-demand measurement with quick response times; Provide capabilities for on-going measurements with sampling patterns in {periodic, random, stratified random, adaptive}
     109 * Setup one-way delay active measurements with microsecond precision on paths x, y, and z encompassing hops a, b, and c that have Netflow measurements collection enabled so that I can know when there is short-term buildup in router queues that does not show in link utilization data, but is correlated with large flows that appear in the flow data
     110 * I am writing an event-driven experiment, at certain time points, I would like to be notified of anomalies and forecasts of system and network performance at hops a, b, c on paths x, y, z pertaining to tools p, q, r
     111 * I am running an experiment to deploy a novel IPTV system protocol, provide me with PSNR measurements of video quality between paths x, y, z (e.g., Evalvid tool that will need source and destination packet captures)
     112 * Provide access to my opt-in users who want to query measurement data within my experiment slice using web-service clients based on GIMA compliant data sharing schemas
     113 * Provide me with an archive of some or all of the slice resource performance measurements that I requested as part of my experiment
     114 * Provide me with mechanisms to share my slice measurements archive with researchers and opt-in users at different levels of permissions sharing (i.e., whitelist/blacklist, sign-in, public)
     115
     116'''3.2  For Experiment (Opt-In) Users'''
     117 * I am utilizing a new P2P networking service in a GENI experiment slice, show me the end-to-end delay and loss characteristics of the network paths between my computer and all the P2P servers in the GENI experiment
     118 * I have subscribed for a virtual desktop service in a GENI experiment slice, show me whether I got all the resources (e.g., CPU, Memory, Disk space) with the performance expectations that I requested in my virtual desktop computer? 
     119 * My application running in the GENI experiment has poor performance, let me query the latest status of my application resources so that I can know the reason for the poor performance or I can notify the researcher who is running the GENI experiment
     120
     121'''3.3  For Central (i.e., GMOC) Operators'''
     122 * For a physical topology of Nodes {A, … Z} spanning multiple aggregates, show me if any slice is mis-behaving so that I can invoke “emergency shutdown” to swap it out
     123 * Experimenter called NOC about non-responsiveness of resources or unexpected behavior in a slice spanning multiple aggregates, notify status of user slice resources via a dashboard with some or all of the resource performance measurements in the user slice; Allow me to configure the dashboard such that it will be obvious for me to see any impending or perceived problems when measurement values cross pre-set performance thresholds
     124 * We would like to keep meta-data of all the experiments, send us experiment meta-data after each slice expires
     125 * Setup Netflow measurements collection at hops a, b, c spanning multiple aggregates and provide an interface where I can view and analyze the flows of all the experiment slices in an on-going manner
     126 * Setup vendor-specific measurements collection from equipment at hops a, b, c spanning multiple aggregates and provide an interface where I can view and analyze the measurements in an on-going manner
     127 * Setup up active measurement capabilities on paths x, y, z using p, q, r tools spanning multiple aggregates; Provide capabilities for looking at the measurements being collected via a weathermap interface
     128 * Provide me with an archive of some or all of the slice resource performance measurements of users X and Y so that I can analyze infrastructure problems spanning multiple aggregates that may have corrupted the users experiment environments
     129
     130'''3.4  For Aggregate Providers and Operators'''
     131 * I would like to have an authentication mechanism for NOC staff, researchers, and opt-in users so that measurement data access spanning across my aggregate components can be granted based on the privileges assigned to the different user roles
     132 * For a physical topology of Nodes {A, … Z} in my aggregate, show me if any slice is mis-behaving so that I can swap the experiment out and/or reallocate resources
     133 * The NOC has complained about non-responsiveness of resources or unexpected behavior in a slice using my aggregate, notify status of the user slice resources via a dashboard with some or all of the resource performance measurements in the user slice; Allow me to configure the dashboard such that it will be obvious for me to see any impending or perceived problems when measurement values cross pre-set performance thresholds
     134 * I would like to keep meta-data of all the running/expired experiments using my aggregate, so that I can track the resource utilization levels and the inherent experiment purposes over time
     135 * Setup Netflow measurements collection at hops a, b, c in my aggregate and provide an interface where I can view and analyze the flows of all the experiment slices in an on-going manner
     136 * Setup vendor-specific measurements collection from equipment at hops a, b, c in my aggregate and provide an interface where I can view and analyze the measurements in an on-going manner
     137 * Setup up active measurement capabilities on paths x, y, z using p, q, r tools in my aggregate; Provide capabilities for looking at the measurements being collected via a weathermap interface
     138 * Provide me with an archive of some or all of the slice resource performance measurements of users X and Y that are using my aggregate so that I can analyze infrastructure problems that may have corrupted my aggregate users experiment environments
     139
     1403.5     For Archive Providers and Operators
     141 * I would like measurement archives corresponding to GENI experiments to be published in the repositories PQR by the experiment researchers, aggregate providers and GMOC with suitable keywords that allow me to catalog indexes for future search and retrieval purposes
     142 * I would like to have an authentication mechanism for NOC staff, aggregate providers, experiment researchers, opt-in users, and researchers that use archived measurement data so that measurement data access in my repositories can be granted based on the privileges assigned to the different user roles
     143 * I would like NOC staff, aggregate providers, and experiment researchers to provide me policies relating to the measurement archive sharing permissions (i.e., whitelist/blacklist, sign-in, public)
     144 * I would like users to use my tools and transformation libraries that deal with various data formats to: share, annotate, search and cite the measurement datasets in my repositories
     145 * I would like NOC staff, aggregate providers, and experiment researchers to contribute various tools that will allow researchers using the archived measurement data to analyze and visualize their corresponding published data sets more effectively
     146
     147'''3.6  For Researchers that use Archived Measurement Data'''
     148 * I would like get search results and access to measurement archives corresponding to GENI experiments published by the experiment researchers, aggregate providers and GMOC when I use different search keywords
     149 * I would like to be able to share (e.g., email, post on Twitter), annotate, search and cite the measurement datasets in repositories of several Archive Providers
    89150
    90151=== Topic 2  GENI I&M Services ===