Changes between Initial Version and Version 1 of OnTime-Mar11


Ignore:
Timestamp:
04/01/11 15:44:57 (9 years ago)
Author:
Prasad Calyam
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • OnTime-Mar11

    v1 v1  
     1= OnTimeMeasure: Centralized and Distributed Measurement Orchestration Software =
     2'''Quarterly Status Report Document for Global Environment for Network Innovations (GENI) Spiral 3 Project # 1764'''
     3
     4'''Prasad Calyam (PI) and Paul Schopis (Co-PI)'''
     5
     6'''Ohio Supercomputer Center/OARnet, The Ohio State University'''
     7
     8''Update Period: December 2010 - March 2011''
     9
     10[[PageOutline]]
     11
     12----
     13== I. Major accomplishments ==
     14
     15=== A. Milestones achieved ===
     16In the project period between December 2010 - March 2011 in GENI Spiral 3, we have made significant progress towards our milestones ![1]. A summary of our accomplishments is as follows: [[BR]]
     17 * We successfully completed several Spiral 3 milestones as planned: !OnTime: S3.a: Demonstrate !OnTimeMeasure with ProtoGENI and !PlanetLab sites; !OnTime: S3.b Release a software version of !OnTimeMeasure that can function across multiple aggregates; !OnTime: S3.c Integrate !OnTimeMeasure measurement service with experimenter workflow tools such as GUSH; !OnTime: S3.d Demonstrate the use of !OnTimeMeasure within a simple GENI Experiment [[BR]]
     18 * To date, we have approx. 25 users from 14 GENI-related projects registered in the !OnTimeMeasure researcher web-portal to try out the software. We have integrated !OnTimeMeasure with 5 GENI projects: ProtoGENI ![3], !PlanetLab ![4], !InsTools ![5], CRON ![6] and Gush ![7]. [[BR]]
     19 * We have also made progress towards the GPO requirement to collaborate with related GENI measurement and security projects on a common GENI instrumentation and measurement architecture ![8]. [[BR]]
     20
     21=== B. Deliverables made ===
     22 * Released the latest !OnTimeMeasure software along with a tutorial slides and videos, source code tar files with documentation and installation instructions in the “Current Capabilities” section of the project wiki. We have also worked with Luisa Nevers at GPO to include all our software modules in the GENI Integration Release 3.1 [[BR]]
     23 * Presented a detailed hands-on tutorial on using !OnTimeMeasure software at GEC10 in the Experimenter Track. [[BR]]
     24 * Presented and Demonstrated !OnTimeMeasure software integration with Gush at GEC10 sessions (Demo Reception, GENI Project Highlights). [http://groups.geni.net/geni/attachment/wiki/GEC10ProjectHighlights/OnTimeMeasure-GUSH-GEC10.pptx OnTimeMeasure-Gush Integration Design and User Workflow Document] [[BR]]
     25 * Demonstrated capability to customize !OnTimeMeasure for an NSF-funded GENI experiment on dynamic resource allocation in virtual desktop clouds. [[BR]]
     26 * Actively participated in the GENI Instrumentation and Measurement Architecture (GIMA) document discussions at the GEC10 I&M Working Session. [[BR]]
     27 * Hired Yingxiao Xu, Postdoctoral Fellow at The Ohio State University to replace Kunpeng Zhu, who is graduating with his Master's degree from The Ohio State University. [[BR]]
     28 * Published quarterly status report document on the GENI project website. [[BR]]
     29
     30== II. Description of work performed during last quarter ==
     31
     32=== A. Activities and findings ===
     33
     34Details of our activities and findings between December 2010 - March 2011 are as follows:
     35
     36=== i. !OnTimeMeasure v1.0 Software Release: ===
     37We successfully completed several Spiral 3 milestones as planned: !OnTime: S3.a: Demonstrate !OnTimeMeasure with ProtoGENI and !PlanetLab sites; !OnTime: S3.b Release a software version of !OnTimeMeasure that can function across multiple aggregates; !OnTime: S3.c Integrate !OnTimeMeasure measurement service with experimenter workflow tools such as GUSH; !OnTime: S3.d Demonstrate the use of !OnTimeMeasure within a simple GENI Experiment. Our implementation of the !OnTimeMeasure software closely follows our high-level design that we have revised again in March 2011 based on the latest discussions within the GENI community ![1].
     38
     39!OnTimeMeasure measurement service is now available to users of ProtoGENI/Emulab, !PlanetLab and CRON aggregates. Users can submit measurement requests, control the measurement service, and query measurement data within ProtoGENI, !PlanetLab and CRON slices spanning geographically distributed sites within the GENI facility. !OnTimeMeasure has also been integrated with !InsTools and Gush. Integration summary is as follows: [[BR]]
     40''!OnTimeMeasure-ProtoGENI'', ''!OnTimeMeasure-!PlanetLab'' - I&M service for GENI aggregate users [[BR]]
     41''!OnTimeMeasure-Gush'' - I&M service control through Experimenter workflow tool [[BR]]
     42''!OnTimeMeasure*-INSTOOLS**'' - Both active* and passive** measurements in experiment slice [[BR]]
     43''!OnTimeMeasure-CRON'' - I&M service for 10Gbps network path experiments [[BR]]
     44
     45To start using !OnTimeMeasure, users can register and follow instructions presented at the researcher web-portal - http://ontime.oar.net
     46
     47For details, users can refer to - Tutorial Slides and Tutorial Videos ![1]; Wikis with Install Instructions: !OnTimeMeasure-ProtoGENI ![3], !OnTimeMeasure-!PlanetLab ![4], !OnTimeMeasure-!InsTools ![5], !OnTimeMeasure-CRON ![6], !OnTimeMeasure-Gush ![7].
     48
     49Following are the list of GENI-related projects who have registered in the researcher web-portal and are trying out the !OnTimeMeasure software:
     50 * GENI Project Office
     51 * CRON 10Gbps Testbed, Louisiana State University
     52 * GMOC, Indiana University
     53 * Instrumentation Tools, University of Kentucky
     54 * Kansei-Genie, The Ohio State University
     55 * Virtual Desktop Cloud Experiment, The Ohio State University
     56 * Experiments Security Analysis, University of Alabama
     57 * Digital Object Registry, CNRI
     58 * Davis Social Links, University of California, Davis
     59 * S3, Purdue University, HP Labs
     60 * PEIBAIRA, Rochester Institute of Technology
     61 * OptFI, University of Vienna
     62 * G-Lab, TU Kaiserslautern
     63 * !WiMax DDoS Experiment, Clemson University
     64 * Engineering Classroom Lab, Oklahoma State University
     65
     66All the above users have agreed to evaluate our software and provide feedback. In fact, many have already registered, evaluated the features and provided feedback to improve the documentation, installation procedures and usability.
     67
     68We also have released a complete version of our command-line tool (!OnTime Control) that uses XML-RPC messages to perform all the measurement service functions between client-and-server currently being done interactively with researcher web-portal (http://ontime.oar.net). For details, please see - http://groups.geni.net/geni/wiki/OTM-Control
     69
     70We presented a !OnTimeMeasure software tutorial at GEC10. The purpose of the tutorial was to inform GENI experimenters, and provide hands-on experience about how to use the !OnTimeMeasure measurement service to monitor their experiment environment, as well as collect and analyze on-going and on-demand measurements of network and system performance with their experiment slices. A list of topics that were covered in the tutorial are:
     71 * Use cases of experimenters that motivate the existing !OnTimeMeasure capabilities in GENI
     72 * Terminology and functions of software bundles: Node Beacon, Root Beacon, !OnTime Beacon, !OnTime Control
     73 * Taking advantage of integration with GENI projects: !OnTimeMeasure-ProtoGENI, !OnTimeMeasure-!PlanetLab, !OnTimeMeasure-CRON, !OnTimeMeasure-!InsTools, !OnTimeMeasure-GUSH
     74 * Example Experiment Demo: Demonstration of a GENI experiment requesting/managing/querying measurements through !OnTimeMeasure to address a network science and engineering research issue (e.g., resource allocation in a virtual desktop cloud)
     75
     76For details, please see - http://groups.geni.net/geni/wiki/GEC10OnTimeMeasureTutorial
     77
     78=== ii. GENI instrumentation and measurement architecture discussions: ===
     79We have also made progress towards the GPO requirement to collaborate with related GENI measurement and security projects on a common GENI instrumentation and measurement architecture. We are contributing towards sections on GENI I&M interfaces and protocols (APIs):  (a) data flows and data file transfers, and (b) service registration and discovery. Further, we are working with the Digital Object Repository project team to evaluate how our I&M services can interface with their recently released Measurement Archive prototype.
     80
     81=== iii.        Service activities relevant to the GENI community: ===
     82Prasad is advising Rohit Patali, Graduate Student at OSU Computer Science and Engg. Department, who is working on a GENI experiment funded by NSF titled - “Thin Client Performance Benchmarking Based Resource Adaptations in Virtual Desktop Clouds”. The goal of the experiment is to validate virtual desktop cloud related laboratory investigations under real system loads, and at the same time evaluate the capabilities of multiple kinds of GENI resources.
     83
     84Prasad is mentoring Alex Berryman, undergraduate student at The Ohio State University as the GENI related NSF REU Student who will be engaged in the R&D activities of !OnTimeMeasure.
     85
     86=== B. Project participants ===
     87The following participants have helped in the execution of the project activities described in this status report: [[BR]]
     88 * Prasad Calyam (PI) – Ohio Supercomputer Center/OARnet [[BR]]
     89 * Paul Schopis (Co-PI) – OARnet [[BR]]
     90 * Kunpeng (Tony) Zhu (Graduate Student Programmer) – Ohio Supercomputer Center [[BR]]
     91 * Rohit Patali (Graduate Research Associate) – OARnet [[BR]]
     92 * Alex Berryman (REU Student) – OARnet [[BR]]
     93 * Yingxiao Xu (!PostDoctoral Fellow) - Ohio Supercomputer Center [[BR]]
     94 * Mukundan Sridharan (!PostDoctoral Fellow) - OARnet [[BR]]
     95 * Rajive Ramnath (Professor) - The Ohio State University [[BR]]
     96
     97=== C. Publications (individual and organizational) ===
     98[http://groups.geni.net/geni/attachment/wiki/GEC10DemoSummary/OnTimeMeasure-GEC10-Poster.pdf?format=raw OnTimeMeasure GEC10 Demo Poster] [[BR]]
     99[http://ontime.oar.net/demo OnTimeMeasure VDCloud Experiment Demo Videos] [[BR]]
     100[http://groups.geni.net/geni/attachment/wiki/GEC10ProjectHighlights/OnTimeMeasure-GUSH-GEC10.pptx?format=raw OnTimeMeasure-Gush Integration] [[BR]]
     101[http://groups.geni.net/geni/attachment/wiki/OnTimeMeasure/OnTimeMeasure-GENI_HLD_Dec09.pdf OnTimeMeasure High-level Document (March 2011 Revision)]
     102[http://groups.geni.net/geni/attachment/wiki/GEC10ProjectHighlights/OnTimeMeasure-GUSH-GEC10.pptx OnTimeMeasure-Gush Integration Design and User Workflow]
     103
     104=== D. Outreach activities ===
     105 * P. Calyam, “!OnTimeMeasure Hands-on Tutorial”, GEC10 Experimenter Track, March 2011.
     106 * P. Calyam, “!OnTimeMeasure-Gush Integration Design and User Workflow”, Presentation at the Selected Project Highlights, GEC10, March 2011.
     107
     108=== E. Collaborations ===
     109We have been collaborating with several GENI project teams: ProtoGENI, GMOC, Instrumentation Tools, S3, Digital Object Repository, Kansei-Genie, CRON, VMI-FED, and Gush. We are also attending Cluster C conference calls regularly.
     110
     111=== F. Other Contributions ===
     112None.
     113
     114----
     115== References ==
     116
     117![1] !OnTimeMeasure-GENI Project Wiki – http://groups.geni.net/geni/wiki/OnTimeMeasure
     118
     119![2] P. Calyam, K. Zhu, “!OnTimeMeasure Project Experiences with using ProtoGENI in Spiral 2”, August 2010. http://groups.geni.net/geni/wiki/ExperienceWithProtoGENI
     120
     121![3] P. Calyam, K. Zhu, “!OnTimeMeasure Installation Procedure on ProtoGENI”, July 2010. http://groups.geni.net/geni/wiki/OnTime-Install
     122
     123![4] P. Calyam, R. Patali, K. Zhu, “!OnTimeMeasure Installation Procedure on !PlanetLab”, August 2010. http://groups.geni.net/geni/wiki/OTM-PlanetLabInstall
     124
     125![5] P. Calyam, R. Patali, “!OnTimeMeasure Integration Efforts with Instrumentation Tools”, August 2010. http://groups.geni.net/geni/wiki/OTM-InsToolsDemo
     126
     127![6] P. Calyam, K. Zhu, “!OnTimeMeasure Installation Procedure on CRON 10Gbps Testbed”, November 2010. http://groups.geni.net/geni/wiki/OTM-CRONInstall
     128
     129![7] P. Calyam, A. Berryman, K. Zhu, “!OnTimeMeasure Integration Efforts with Gush Experimenter Workflow Tool”, January 2011. http://groups.geni.net/geni/wiki/OTM-Gush
     130
     131![8] P. Calyam, “Use-cases for GENI Instrumentation and Measurement Architecture Design”, June 2010. http://groups.geni.net/geni/wiki/2ndInstMeasWork#Topic1GENIIMUseCases
     132
     133''This material is based upon work supported by the National Science Foundation under Grant No. CNS-0940805. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of BBN Technologies, Corp., the GENI Project Office, or the National Science Foundation.''