| | 1 | = OnTimeMeasure: Centralized and Distributed Measurement Orchestration Software = |
| | 2 | '''Quarterly Status Report Document for Global Environment for Network Innovations (GENI) Spiral 3 Project # 1764''' |
| | 3 | |
| | 4 | '''Prasad Calyam (PI) and Paul Schopis (Co-PI)''' |
| | 5 | |
| | 6 | '''Ohio Supercomputer Center/OARnet, The Ohio State University''' |
| | 7 | |
| | 8 | ''Update Period: December 2010 - March 2011'' |
| | 9 | |
| | 10 | [[PageOutline]] |
| | 11 | |
| | 12 | ---- |
| | 13 | == I. Major accomplishments == |
| | 14 | |
| | 15 | === A. Milestones achieved === |
| | 16 | In the project period between December 2010 - March 2011 in GENI Spiral 3, we have made significant progress towards our milestones ![1]. A summary of our accomplishments is as follows: [[BR]] |
| | 17 | * We successfully completed several Spiral 3 milestones as planned: !OnTime: S3.a: Demonstrate !OnTimeMeasure with ProtoGENI and !PlanetLab sites; !OnTime: S3.b Release a software version of !OnTimeMeasure that can function across multiple aggregates; !OnTime: S3.c Integrate !OnTimeMeasure measurement service with experimenter workflow tools such as GUSH; !OnTime: S3.d Demonstrate the use of !OnTimeMeasure within a simple GENI Experiment [[BR]] |
| | 18 | * To date, we have approx. 25 users from 14 GENI-related projects registered in the !OnTimeMeasure researcher web-portal to try out the software. We have integrated !OnTimeMeasure with 5 GENI projects: ProtoGENI ![3], !PlanetLab ![4], !InsTools ![5], CRON ![6] and Gush ![7]. [[BR]] |
| | 19 | * We have also made progress towards the GPO requirement to collaborate with related GENI measurement and security projects on a common GENI instrumentation and measurement architecture ![8]. [[BR]] |
| | 20 | |
| | 21 | === B. Deliverables made === |
| | 22 | * Released the latest !OnTimeMeasure software along with a tutorial slides and videos, source code tar files with documentation and installation instructions in the “Current Capabilities” section of the project wiki. We have also worked with Luisa Nevers at GPO to include all our software modules in the GENI Integration Release 3.1 [[BR]] |
| | 23 | * Presented a detailed hands-on tutorial on using !OnTimeMeasure software at GEC10 in the Experimenter Track. [[BR]] |
| | 24 | * Presented and Demonstrated !OnTimeMeasure software integration with Gush at GEC10 sessions (Demo Reception, GENI Project Highlights). [http://groups.geni.net/geni/attachment/wiki/GEC10ProjectHighlights/OnTimeMeasure-GUSH-GEC10.pptx OnTimeMeasure-Gush Integration Design and User Workflow Document] [[BR]] |
| | 25 | * Demonstrated capability to customize !OnTimeMeasure for an NSF-funded GENI experiment on dynamic resource allocation in virtual desktop clouds. [[BR]] |
| | 26 | * Actively participated in the GENI Instrumentation and Measurement Architecture (GIMA) document discussions at the GEC10 I&M Working Session. [[BR]] |
| | 27 | * Hired Yingxiao Xu, Postdoctoral Fellow at The Ohio State University to replace Kunpeng Zhu, who is graduating with his Master's degree from The Ohio State University. [[BR]] |
| | 28 | * Published quarterly status report document on the GENI project website. [[BR]] |
| | 29 | |
| | 30 | == II. Description of work performed during last quarter == |
| | 31 | |
| | 32 | === A. Activities and findings === |
| | 33 | |
| | 34 | Details of our activities and findings between December 2010 - March 2011 are as follows: |
| | 35 | |
| | 36 | === i. !OnTimeMeasure v1.0 Software Release: === |
| | 37 | We successfully completed several Spiral 3 milestones as planned: !OnTime: S3.a: Demonstrate !OnTimeMeasure with ProtoGENI and !PlanetLab sites; !OnTime: S3.b Release a software version of !OnTimeMeasure that can function across multiple aggregates; !OnTime: S3.c Integrate !OnTimeMeasure measurement service with experimenter workflow tools such as GUSH; !OnTime: S3.d Demonstrate the use of !OnTimeMeasure within a simple GENI Experiment. Our implementation of the !OnTimeMeasure software closely follows our high-level design that we have revised again in March 2011 based on the latest discussions within the GENI community ![1]. |
| | 38 | |
| | 39 | !OnTimeMeasure measurement service is now available to users of ProtoGENI/Emulab, !PlanetLab and CRON aggregates. Users can submit measurement requests, control the measurement service, and query measurement data within ProtoGENI, !PlanetLab and CRON slices spanning geographically distributed sites within the GENI facility. !OnTimeMeasure has also been integrated with !InsTools and Gush. Integration summary is as follows: [[BR]] |
| | 40 | ''!OnTimeMeasure-ProtoGENI'', ''!OnTimeMeasure-!PlanetLab'' - I&M service for GENI aggregate users [[BR]] |
| | 41 | ''!OnTimeMeasure-Gush'' - I&M service control through Experimenter workflow tool [[BR]] |
| | 42 | ''!OnTimeMeasure*-INSTOOLS**'' - Both active* and passive** measurements in experiment slice [[BR]] |
| | 43 | ''!OnTimeMeasure-CRON'' - I&M service for 10Gbps network path experiments [[BR]] |
| | 44 | |
| | 45 | To start using !OnTimeMeasure, users can register and follow instructions presented at the researcher web-portal - http://ontime.oar.net |
| | 46 | |
| | 47 | For details, users can refer to - Tutorial Slides and Tutorial Videos ![1]; Wikis with Install Instructions: !OnTimeMeasure-ProtoGENI ![3], !OnTimeMeasure-!PlanetLab ![4], !OnTimeMeasure-!InsTools ![5], !OnTimeMeasure-CRON ![6], !OnTimeMeasure-Gush ![7]. |
| | 48 | |
| | 49 | Following are the list of GENI-related projects who have registered in the researcher web-portal and are trying out the !OnTimeMeasure software: |
| | 50 | * GENI Project Office |
| | 51 | * CRON 10Gbps Testbed, Louisiana State University |
| | 52 | * GMOC, Indiana University |
| | 53 | * Instrumentation Tools, University of Kentucky |
| | 54 | * Kansei-Genie, The Ohio State University |
| | 55 | * Virtual Desktop Cloud Experiment, The Ohio State University |
| | 56 | * Experiments Security Analysis, University of Alabama |
| | 57 | * Digital Object Registry, CNRI |
| | 58 | * Davis Social Links, University of California, Davis |
| | 59 | * S3, Purdue University, HP Labs |
| | 60 | * PEIBAIRA, Rochester Institute of Technology |
| | 61 | * OptFI, University of Vienna |
| | 62 | * G-Lab, TU Kaiserslautern |
| | 63 | * !WiMax DDoS Experiment, Clemson University |
| | 64 | * Engineering Classroom Lab, Oklahoma State University |
| | 65 | |
| | 66 | All the above users have agreed to evaluate our software and provide feedback. In fact, many have already registered, evaluated the features and provided feedback to improve the documentation, installation procedures and usability. |
| | 67 | |
| | 68 | We also have released a complete version of our command-line tool (!OnTime Control) that uses XML-RPC messages to perform all the measurement service functions between client-and-server currently being done interactively with researcher web-portal (http://ontime.oar.net). For details, please see - http://groups.geni.net/geni/wiki/OTM-Control |
| | 69 | |
| | 70 | We presented a !OnTimeMeasure software tutorial at GEC10. The purpose of the tutorial was to inform GENI experimenters, and provide hands-on experience about how to use the !OnTimeMeasure measurement service to monitor their experiment environment, as well as collect and analyze on-going and on-demand measurements of network and system performance with their experiment slices. A list of topics that were covered in the tutorial are: |
| | 71 | * Use cases of experimenters that motivate the existing !OnTimeMeasure capabilities in GENI |
| | 72 | * Terminology and functions of software bundles: Node Beacon, Root Beacon, !OnTime Beacon, !OnTime Control |
| | 73 | * Taking advantage of integration with GENI projects: !OnTimeMeasure-ProtoGENI, !OnTimeMeasure-!PlanetLab, !OnTimeMeasure-CRON, !OnTimeMeasure-!InsTools, !OnTimeMeasure-GUSH |
| | 74 | * Example Experiment Demo: Demonstration of a GENI experiment requesting/managing/querying measurements through !OnTimeMeasure to address a network science and engineering research issue (e.g., resource allocation in a virtual desktop cloud) |
| | 75 | |
| | 76 | For details, please see - http://groups.geni.net/geni/wiki/GEC10OnTimeMeasureTutorial |
| | 77 | |
| | 78 | === ii. GENI instrumentation and measurement architecture discussions: === |
| | 79 | We have also made progress towards the GPO requirement to collaborate with related GENI measurement and security projects on a common GENI instrumentation and measurement architecture. We are contributing towards sections on GENI I&M interfaces and protocols (APIs): (a) data flows and data file transfers, and (b) service registration and discovery. Further, we are working with the Digital Object Repository project team to evaluate how our I&M services can interface with their recently released Measurement Archive prototype. |
| | 80 | |
| | 81 | === iii. Service activities relevant to the GENI community: === |
| | 82 | Prasad is advising Rohit Patali, Graduate Student at OSU Computer Science and Engg. Department, who is working on a GENI experiment funded by NSF titled - “Thin Client Performance Benchmarking Based Resource Adaptations in Virtual Desktop Clouds”. The goal of the experiment is to validate virtual desktop cloud related laboratory investigations under real system loads, and at the same time evaluate the capabilities of multiple kinds of GENI resources. |
| | 83 | |
| | 84 | Prasad is mentoring Alex Berryman, undergraduate student at The Ohio State University as the GENI related NSF REU Student who will be engaged in the R&D activities of !OnTimeMeasure. |
| | 85 | |
| | 86 | === B. Project participants === |
| | 87 | The following participants have helped in the execution of the project activities described in this status report: [[BR]] |
| | 88 | * Prasad Calyam (PI) – Ohio Supercomputer Center/OARnet [[BR]] |
| | 89 | * Paul Schopis (Co-PI) – OARnet [[BR]] |
| | 90 | * Kunpeng (Tony) Zhu (Graduate Student Programmer) – Ohio Supercomputer Center [[BR]] |
| | 91 | * Rohit Patali (Graduate Research Associate) – OARnet [[BR]] |
| | 92 | * Alex Berryman (REU Student) – OARnet [[BR]] |
| | 93 | * Yingxiao Xu (!PostDoctoral Fellow) - Ohio Supercomputer Center [[BR]] |
| | 94 | * Mukundan Sridharan (!PostDoctoral Fellow) - OARnet [[BR]] |
| | 95 | * Rajive Ramnath (Professor) - The Ohio State University [[BR]] |
| | 96 | |
| | 97 | === C. Publications (individual and organizational) === |
| | 98 | [http://groups.geni.net/geni/attachment/wiki/GEC10DemoSummary/OnTimeMeasure-GEC10-Poster.pdf?format=raw OnTimeMeasure GEC10 Demo Poster] [[BR]] |
| | 99 | [http://ontime.oar.net/demo OnTimeMeasure VDCloud Experiment Demo Videos] [[BR]] |
| | 100 | [http://groups.geni.net/geni/attachment/wiki/GEC10ProjectHighlights/OnTimeMeasure-GUSH-GEC10.pptx?format=raw OnTimeMeasure-Gush Integration] [[BR]] |
| | 101 | [http://groups.geni.net/geni/attachment/wiki/OnTimeMeasure/OnTimeMeasure-GENI_HLD_Dec09.pdf OnTimeMeasure High-level Document (March 2011 Revision)] |
| | 102 | [http://groups.geni.net/geni/attachment/wiki/GEC10ProjectHighlights/OnTimeMeasure-GUSH-GEC10.pptx OnTimeMeasure-Gush Integration Design and User Workflow] |
| | 103 | |
| | 104 | === D. Outreach activities === |
| | 105 | * P. Calyam, “!OnTimeMeasure Hands-on Tutorial”, GEC10 Experimenter Track, March 2011. |
| | 106 | * P. Calyam, “!OnTimeMeasure-Gush Integration Design and User Workflow”, Presentation at the Selected Project Highlights, GEC10, March 2011. |
| | 107 | |
| | 108 | === E. Collaborations === |
| | 109 | We have been collaborating with several GENI project teams: ProtoGENI, GMOC, Instrumentation Tools, S3, Digital Object Repository, Kansei-Genie, CRON, VMI-FED, and Gush. We are also attending Cluster C conference calls regularly. |
| | 110 | |
| | 111 | === F. Other Contributions === |
| | 112 | None. |
| | 113 | |
| | 114 | ---- |
| | 115 | == References == |
| | 116 | |
| | 117 | ![1] !OnTimeMeasure-GENI Project Wiki – http://groups.geni.net/geni/wiki/OnTimeMeasure |
| | 118 | |
| | 119 | ![2] P. Calyam, K. Zhu, “!OnTimeMeasure Project Experiences with using ProtoGENI in Spiral 2”, August 2010. http://groups.geni.net/geni/wiki/ExperienceWithProtoGENI |
| | 120 | |
| | 121 | ![3] P. Calyam, K. Zhu, “!OnTimeMeasure Installation Procedure on ProtoGENI”, July 2010. http://groups.geni.net/geni/wiki/OnTime-Install |
| | 122 | |
| | 123 | ![4] P. Calyam, R. Patali, K. Zhu, “!OnTimeMeasure Installation Procedure on !PlanetLab”, August 2010. http://groups.geni.net/geni/wiki/OTM-PlanetLabInstall |
| | 124 | |
| | 125 | ![5] P. Calyam, R. Patali, “!OnTimeMeasure Integration Efforts with Instrumentation Tools”, August 2010. http://groups.geni.net/geni/wiki/OTM-InsToolsDemo |
| | 126 | |
| | 127 | ![6] P. Calyam, K. Zhu, “!OnTimeMeasure Installation Procedure on CRON 10Gbps Testbed”, November 2010. http://groups.geni.net/geni/wiki/OTM-CRONInstall |
| | 128 | |
| | 129 | ![7] P. Calyam, A. Berryman, K. Zhu, “!OnTimeMeasure Integration Efforts with Gush Experimenter Workflow Tool”, January 2011. http://groups.geni.net/geni/wiki/OTM-Gush |
| | 130 | |
| | 131 | ![8] P. Calyam, “Use-cases for GENI Instrumentation and Measurement Architecture Design”, June 2010. http://groups.geni.net/geni/wiki/2ndInstMeasWork#Topic1GENIIMUseCases |
| | 132 | |
| | 133 | ''This material is based upon work supported by the National Science Foundation under Grant No. CNS-0940805. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of BBN Technologies, Corp., the GENI Project Office, or the National Science Foundation.'' |
