| | 1 | = OnTimeMeasure: Centralized and Distributed Measurement Orchestration Software = |
| | 2 | '''Quarterly Status Report Document for Global Environment for Network Innovations (GENI) Spiral 3 Project # 1764''' |
| | 3 | |
| | 4 | '''Prasad Calyam (PI) and Paul Schopis (Co-PI)''' |
| | 5 | |
| | 6 | '''Ohio Supercomputer Center/OARnet, The Ohio State University''' |
| | 7 | |
| | 8 | ''Update Period: April 2011 - July 2011'' |
| | 9 | |
| | 10 | [[PageOutline]] |
| | 11 | |
| | 12 | ---- |
| | 13 | == I. Major accomplishments == |
| | 14 | |
| | 15 | === A. Milestones achieved === |
| | 16 | In the project period between April 2011 - July 2011 in GENI Spiral 3, we have made significant progress towards our milestones ![1]. A summary of our accomplishments is as follows: [[BR]] |
| | 17 | * We successfully completed the latest Spiral 3 milestone as planned: !OnTime: S3.e Demonstrate the use of OnTimeMeasure within a GENI experiment that utilizes multiple GENI tools/services [[BR]] |
| | 18 | * To date, we have 41 users from 16 GENI-related projects registered in the !OnTimeMeasure researcher web-portal to try out the software. We have integrated !OnTimeMeasure with 6 GENI projects: ProtoGENI ![3], !PlanetLab ![4], !InsTools ![5], CRON ![6] Gush ![7], and DOR ![8]. [[BR]] |
| | 19 | * We have also made progress towards the GPO requirement to collaborate with related GENI measurement and security projects on a common GENI instrumentation and measurement architecture ![8]. [[BR]] |
| | 20 | |
| | 21 | === B. Deliverables made === |
| | 22 | * Released the latest !OnTimeMeasure software along with a tutorial slides and videos, source code tar files with documentation and installation instructions in the “Current Capabilities” section of the project wiki. We have also worked with Luisa Nevers at GPO to include all our latest software modules in the GENI Integration Release 3.2 [[BR]] |
| | 23 | * Developed capability to customize !OnTimeMeasure for an NSF-funded GENI experiment titled "Emulating Cloud Dynamics for performance sensitive applications" led by Purdue University. Previously, at GEC10, we integrated !OnTimeMeasure with the NSF-funded experiment titled "Resource allocation in virtual desktop clouds" led by The Ohio State University. We are also actively working towards integration of !OnTimeMeasure with the NSF-funded GENI experiment titled "Evaluation of Intra-domain Bandwidth Allocation and Inter-domain Routing Algorithms" led by Rochester Institute of Technology. [[BR]] |
| | 24 | * Presented a status update of !OnTimeMeasure software at GEC11. More specifically, we presented and demonstrated !OnTimeMeasure software integration with DOR i.e., GENI Measurement Archive at GEC11 poster session as well as in the GEC11 I&M Working Session. [http://groups.geni.net/geni/attachment/wiki/GEC10ProjectHighlights/OnTimeMeasure-GEC11.pptx OnTimeMeasure-DOR Integration Slides] [http://groups.geni.net/geni/attachment/wiki/OTM-DOR OnTimeMeasure-DOR Integration Wiki]. We also actively participated in the GENI Instrumentation and Measurement Architecture (GIMA) document discussions relating to Measurement Data Object Descriptor (MDOD) data model at the GEC11 I&M Working Session. [[BR]] |
| | 25 | * Published quarterly status report document on the GENI project website. [[BR]] |
| | 26 | |
| | 27 | == II. Description of work performed during last quarter == |
| | 28 | |
| | 29 | === A. Activities and findings === |
| | 30 | |
| | 31 | Details of our activities and findings between April 2011 - July 2011 are as follows: |
| | 32 | |
| | 33 | === i. !OnTimeMeasure v1.0 Software Release: === |
| | 34 | We successfully completed the latest Spiral 3 milestone as planned: !OnTime: S3.e Demonstrate the use of OnTimeMeasure within a GENI experiment that utilizes multiple GENI tools/services [[BR]] |
| | 35 | |
| | 36 | !OnTimeMeasure measurement service is now available to users of ProtoGENI/Emulab, !PlanetLab and CRON aggregates. Users can submit measurement requests, control the measurement service, and query measurement data within ProtoGENI, !PlanetLab and CRON slices spanning geographically distributed sites within the GENI facility. !OnTimeMeasure has also been integrated with !InsTools, Gush and DOR. Integration summary is as follows: [[BR]] |
| | 37 | ''!OnTimeMeasure-ProtoGENI'', ''!OnTimeMeasure-!PlanetLab'' - I&M service for GENI aggregate users [[BR]] |
| | 38 | ''!OnTimeMeasure-Gush'' - I&M service control through Experimenter workflow tool [[BR]] |
| | 39 | ''!OnTimeMeasure*-INSTOOLS**'' - Both active* and passive** measurements in experiment slice [[BR]] |
| | 40 | ''!OnTimeMeasure-CRON'' - I&M service for 10Gbps network path experiments [[BR]] |
| | 41 | ''!OnTimeMeasure-DOR'' - Persistent storage of I&M data within user slice into GENI measurement archive [[BR]] |
| | 42 | |
| | 43 | To start using !OnTimeMeasure, users can register and follow instructions presented at the researcher web-portal - http://ontime.oar.net |
| | 44 | |
| | 45 | For details, users can refer to - Tutorial Slides and Tutorial Videos ![1]; Wikis with Install and/or Usage Instructions: !OnTimeMeasure-ProtoGENI ![3], !OnTimeMeasure-!PlanetLab ![4], !OnTimeMeasure-!InsTools ![5], !OnTimeMeasure-CRON ![6], !OnTimeMeasure-Gush ![7], !OnTimeMeasure-DOR ![8]. |
| | 46 | |
| | 47 | Following are the list of GENI-related projects who have registered in the researcher web-portal and are trying out the !OnTimeMeasure software: |
| | 48 | * GENI Project Office |
| | 49 | * CRON 10Gbps Testbed, Louisiana State University |
| | 50 | * GMOC, Indiana University |
| | 51 | * Instrumentation Tools, University of Kentucky |
| | 52 | * Kansei-Genie, The Ohio State University |
| | 53 | * Virtual Desktop Clouds, The Ohio State University |
| | 54 | * Experiments Security Analysis, University of Alabama |
| | 55 | * Digital Object Registry, CNRI |
| | 56 | * Davis Social Links, University of California, Davis |
| | 57 | * S3, Purdue University, HP Labs |
| | 58 | * Intra-domain Bandwidth Allocation, Rochester Institute of Technology |
| | 59 | * OptFI, University of Vienna |
| | 60 | * G-Lab, TU Kaiserslautern |
| | 61 | * !WiMax DDoS Experiment, Clemson University |
| | 62 | * Engineering Classroom Lab, Oklahoma State University |
| | 63 | * Networking for distributed manufacturing, University of Akron |
| | 64 | * Emulating Cloud Dynamics, Purdue University |
| | 65 | |
| | 66 | All the above users have agreed to evaluate our software and provide feedback. In fact, many have already registered, evaluated the features and provided feedback to improve the documentation, installation procedures and usability. |
| | 67 | |
| | 68 | We also have released a complete version of our command-line tool (!OnTime Control) that uses XML-RPC messages to perform all the measurement service functions between client-and-server currently being done interactively with researcher web-portal (http://ontime.oar.net). For details of the !OnTime Control tool, please see - http://groups.geni.net/geni/wiki/OTM-Control. Experimenters can use any other client that supports XML-RPC to communicate with the various !OnTimeMeasure web services. A complete list of web services implemented can be found at - http://groups.geni.net/geni/wiki/OTM-Webservices |
| | 69 | |
| | 70 | We are working on a "new metric integration" feature that allows Experimenters to add their custom measurement metrics into the measurement service. The motivation for this feature is that the Experimenters not only want to use off-the-shelf tools (e.g., Ping, Netflow) within measurement services in GENI, but also other tools they have developed or others have developed that are relevant to their experiment. Based upon our discussions with Experimenters from OSU, Purdue and RIT, we have development a design document, whose salient aspects can be found in the GEC11 I&M Working Session presentation slides. [http://groups.geni.net/geni/attachment/wiki/GEC10ProjectHighlights/OnTimeMeasure-GEC11.pptx !OnTimeMeasure New Metric Integration Feature Slides] |
| | 71 | |
| | 72 | We broadly described to the GENI community, how OnTimeMeasure software was being used within the OSU Virtual Desktop Cloud experiment during the [http://groups.geni.net/geni/attachment/wiki/Gec11Agenda/Lightning%201%20Prasad%20Calyam%20Resource%20Allocation%20in%20Virtual%20Desktop%20Clouds%20VMLab-GENI%20Experiment.pdf GEC11 Plenary Talk] and [http://groups.geni.net/geni/attachment/wiki/GEC11ExperimenterFeedbackRoundtable/Prasad-Experimenter-RT-GEC11.pdf Experimenter Round-table Talk]. For details, please refer to - |
| | 73 | [http://groups.geni.net/geni/attachment/wiki/OnTimeMeasure/OnTimeMeasure-VDCloud.pdf Paper on OnTimeMeasure Integration in Virtual Desktop Cloud GENI Experiment] |
| | 74 | |
| | 75 | === ii. GENI instrumentation and measurement architecture discussions: === |
| | 76 | We have also made progress towards the GPO requirement to collaborate with related GENI measurement and security projects on a common GENI instrumentation and measurement architecture. We have investigated how !OnTimeMeasure's current meta-data collection can be mapped to the GENI Measurement Data Object Descriptor (MDOD) data model. More specifically, we have identified the use cases, identifiers, descriptors and handlers within !OnTimeMeasure to map to the early version of the GENI MDOD data model. We plan to work on a prototype implementation in !OnTimeMeasure to couple XML records for different measurement objects such that they are compliant with the GENI MDOD data model that is being developed within the I&M working sessions. |
| | 77 | |
| | 78 | === iii. Service activities relevant to the GENI community: === |
| | 79 | Prasad is advising Aishwarya Venkataraman, Graduate Student at OSU Computer Science and Engg. Department, who is working on a GENI experiment funded by NSF titled - “Thin Client Performance Benchmarking Based Resource Adaptations in Virtual Desktop Clouds”. The goal of the experiment is to validate virtual desktop cloud related laboratory investigations under real system loads, and at the same time evaluate the capabilities of multiple kinds of GENI resources. |
| | 80 | |
| | 81 | Prasad was mentoring Alex Berryman, undergraduate student at The Ohio State University until June 31st 2011 as the GENI related NSF REU Student who was engaged in the R&D activities of !OnTimeMeasure. |
| | 82 | |
| | 83 | Prasad has been invited for an NSF-sponsored Workshop on Information Centric Engineering (ICE) and Cybertechnologies to be held in Hersonissos, Greece on Oct 19 and 20. He is a member of the workshop organizing committee, and will serve as speaker and moderator for the proposed session on GENI and emerging cyber technologies. |
| | 84 | |
| | 85 | === B. Project participants === |
| | 86 | The following participants have helped in the execution of the project activities described in this status report: [[BR]] |
| | 87 | * Prasad Calyam (PI) – Ohio Supercomputer Center/OARnet [[BR]] |
| | 88 | * Paul Schopis (Co-PI) – OARnet [[BR]] |
| | 89 | * Rohit Patali (Graduate Research Associate) – OARnet [[BR]] |
| | 90 | * Alex Berryman (REU Student) – OARnet [[BR]] |
| | 91 | * Yingxiao Xu (!PostDoctoral Fellow) - Ohio Supercomputer Center [[BR]] |
| | 92 | * Mukundan Sridharan (!PostDoctoral Fellow) - OARnet [[BR]] |
| | 93 | * Rajiv Ramnath (Professor) - The Ohio State University [[BR]] |
| | 94 | |
| | 95 | === C. Publications (individual and organizational) === |
| | 96 | [http://groups.geni.net/geni/attachment/wiki/OnTimeMeasure/OnTimeMeasure_GEC11-Poster.pdf GEC11 Demo Poster] [[BR]] |
| | 97 | [http://ontime.oar.net/demo OnTimeMeasure-DOR Integration Demo Video] [[BR]] |
| | 98 | [http://groups.geni.net/geni/attachment/wiki/GEC10ProjectHighlights/OnTimeMeasure-GEC11.pptx OnTimeMeasure-DOR Integration and New Metric Integration Feature] [[BR]] |
| | 99 | [http://groups.geni.net/geni/attachment/wiki/OnTimeMeasure/OnTimeMeasure-VDCloud.pdf Paper on OnTimeMeasure Integration in Virtual Desktop Cloud GENI Experiment] |
| | 100 | |
| | 101 | === D. Outreach activities === |
| | 102 | * P. Calyam, “!OnTimeMeasure Status Update”, GEC11 I&M Working Session, July 2011. |
| | 103 | * P. Calyam, “Resource Allocation in Virtual Desktop Clouds - VMLab-GENI Experiment”, GEC11 Plenary Lightning Talk, July 2011. |
| | 104 | * P. Calyam, “OSU Experiment Feedback to GENI Developers”, GEC11 Experimenter Roundtable Talk, July 2011. |
| | 105 | |
| | 106 | === E. Collaborations === |
| | 107 | We have been collaborating with several GENI project teams: ProtoGENI, GMOC, Instrumentation Tools, S3, Digital Object Repository, Kansei-Genie, CRON, VMI-FED, and Gush. We are also attending Cluster C conference calls regularly. |
| | 108 | |
| | 109 | === F. Other Contributions === |
| | 110 | None. |
| | 111 | |
| | 112 | ---- |
| | 113 | == References == |
| | 114 | |
| | 115 | ![1] !OnTimeMeasure-GENI Project Wiki – http://groups.geni.net/geni/wiki/OnTimeMeasure |
| | 116 | |
| | 117 | ![2] P. Calyam, K. Zhu, “!OnTimeMeasure Project Experiences with using ProtoGENI in Spiral 2”, August 2010. http://groups.geni.net/geni/wiki/ExperienceWithProtoGENI |
| | 118 | |
| | 119 | ![3] P. Calyam, K. Zhu, “!OnTimeMeasure Installation Procedure on ProtoGENI”, July 2010. http://groups.geni.net/geni/wiki/OnTime-Install |
| | 120 | |
| | 121 | ![4] P. Calyam, R. Patali, K. Zhu, “!OnTimeMeasure Installation Procedure on !PlanetLab”, August 2010. http://groups.geni.net/geni/wiki/OTM-PlanetLabInstall |
| | 122 | |
| | 123 | ![5] P. Calyam, R. Patali, “!OnTimeMeasure Integration Efforts with Instrumentation Tools”, August 2010. http://groups.geni.net/geni/wiki/OTM-InsToolsDemo |
| | 124 | |
| | 125 | ![6] P. Calyam, K. Zhu, “!OnTimeMeasure Installation Procedure on CRON 10Gbps Testbed”, November 2010. http://groups.geni.net/geni/wiki/OTM-CRONInstall |
| | 126 | |
| | 127 | ![7] P. Calyam, A. Berryman, K. Zhu, “!OnTimeMeasure Integration Efforts with Gush Experimenter Workflow Tool”, January 2011. http://groups.geni.net/geni/wiki/OTM-Gush |
| | 128 | |
| | 129 | ![8] P. Calyam, Y. Zhu, “!OnTimeMeasure Integration Efforts with Digital Object Repository”, June 2011. http://groups.geni.net/geni/wiki/OTM-DOR |
| | 130 | |
| | 131 | ''This material is based upon work supported by the National Science Foundation under Grant No. CNS-0940805. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of BBN Technologies, Corp., the GENI Project Office, or the National Science Foundation.'' |
