| 35 | | The scope of work on this project is to adapt the Handle System and/or |
| 36 | | a Digital Object Registry to realize a clearinghouse registry for |
| 37 | | principals, slices, and/or components in a selected GENI Spiral 1 control |
| 38 | | framework (possibly using XML RPC), and capable of |
| 39 | | supporting limited operations in Year 1. Also, to analyze how the |
| 40 | | Handle System and/or a Digital Object Registry could be used to |
| 41 | | identify and register GENI software, including experimenter’s tools, |
| 42 | | test images and configurations, and test results. And finally, to |
| 43 | | define the operational, scaling, security, and management |
| 44 | | requirements, plus recommended design approaches, for implementing |
| 45 | | GENI clearinghouse and software registry services. |
| | 47 | This project will develop and deploy the GIMI instrumentation and measurement framework, capable of supporting the needs of both GENI experimenters and GENI infrastructure operators. It uses the ORBIT Measurement Library (OML) and integrated Rule Oriented Data System (iRODS) as its basis. It will provide libraries to instrument resources, to filter and process measurement flows, and to consume measurement flows. It will use the iRODS data grid for archiving and further processing. It will include access control based on accepted GENI policy and authorization mechanisms. [[BR]] |
| | 48 | |
| | 49 | == Strategy and Goals == |
| | 50 | |
| | 51 | Its first goal is to provide easy-to-use I&M services for experimenters, who are deploying slices in GENI on selected types of servers, VMs and racks, interconnected by various types of network paths. [[BR]] |
| | 52 | |
| | 53 | Its second goal is to provide comprehensive infrastructure measurement services for infrastructure operators, who are deploying measurement slices on selected types of servers, VMs and racks, interconnected by a various types of network paths. In addition, slices established by other infrastructure operators, or by experimenters, can be authorized to gather data from the measurement slices. [[BR]] |
| | 54 | |
| | 55 | This project will build and operate two persistent services: the GENI Measurement Data Archive service (i.e., iRODs)and the GENI Experimenter Portal Service. These can be utilized by all types of GENI I&M services, including those developed in the GEMINI project. The GENI Experimenter Portal Service will be developed in cooperation with the GEMINI project, to support both GIMI and GEMINI tools. |
| | 56 | This project will use the GENI Measurement Data Object Descriptor (MDOD) schema, defined for use by all GENI I&M services. [[BR]] |
| | 57 | |
| | 58 | It may utilize two persistent services provided by the GEMINI project: the GENI Global I&M Registry (i.e., UNIS), and the GENI Event Messaging Service. [[BR]] |
| | 59 | |
| | 60 | The GIMI project will use the configuration shown in the diagram below. [[BR]] |
| | 61 | |
| | 62 | GIMI I&M Tools Configuration (p6) [[BR]] |
| | 63 | |
| | 64 | |
| | 73 | a) Define MeasurementDataObjectDescriptor (MDOD) schema, plus naming of objects and object registry, in collaboration with I&M teams and the GPO. (March 2012, GEC13) [[BR]] |
| | 74 | |
| | 75 | |
| | 76 | b) Define v0.5 I&M use cases for experiments and infrastructure monitoring, in collaboration with I&M teams, the GPO, experimenters and operators/GMOC. (February 2012) [[BR]] |
| | 77 | |
| | 78 | |
| | 79 | c) Develop reference v1.0 experiment control tools based on OMF and Gush (including OMNI) and document the interfaces, protocols, and APIs of these tools, in collaboration with I&M teams and the GPO. (March 2012, GEC13) [[BR]] |
| | 80 | |
| | 81 | |
| | 82 | d) Description of ontology extensions to cover measurement point resources (software and hardware). This will be integrated into ORCA per the ORCA-AUG SOW. (February 2012) [[BR]] |
| | 83 | |
| | 84 | |
| | 85 | e) Identify use cases and concept of operations for GENI messaging services, in cooperation with the IMF and GEMINI projects. (March 2012, GEC13) [[BR]] |
| | 86 | |
| | 87 | |
| | 88 | f) Deliver v0.5 definition of GIMI architecture and software modules for year 1, documented on GIMI web page. (February 2012) [[BR]] |
| | 89 | |
| | 90 | |
| | 91 | g) OML Release 2.7.0: (February 2012) [[BR]] |
| | 92 | |
| | 93 | 1. Fixing of current bugs affecting client apps or user's interpretation of data [[BR]] |
| | 94 | |
| | 95 | 2. Fixing of current deployment and user development issues [[BR]] |
| | 96 | |
| | 97 | 3. New features to improve measurement reporting and future analysis [[BR]] |
| | 98 | |
| | 99 | 4. New features to ease current usage and enable future features [[BR]] |
| | 100 | |
| | 101 | 5. Improved documentation [[BR]] |
| | 102 | |
| | 103 | |
| | 104 | h) Agree on v1.0 I&M use cases for experiments and infrastructure monitoring, in collaboration with I&M teams and the GPO, and document, including: (March 2012, GEC13) [[BR]] |
| | 105 | |
| | 106 | 1. WiMax [[BR]] |
| | 107 | |
| | 108 | 2. LEARN/BEN layer 0,1 or 2 real-time measurements [[BR]] |
| | 109 | |
| | 110 | 3. Sensor network (radars, power monitors) [[BR]] |
| | 111 | |
| | 112 | 4. Measure DiCloud workflow [[BR]] |
| | 113 | |
| | 114 | |
| | 115 | i) Compare available technology and prototypes for GENI messaging services, in cooperation with the IMF and GEMINI projects. (March 2012, GEC13) [[BR]] |
| | 116 | |
| | 117 | 1. Decide whether GENI Event Messaging Service being developed for GEMINI project could be used by GIMI tools. [[BR]] |
| | 118 | |
| | 119 | |
| | 120 | j) Agree on v1.0 definition of GIMI architecture and software modules for year 1 with the GPO, and document on GIMI web page. (March 2012, GEC13) [[BR]] |
| | 121 | |
| | 122 | |
| | 123 | |
| | 124 | k) Identify necessary mappings between iRods metadata catalog information and MDOD. (March 2012, GEC13) [[BR]] |
| | 125 | |
| | 126 | 1. MDOD will be created and edited as part of measurement orchestration, to be completed in Year 2 (Spiral 5). [[BR]] |
| | 127 | |
| | 128 | |
| | 129 | |
| | 130 | l) Agree on v1.0 target GENI environment for GIMI tools with I&M teams and the GPO (March 2012, GEC13) [[BR]] |
| | 131 | |
| | 132 | 1. Nominal v1.0 target aggregate is ORCA and ExoGENI racks; both servers and VMs; when VMs have private IP addresses, make use of RENCI’s proxy mechanism, which basically works like an automated NAT. [[BR]] |
| | 133 | |
| | 134 | 2. GIMI tools will come with an image; create template images with a basic configuration of tools which can be used and modified by other experimenters. [[BR]] |
| | 135 | |
| | 136 | 3. GIMI tools will be configured via OMF. [[BR]] |
| | 137 | |
| | 138 | |
| | 139 | m) Deliver Beta 1.0 of GIMI software (June 2012) [[BR]] |
| | 140 | |
| | 141 | 1. Utilize XML messaging service based on XMPP [[BR]] |
| | 142 | |
| | 143 | 2. Utilize OML servers that are part of the software release, and are run as part of the slice. [[BR]] |
| | 144 | |
| | 145 | 3. Visualization is provided by a standalone tool, that is run as part of the slice. [[BR]] |
| | 146 | |
| | 147 | 4. Demonstrate GIMI working on target aggregates, including ORCA and ExoGENI racks (if available), both servers and VMs. |
| | 148 | 5. Demonstrate some WiMAX measurement capabilities. |
| | 149 | 6. Demonstrate Layer 0,1 or 2 measurement capabilities (potentially a combined LEARN/CASA measurement depending on radar deployment in DFW) |
| | 150 | 7. If installed, demonstrate initial capabilities to monitor racks. |
| | 151 | |
| | 152 | n) Develop use cases and best practices for Experimenter Portal Service, and document (based on LabWiki, Max’s portal) (March 2012, GEC13) |
| | 153 | 1. In cooperation with the GEMINI project. |
| | 154 | 2. Goal is to have one portal service support both GIMI and GEMINI tools. |
| | 155 | |
| | 156 | |
| | 157 | o) Stand up a v1.0 prototype iRods datagrid. (March 2012, GEC13) |
| | 158 | 1. Ideally across at least two GIMI institutions |
| | 159 | 2. Identify/document the critical iRods microservices needed to support GENI. |
| | 160 | 3. Identify/document mechanisms to map GENI authorization onto iRods datagrid. |
| | 161 | 4. Share with GEMINI project |
| | 162 | |
| | 163 | p) Deliver Release 1.0 of GIMI software after functional and performance testing. (July 2012) |
| | 164 | 1. Document on GIMI web page |
| | 165 | 2. Provide support to early users |
| | 166 | |
| | 167 | q) OML Release 2.8.0: (June 2012) |
| | 168 | 1. Fixing of new bugs from previous release 2.7.0 |
| | 169 | 2. Fixing of user development issues |
| | 170 | 3. New features to improve data analysis |
| | 171 | 4. New features to improve filtering capabilities and re-design of filter handling system |
| | 172 | 5. New binding for additional languages (Python) |
| | 173 | 6. New OML application to collect measurements from SNMP agent (NICTA); should provide measurements equivalent to INSTOOLS |
| | 174 | 7. Improved documentation |
| | 175 | |
| | 176 | r) Provide v1.0 persistent Experimenter Portal Service (based on NICTA LabWiki) that can be used by GENI experimenters. (June 2012) |
| | 177 | 1. Allows users to keep a persistent log of their experiments |
| | 178 | 2. Includes OML server |
| | 179 | 3. May push measurement data to the iRODS archive |
| | 180 | 4. May retrieve measurement data stored in iRODs archive, and visualize it. (requires sql query support in iRODS, where an sql database can be “actively” hosted in iRODS, and someone can run queries against it. |
| | 181 | 5. Provision of a set of visualization tools to graphically present measurement data |
| | 182 | 6. Share with GEMINI project |
| | 183 | |
| | 184 | s) Demonstrate Release 1.0 GIMI tools for experimenter use cases (July 2012, GEC14) |
| | 185 | 1. Can push measurement data from OML server run as part of the slice, to the iRODS archive. |
| | 186 | 2. Feedback on use of v1.0 software by GPO and early users |
| | 187 | 3. Tutorial on v1.0 software for all users |
| | 188 | 4. Agree on definition of V1.1 release |
| | 189 | |
| | 190 | t) Demonstrate tool-based setup of basic set of measurements using Release 1.0 of GIMI tools (July 2012, GEC14) |
| | 191 | 1. WiFi |
| | 192 | 2. LEARN/BEN |
| | 193 | 3. Sensors |
| | 194 | |
| | 195 | u) Best-effort operation of persistent OML server in Experimenter Portal Service, for prototyping and testing. (July 2012, GEC14) |
| | 196 | 1. Can be accessed through Experimenter Portal Service |
| | 197 | |
| | 198 | v) Prototype orchestration capability, using OMF EC and RC (July 2012, GEC14) |
| | 199 | |
| | 200 | w) Deliver Release 1.1 of GIMI software, with fixes and small features. (October 2012) |
| | 201 | |
| | 202 | x) OML Release 2.9.0: (October 2012) |
| | 203 | 1. Fixing of new bugs from previous release 2.8.0, stress test disconnection mode |
| | 204 | 2. New features to improve data analysis |
| | 205 | 3. New features to support IPv6 and IPv4/v6 address in databases |
| | 206 | 4. New features to improve filtering capabilities: filter composition/stacking |
| | 207 | 5. New binding for additional languages (Java/JNI) |
| | 208 | 6. New platform support: Android (experimental) |
| | 209 | 7. Improved documentation |
| | 210 | |
| | 211 | |
