| 1 | [[PageOutline]] |
| 2 | |
| 3 | = Instrumentation and Measurement (I&M) Design Topics = |
| 4 | |
| 5 | Monday, July 9, 8am - 10am [[BR]] |
| 6 | Room: [[BR]] |
| 7 | Session leader: Harry Mussman (GENI Project Office, Raytheon BBN Technologies) [[BR]] |
| 8 | |
| 9 | == Description == |
| 10 | |
| 11 | This is the I&M working session that will review progress towards a comprehensive set of I&M tools for GENI experimenters and for infrastructure measurement. [[BR]] |
| 12 | |
| 13 | It will start with reports from several of the design topic teams formed at the GEC-12 working session; these will include the contributions of the I&M projects continuing from Solicitation 2. [[BR]] |
| 14 | |
| 15 | Then the two large Solicitation 3 I&M D&P projects, GIMI and GEMINI, will review their progress. [[BR]] |
| 16 | |
| 17 | Finally, we will discuss how to support experimenters and infrastructure measurement. [[BR]] |
| 18 | |
| 19 | |
| 20 | == Summary == |
| 21 | |
| 22 | |
| 23 | == Agenda == |
| 24 | This is a tentative agenda, which may change. [[BR]] |
| 25 | |
| 26 | == 1) Introductions == |
| 27 | 10:00am [[BR]] |
| 28 | |
| 29 | |
| 30 | == 2) Reports by I&M design topic teams == |
| 31 | 10:05am [[BR]] |
| 32 | |
| 33 | At GEC12, nine I&M priority design topics were identified, and nine teams were assigned to understand and resolve these topics by GEC13. [[BR]] |
| 34 | |
| 35 | See the [http://groups.geni.net/geni/wiki/InstMeasCurrentDesignTopicsAll list of topics], including a brief summary of each topic. [[BR]] |
| 36 | |
| 37 | |
| 38 | === T2) I&M Use Cases for Experiments, and Support for Experimenters === |
| 39 | 10:05am [[BR]] |
| 40 | |
| 41 | Team [[BR]] |
| 42 | CO-LEAD Jim Griffioen (U Kentucky) [[BR]] |
| 43 | CO-LEAD Mike Zink (UMass Amherst) [[BR]] |
| 44 | Hussamuddin Nasir (U Kentucky) [[BR]] |
| 45 | David Irwin (UMass Amherst) [[BR]] |
| 46 | Max Ott (NICTA) [[BR]] |
| 47 | Prasad Calyam (Ohio Super Center) [[BR]] |
| 48 | Harry Mussman (GPO) [[BR]] |
| 49 | |
| 50 | |
| 51 | Tasks [[BR]] |
| 52 | Provide a concise but complete definition of I&M Use Cases for Experiments [[BR]] |
| 53 | Define use cases for a wide range of experiments: complex (by skilled experimenters) to simple (by novice experimenter, i.e., a student) [[BR]] |
| 54 | Identify the support that should be available to experimenters, i.e., on-line instructions, examples and help desks. [[BR]] |
| 55 | Update the [http://groups.geni.net/geni/wiki/GeniInstrumentationandMeasurementsArchitecture GENI I&M Architecture document]: [[BR]] |
| 56 | Sec. 3.1. I&M Use cases for Experimenters [[BR]] |
| 57 | Sec. 4.2.1 Typical Arrangements of I&M Services: For Experimenter Gathering MD from their Slice [[BR]] |
| 58 | Sec. 4.3.1 Type 1 I&M Service: Service Contained within a Slice [[BR]] |
| 59 | Use as guidance in the design of GENI I&M tools, particularly for the GEMINI and GIMI projects [[BR]] |
| 60 | |
| 61 | [wiki:InstMeasTopic_4.2UseCasesExperimenters Work in Progress] [[BR]] |
| 62 | |
| 63 | Summary of use cases: (Jim Griffioen, Mike Zink, Jeanne Ohren) |
| 64 | [http://groups.geni.net/geni/attachment/wiki/GEC13Agenda/InstrumentationAndMeasurement/T2a%29%20%20IM%20Uses%20Cases.pdf slides] |
| 65 | |
| 66 | View of user tools and services: (Jeanne Ohren) |
| 67 | [http://groups.geni.net/geni/attachment/wiki/GEC13Agenda/InstrumentationAndMeasurement/T2b%29%20GENIUserToolsAndServices.pdf slides] |
| 68 | |
| 69 | Discussion: [[BR]] |
| 70 | Compare experiments and their results. [[BR]] |
| 71 | Do community benchmarking (Max) [[BR]] |
| 72 | Do verifications (Mike) [[BR]] |
| 73 | |
| 74 | |
| 75 | |
| 76 | |
| 77 | === T3) I&M Use Cases for Infrastructure Measurement, and Support for Operators === |
| 78 | 10:20am [[BR]] |
| 79 | |
| 80 | Team [[BR]] |
| 81 | LEAD Martin Swany (Indiana U) [[BR]] |
| 82 | Guilherme Fernandes (?) [[BR]] |
| 83 | Eric Boyd (Internet2) [[BR]] |
| 84 | Jason Zurawski (Internet2) [[BR]] |
| 85 | Prasad Calyam (Ohio Super Center) [[BR]] |
| 86 | Chris Small, for NetKarma (Indiana U) [[BR]] |
| 87 | Ilia Baldine, for ExoGENI racks (RENCI) [[BR]] |
| 88 | Jonathan Mills (RENCI) [[BR]] |
| 89 | ?, for InstaGENI racks (HP) [[BR]] |
| 90 | ?, for GMOC [[BR]] |
| 91 | Sarah Edwards (GPO) [[BR]] |
| 92 | Chaos Golubitsky (GPO) [[BR]] |
| 93 | Harry Mussman (GPO) [[BR]] |
| 94 | |
| 95 | |
| 96 | Tasks [[BR]] |
| 97 | Provide a concise but complete definition of I&M Use Cases for Infrastructure Measurement [[BR]] |
| 98 | Identify the support that should be available to operators [[BR]] |
| 99 | Update the [http://groups.geni.net/geni/wiki/GeniInstrumentationandMeasurementsArchitecture GENI I&M Architecture document]: [[BR]] |
| 100 | Sec. 3.3. I&M Use cases for Central Operators (i.e., GMOC) [[BR]] |
| 101 | Sec. 3.4. I&M Use cases for Aggregate Providers and Operators [[BR]] |
| 102 | Sec. 4.2.2 Typical Arrangements of I&M Services: For Operator Gathering MD from GENI Infrastructure [[BR]] |
| 103 | Sec. 4.2.3 Typical Arrangements of I&M Services: For Experimenters Gathering MD from their Slice and from GENI Infrastructure [[BR]] |
| 104 | Sec. 4.3.3 Type 3 I&M Service: Common Service with MD for Multiple Slices [[BR]] |
| 105 | Use as guidance in the design of GENI I&M tools, particularly for the GEMINI and GIMI projects [[BR]] |
| 106 | |
| 107 | [wiki:InstMeasTopic_4.3UseCasesInfrastructure Work in Progress] [[BR]] |
| 108 | |
| 109 | Review of use cases: (Martin Swany) |
| 110 | Need to provide infrastructure measurements [[BR]] |
| 111 | Should preserve relationship between experiment and infrastructure emasurements [[BR]] |
| 112 | |
| 113 | Review of plan for measurements on Layer 2 and OpenFlow paths: (Prasad Calyam) |
| 114 | [http://groups.geni.net/geni/attachment/wiki/GEC13Agenda/InstrumentationAndMeasurement/OnTimeMeasure_GEC13-I%26M-Talk.pdf slides] [[BR]] |
| 115 | |
| 116 | |
| 117 | === T4) GENI I&M Tool Testing Environment === |
| 118 | 10:35am [[BR]] |
| 119 | |
| 120 | Team [[BR]] |
| 121 | LEAD Harry Mussman (GPO) [[BR]] |
| 122 | Martin Swany (IU) [[BR]] |
| 123 | Jim Griffioen (U Kentucky) [[BR]] |
| 124 | Ilia Baldine, for ExoGENI racks (RENCI) [[BR]] |
| 125 | ?, for InstaGENI racks (?) [[BR]] |
| 126 | David Irwin (UMass Amherst) [[BR]] |
| 127 | Mike Zink (UMass Amherst) [[BR]] |
| 128 | Christoph Dwertmann (NICTA) [[BR]] |
| 129 | Tom Mitchell (GPO) [[BR]] |
| 130 | Aaron Helsinger (GPO) [[BR]] |
| 131 | Vic Thomas (GPO) [[BR]] |
| 132 | Jeanne Ohren (GPO) [[BR]] |
| 133 | Luisa Nevers (GPO) [[BR]] |
| 134 | |
| 135 | Tasks [[BR]] |
| 136 | Provide a concise definition of the environment where the GENI I&M tools will be tested, including: [[BR]] |
| 137 | User tools for experiment and measurement setup and orchestration [[BR]] |
| 138 | Interfaces/protocols between user tools and GENI aggregates [[BR]] |
| 139 | Supported GENI aggregtaes [[BR]] |
| 140 | |
| 141 | [wiki:InstMeasTopic_4.4GENIEnvironment Work in Progress] (Harry Mussman) [[BR]] |
| 142 | |
| 143 | |
| 144 | |
| 145 | |
| 146 | |
| 147 | |
| 148 | === T5) Descriptors, Objects and Registries === |
| 149 | 10:50am [[BR]] |
| 150 | |
| 151 | Team [[BR]] |
| 152 | LEAD Giridhar Manepalli (CNRI) [[BR]] |
| 153 | Jason Zurawski (Internet2) [[BR]] |
| 154 | Ezra Kissel (U Delaware) [[BR]] |
| 155 | Eric Boyd (Internet2) [[BR]] |
| 156 | Beth Plale (IU) [[BR]] |
| 157 | Chris Small (GEMINI, IU) [[BR]] |
| 158 | Scott Jensen (Indiana U) [[BR]] |
| 159 | Larry Lannom (CNRI) [[BR]] |
| 160 | Deniz Gurken (GIMI, UH) [[BR]] |
| 161 | Harry Mussman (GPO) [[BR]] [[BR]] |
| 162 | |
| 163 | Tasks [[BR]] |
| 164 | Need to finalize MDOD schema, for XML file. [http://groups.geni.net/geni/wiki/GEC11InstMeasWorkingSession#a2MeasurementDataObjectDescriptorMDOD References] [[BR]] |
| 165 | Want to extend MDOD to cover all types of objects, i.e., software images. (NetKarma)[[BR]] |
| 166 | Want to use MDOD schema to define Event Record schema. (NetKarma)[[BR]] |
| 167 | Do we need MDOD registry? Use UNIS lookup service? Use DOR registry? Include in iRODS? Consider IF-MAP server? [[BR]] |
| 168 | Need MDOD creation and editing service. (CNRI) [[BR]] |
| 169 | Need Measurement Data Object identifiers (names); sometimes need a persistent, public reference; consider DataCite approach, which uses handle [[BR]] |
| 170 | |
| 171 | [wiki:InstMeasTopic_4.5DescriptorsObjectsRegistriesLookupService Work in Progress] [[BR]] |
| 172 | |
| 173 | |
| 174 | Summary of current status (Giridhar Manepalli): [[BR]] |
| 175 | [http://groups.geni.net/geni/attachment/wiki/GEC13Agenda/InstrumentationAndMeasurement/T5%29%20%20MDOD%20Status%20-%20CNRI.pptx slides] [[BR]] |
| 176 | |
| 177 | Conclusions: [[BR]] |
| 178 | |
| 179 | Good things: [[BR]] |
| 180 | Excellent start [[BR]] |
| 181 | Collaborative Specification [[BR]] |
| 182 | Great Coverage [[BR]] |
| 183 | Nicely broken down into elements [[BR]] |
| 184 | Mandatory vs. optional elements identified [[BR]] |
| 185 | Genuine Use Cases: Gathering, transferring, and sharing [[BR]] |
| 186 | |
| 187 | Jensen's proposal (NetKarma): [[BR]] |
| 188 | Current: Identifiers, Descriptors, Holders [[BR]] |
| 189 | Proposed: Identification, Lineage/Provenance, Constraints/Security, MDO Description [[BR]] |
| 190 | |
| 191 | Zurawski's comments: [[BR]] |
| 192 | Too many secondary identifiers [[BR]] |
| 193 | Descriptors should be contextualized [[BR]] |
| 194 | Variations based on the type of object [[BR]] |
| 195 | GENI specific descriptions should be clearly marked and separated [[BR]] |
| 196 | Slight changes to names & enclosing elements recommended [[BR]] |
| 197 | |
| 198 | Comments/suggestions based on metadata practices: [[BR]] |
| 199 | Too many optional elements [[BR]] |
| 200 | Too many choices given to users [[BR]] |
| 201 | Users bound to take the path of least resistance [[BR]] |
| 202 | Keep the scope restricted to only mandatory elements – at least in the beginning [[BR]] |
| 203 | Try those out. Implement them. [[BR]] |
| 204 | One size fits all ---- No! [[BR]] |
| 205 | Capturing descriptions, formats, policies, transactions, etc. in a monolithic fashion [[BR]] |
| 206 | Register individual components separately [[BR]] |
| 207 | E.g., Capture legal formats & interpretations in their own records, and reference them here [[BR]] |
| 208 | E.g., Same with accepted policies [[BR]] |
| 209 | Identifiers cannot be semantic [[BR]] |
| 210 | Domain, sub-domain, and object-type are part of an ID [[BR]] |
| 211 | World view changes frequently [[BR]] |
| 212 | Non-semantic Ids are worth every penny [[BR]] |
| 213 | Search engines & registries mask the opaqueness [[BR]] |
| 214 | After all, IDs are just entities behind the scenes [[BR]] |
| 215 | Object Type controlled vocabulary enumerates apples and oranges [[BR]] |
| 216 | Collection, flow, directory, file, database, gui are not mutually exclusive [[BR]] |
| 217 | Doesn’t help the recipient make any decision looking at the descriptor [[BR]] |
| 218 | Bundle type & format into format interpretation method [[BR]] |
| 219 | Covers too many corner cases, e.g., flow-rate [[BR]] |
| 220 | Expects too many details, e.g., locator (type, access method, etc.) [[BR]] |
| 221 | |
| 222 | |
| 223 | === T6) XML Messaging Service === |
| 224 | 11:05am [[BR]] |
| 225 | |
| 226 | Team [[BR]] |
| 227 | LEAD Anirban Mandal (RENCI) [[BR]] |
| 228 | Ilia Baldine (RENCI) [[BR]] |
| 229 | Rudra Dutta (NCSU) [[BR]] |
| 230 | Christoph Dwertmann (NICTA) [[BR]] |
| 231 | Ahmed El-Hassany (IU) [[BR]] |
| 232 | Harry Mussman (GPO) [[BR]] |
| 233 | |
| 234 | |
| 235 | Tasks [[BR]] |
| 236 | Define, prototype, demonstrate and operate a GENI Messaging service, starting at GEC13. [[BR]] |
| 237 | The XML Mesaaging service will be built by the IMF project. For a detailed task list, see the Spiral 4 SOW of the IMF project. [[BR]] |
| 238 | Support use in GENI by many tools, including GEMINI and GIMI I&M tools [[BR]] |
| 239 | Define operations plan for XML Messaging service. [[BR]] |
| 240 | |
| 241 | [wiki:InstMeasTopic_4.6MessagingService Work in Progress] [[BR]] |
| 242 | |
| 243 | Summary of current status: (Rudra Dutta) [[BR]] |
| 244 | [attachment:GEC13_IMF_overview.pptx Slides] [[BR]] |
| 245 | |
| 246 | Discussion: [[BR]] |
| 247 | How do we set "topics" in XMPP server? [[BR]] |
| 248 | What is the efficiency of XML processing in XMPP? [[BR]] |
| 249 | How does the authorization work? [[BR]] |
| 250 | |
| 251 | === T7) Measurement Information (MI) Service === |
| 252 | 11:15am [[BR]] |
| 253 | |
| 254 | Team [[BR]] |
| 255 | LEAD Ahmed El-Hassany (IU) [[BR]] |
| 256 | Martin Swany (IU) [[BR]] |
| 257 | Harry Mussman (GPO) [[BR]] |
| 258 | |
| 259 | Tasks [[BR]] |
| 260 | The MI service will be built by the GEMINI project using UNIS technology; see the Spiral 4 SOW of the GEMINI project for the detailed steps, which include: [[BR]] |
| 261 | 1) Refactor UNIS (combined Lookup and Topology Services) to support hierarchical operation with local and global instances: [[BR]] |
| 262 | 2) Update topology model to Rspec version 3 and AM API (February 2012) [[BR]] |
| 263 | 3) Modifications to allow local UNIS to register with global UNIS (March 2012) [[BR]] |
| 264 | 4) Initial deployment of persistent GENI Global I&M Registry (GGR) service, based on UNIS. (May 2012) [[BR]] |
| 265 | 5) Complete noSQL (MongoDB) backend (September 2012) [[BR]] |
| 266 | 6) Unify Perl and Python implementations (September 2012) [[BR]] |
| 267 | Define, prototype, demonstrate and operate a MI service, starting in May, 2012. [[BR]] |
| 268 | Support use in GENI by many tools, including GEMINI and GIMI I&M tools [[BR]] |
| 269 | Define operations plan for MI service. [[BR]] |
| 270 | |
| 271 | [wiki:InstMeasTopic_4.7LookupService Work in Progress] [[BR]] |
| 272 | |
| 273 | Summary of current status: (Ahmed El-Hassany) [[BR]] |
| 274 | [http://groups.geni.net/geni/attachment/wiki/GEC13Agenda/InstrumentationAndMeasurement/T7%29%20%20GEC13.pdf slides] [[BR]] |
| 275 | |
| 276 | === T8) GENI User Tools and Services === |
| 277 | 11:25am [[BR]] |
| 278 | |
| 279 | Team [[BR]] |
| 280 | LEAD Jeanne Ohren (GPO)[[BR]] |
| 281 | Jim Griffioen and/or Charles Carpenter (INSTOOLS and GEMINI, U Kentucky) [[BR]] |
| 282 | Max Ott and/or Christoph Dwertmann (NICTA) [[BR]] |
| 283 | Chris Small (NetKarma, IU) [[BR]] |
| 284 | Ahmed El-Hassany (IU) [[BR]] |
| 285 | Giridhar Manepalli (CNRI) [[BR]] |
| 286 | Harry Mussman (GPO) [[BR]] |
| 287 | Vic Thomas (GPO) [[BR]] |
| 288 | Niky Riga (GPO) [[BR]] |
| 289 | Luisa Nevers (GPO) [[BR]] |
| 290 | |
| 291 | Goals [[BR]] |
| 292 | Work towards Max Ott's vision for experiment support [[BR]] |
| 293 | Provide a way for a GENI user (e.g., experimenter or operator) to access a wide variety of "GENI User Services", where each user service provides an interface (e.g., API or GUI) to the user. Those user services with a GUI (web) interface are often called "portal services".[[BR]] |
| 294 | Together, the "GENI User Services" should provide all of the functions the user needs to setup and run their experiment, then gather, analyze and present the measurement data. [[BR]] |
| 295 | These services should work together via APIs, etc., to streamline the experiment process. [[BR]] |
| 296 | |
| 297 | Tasks [[BR]] |
| 298 | Based upon the configuration defined below, the implementation is split into: [[BR]] |
| 299 | 1) A GENI User Workspace, which is a persistent Linux OS environment dedicated to the user, that serves as a container for multiple user tools [[BR]] |
| 300 | 2) Multiple GENI User Tools, where each provides a service with an interface or a "portal" to the user. [[BR]] |
| 301 | |
| 302 | Define, prototype, deploy and operate a GENI User Workspace. It can be hosted on a server dedicated to the user, or on a server hosting multiple user workspaces for multiple users.[[BR]] |
| 303 | Gather the various "user tools" that have been implemented to date, and fit into GENI User Workspace Service so that GENI I&M users can begin to conveniently conduct experiments or instrument infrastructure. [[BR]] |
| 304 | Optimize "user tools" and their interfaces to better meet the needs of GENI users (e.g., experimenters and operators). [[BR]] |
| 305 | |
| 306 | [wiki:InstMeasTopic_4.8PortalService Work in Progress] [[BR]] |
| 307 | |
| 308 | Summary of current status: (Jeanne Ohren) [[BR]] |
| 309 | [http://groups.geni.net/geni/attachment/wiki/GEC13Agenda/InstrumentationAndMeasurement/T8%29%20GENIUserToolsAndServices.pdf slides] [[BR]] |
| 310 | |
| 311 | |
| 312 | |
| 313 | === T9) Digital Object Archive (DOA) Service === |
| 314 | 11:40am [[BR]] |
| 315 | |
| 316 | Team [[BR]] |
| 317 | Co-LEAD Giridhar Manepalli (CNRI) [[BR]] |
| 318 | Co-LEAD Shu Huang (RENCI) [[BR]] |
| 319 | Larry Lannom (CNRI) [[BR]] |
| 320 | Wesley Wu (U Kentucky) [[BR]] |
| 321 | Hussam Nasir (U Kentucky) [[BR]] |
| 322 | Chris Small (NetKarma, IU) [[BR]] |
| 323 | Jeannie Ohren (GPO) [[BR]] |
| 324 | |
| 325 | Tasks |
| 326 | Start with CNRI prototype digital object archive service [[BR]] |
| 327 | Plan transition to use of iRODS service [[BR]] |
| 328 | How to move data to service: move file; move SQL DB; or? [[BR]] |
| 329 | How is persistent object identifier (i.e., handle) generated? also registered? and later resolved? Include necessary Object Identifier (OI) service.[[BR]] |
| 330 | How are partitions for different users managed? [[BR]] |
| 331 | How is data in MDOD used to set archive sharing policy? what is required in MDOD? [[BR]] |
| 332 | Operations plans for Digital Object Archive (DOA) and Object Identifier (OI) services. [[BR]] |
| 333 | |
| 334 | |
| 335 | [wiki:InstMeasTopic_4.9ArchiveService Work in Progress] [[BR]] |
| 336 | |
| 337 | |
| 338 | Summary of current status [[BR]] |
| 339 | |
| 340 | Review of prototype Measurement Data Archive (MDA) service: (Giridhar Manepalli, CNRI) [[BR]] |
| 341 | [http://groups.geni.net/geni/attachment/wiki/GEC13Agenda/InstrumentationAndMeasurement/T9a%29%20MDA_ProjectHighlights_GEC13%20-%20CNRI.pptx slides] [[BR]] |
| 342 | |
| 343 | Introduction to iRODS service: (Anirban for Shu Huang, RENCI) |
| 344 | [http://groups.geni.net/geni/attachment/wiki/GEC13Agenda/InstrumentationAndMeasurement/T9b%29%20%20gec13_irods_im_anirban.pptx slides] [[BR]] |
| 345 | |
| 346 | |
| 347 | === T10) List of Operational Services === |
| 348 | (no report) [[BR]] |
| 349 | |
| 350 | Team [[BR]] |
| 351 | Mike Zink (UMass Amherst) [[BR]] |
| 352 | Martin Swany (Inidana U) [[BR]] |
| 353 | Jim Griffioen (U Kentucky) [[BR]] |
| 354 | Giridhar Manepalli (CNRI) [[BR]] |
| 355 | Jeanne Ohren (GPO) [[BR]] |
| 356 | Harry Mussman (GPO) [[BR]] |
| 357 | |
| 358 | Tasks: |
| 359 | What persistent operational services must be supported: [[BR]] |
| 360 | a) Descriptor registry required? use UNIS? DOR? iRODS? IF-MAP? [[BR]] |
| 361 | b) Object registry required? use DOR? [[BR]] |
| 362 | c) XML Messaging service [[BR]] |
| 363 | d) Measurement Information (MI)service [[BR]] |
| 364 | e) GENI User services [[BR]] |
| 365 | f) Digital Object Archive (DOA) service [[BR]] |
| 366 | Can all services can be shared by GIMI and GEMINI tools? [[BR]] |
| 367 | How do these relate to other GENI services/functions, including clearinghouse? |
| 368 | |
| 369 | |
| 370 | [wiki:InstMeasTopic_4.10OperationalServices Work in Progress] [[BR]] |
| 371 | |
| 372 | |
| 373 | === Discussion of next steps === |
| 374 | 11:55am [[BR]] |
| 375 | |
| 376 | == 3) Break for lunch == |
| 377 | 12noon [[BR]] |
| 378 | |
| 379 | |
| 380 | == 4) Update on GIMI project == |
| 381 | 1:30pm [[BR]] |
| 382 | '''PI''' Michael Zink, University of Massachusetts at Amherst (mailto:zink@ecs.umass.edu) [[BR]] |
| 383 | '''Co-PI''' Max Ott, NICTA (mailto:max.ott@nicta.com.au) [[BR]] |
| 384 | '''Key personnel''' Ilia Baldine, RENCI (mailto:ibaldin@renci.org) [[BR]] |
| 385 | |
| 386 | [wiki:GIMI GIMI wiki] [[BR]] |
| 387 | [http://gimi.ecs.umass.edu/ GIMI website at UMass Amherst] [[BR]] |
| 388 | |
| 389 | Goals: [[BR]] |
| 390 | |
| 391 | **Starts with OML, and provides easy-to-use tools for GENI environment [[BR]] |
| 392 | |
| 393 | *First focus: I&M use cases for experiments, with default OML Client in nodes that gathers passive measurements like INSTOOLS, and provides basic node-to-node connectivity tests using ping and iperf [[BR]] |
| 394 | *Second focus: I&M use cases for infrastructure measurement [[BR]] |
| 395 | *Later focuse: add sensor measurement data, carried in data network [[BR]] |
| 396 | |
| 397 | *Spiral 4 supported aggregates: ORCA servers/VMs and ExoGENI (RENCI) racks [[BR]] |
| 398 | *Later, support: WiMAX sites [[BR]] |
| 399 | *Spiral 5 supported aggregates: protoGENI/Emulab servers/VMs and InstaGENI (HP) racks [[BR]] |
| 400 | |
| 401 | *Introduces XML messaging service, with pub/sub, in public IP space [[BR]] |
| 402 | *Introduces iRODS service for digital object archive. [[BR]] |
| 403 | |
| 404 | |
| 405 | Members of the GIMI project will review: (Mike Zink) [[BR]] |
| 406 | |
| 407 | *Current architecture and design [[BR]] |
| 408 | |
| 409 | *Current status [[BR]] |
| 410 | |
| 411 | [http://groups.geni.net/geni/attachment/wiki/GEC13Agenda/InstrumentationAndMeasurement/GIMI%20GEC%2013.pptx slides] [[BR]] |
| 412 | |
| 413 | *Preview of tonight's GEC-13 demo [[BR]] |
| 414 | [http://groups.geni.net/geni/attachment/wiki/GEC13Agenda/InstrumentationAndMeasurement/GIMI_GEC13_poster.pdf poster] [[BR]] |
| 415 | |
| 416 | *Plan for GEC-14 tutorial [[BR]] |
| 417 | |
| 418 | |
| 419 | == 5) Update on GEMINI project == |
| 420 | 2pm [[BR]] |
| 421 | '''PI''' Martin Swany, Indiana University (mailto:swany@iu.edu) [[BR]] |
| 422 | '''Co-PI''' Chris Small, Indiana University (mailto:chsmall@indiana.edu) [[BR]] |
| 423 | '''Co-PI''' James Griffioen, University of Kentucky (mailto:griff@netlab.uky.edu) [[BR]] |
| 424 | '''Co-PI''' Zongming Fei, University of Kentucky (mailto:fei@netlab.uky.edu) [[BR]] |
| 425 | |
| 426 | [wiki:GEMINI GEMINI wiki] [[BR]] |
| 427 | |
| 428 | Goals: [[BR]] |
| 429 | |
| 430 | **Starts with LAMP, which provides flexible tools based on perfSONAR for active infrastructure measurements [[BR]] |
| 431 | ++Fold INSTOOLS features into LAMP to form GEMINI tools, and then discontinue INSTOOLS [[BR]] |
| 432 | |
| 433 | *First focus: I&M use cases for infrastructure measurement |
| 434 | *Include sharing of data with other users (e.g., operators), at an interface with authorization using a GENI credential [[BR]] |
| 435 | *Show how to monitor clusters/racks [[BR]] |
| 436 | *Show how to measure Layer 2 and OpenFlow paths (with input from OnTimeMeasure project [http://groups.geni.net/geni/attachment/wiki/GEC13Agenda/InstrumentationAndMeasurement/OnTimeMeasure_GEC13-I%26M-Talk.pdf Slides]) [[BR]] |
| 437 | |
| 438 | *Second focus: I&M use cases for experiments [[BR]] |
| 439 | *Consider how to gather basic host measurements with BLiPP service (as was done by INSTOOLS using SNMP) [[BR]] |
| 440 | *Consider how to gather customized data from applications (as provided by OML Client) [[BR]] |
| 441 | |
| 442 | ++Extending LAMP with INSTOOLS features: [[BR]] |
| 443 | *Consider how to load tools on top of basic image [[BR]] |
| 444 | *Consider how to extend Periscope to include druple content management service [[BR]] |
| 445 | *Consider how to add xserver to basic node image, to login from portal using vnc protocol [[BR]] |
| 446 | *Continue separate portal service, which is really a gateway service, within a user workspace service [[BR]] |
| 447 | *Consider how to add interface to archive service, e.g., iRODs [[BR]] |
| 448 | |
| 449 | *Spiral 4 supported aggregates: protoGENI/Emulab servers/VMs and InstaGENI (HP) racks [[BR]] |
| 450 | *Spiral 5 supported aggregates: ORCA servers/VMs and ExoGENI (RENCI) racks [[BR]] |
| 451 | |
| 452 | *Continue INSTOOLS portal service, in user workspace, to find GUIs [[BR]] |
| 453 | *Continue LAMP local and global UNIS service, to register available measurement data, and network topology [[BR]] |
| 454 | |
| 455 | Members of the GEMINI project will review: (Martin Swany) [[BR]] |
| 456 | |
| 457 | *Current architecture and design [[BR]] |
| 458 | |
| 459 | *Current status [[BR]] |
| 460 | |
| 461 | [http://groups.geni.net/geni/attachment/wiki/GEC13Agenda/InstrumentationAndMeasurement/gemini-gec13.pptx slides] [[BR]] |
| 462 | |
| 463 | *Preview of tonight's GEC-13 demo [[BR]] |
| 464 | |
| 465 | [http://groups.geni.net/geni/attachment/wiki/GEC13Agenda/InstrumentationAndMeasurement/GEC13%20GEMINI%20Demo%20Poster%20V2.pdf poster] [[BR]] |
| 466 | |
| 467 | *Plan for GEC-14 tutorial [[BR]] |
| 468 | |
| 469 | == 6) Support for experimenters == |
| 470 | 2:30pm [[BR]] |
| 471 | |
| 472 | Round-table discussion: [[BR]] |
| 473 | What use cases must be supported by GEC14? by GEC15? [[BR]] |
| 474 | What tools must be available by GEC14? by GEC15? [[BR]] |
| 475 | Suggest: Put basic set of tools on common images, ready to add apps. [[BR]] |
| 476 | How can we best verify that available tools meet the needs of experimenters? process for fixing bugs? process for making extensions? [[BR]] |
| 477 | How can we best reach out to experimenters? tutorials? workshops? on-line instructions? examples? help desks? [[BR]] |
| 478 | It is essential to have on-line instructions and examples; should be easy to retrieve, modify and use. [[BR]] |
| 479 | |
| 480 | |
| 481 | == 7) Support for infrastructure measurement == |
| 482 | 2:45pm [[BR]] |
| 483 | |
| 484 | Round-table discussion: [[BR]] |
| 485 | What use cases must be supported by GEC14? by GEC15? [[BR]] |
| 486 | What tools must be available by GEC14? by GEC15? [[BR]] |
| 487 | What use cases/tools will support experimenters? [[BR]] |
| 488 | What use cases/tools will support operators? [[BR]] |
| 489 | Note: Some use will be in an "infrastructure measurement slice", and some use will be in an environment "outside of a slice". [[BR]] |
| 490 | How can we best verify that available tools meet the needs of experimenters and operators? process for fixing bugs? process for making extensions? [[BR]] |
| 491 | How can we best reach out to experimenters and operators? tutorials? workshops? on-line instructions? examples? help desks? [[BR]] |
| 492 | It is essential to have on-line instructions and examples; should be easy to retrieve, modify and use. [[BR]] |
| 493 | |
| 494 | |
| 495 | == 8) Adjourn == |
| 496 | 3pm [[BR]] |