8 | | [http://groups.geni.net/geni/attachment/wiki/2ndInstMeasWork/051810%20%20InstMeasWorkshopAgenda.pdf Announcement, v1.1] |
9 | | |
| 9 | |
| 10 | == Announcement with goals, topics and reference material == |
| 11 | |
| 12 | The following announcement (with figures and references) was sent to the attendees to prepare for the workshop: [[BR]] |
| 13 | |
| 14 | [ Announcement, v1.1 (060410)] |
| 15 | [ Figures, v1.1 (060410)] |
| 16 | |
| 17 | |
| 18 | == Announcement with notes == |
| 19 | |
| 20 | The following announcement now includes all notes from the workshop: |
| 21 | |
| 22 | [ Announcement, v1.2 (062510)] |
| 23 | [ Figures, v1.2 (062510)] |
| 24 | |
| 25 | == Attendees at workshop == |
| 26 | |
| 27 | (attended workshop: yes or no) |
| 28 | Paul Barford - University of Wisconsin – Madison (no) |
| 29 | Bruce Maggs – Duke University and Akamai (yes) |
| 30 | Harry Mussman – BBN/GPO (yes) |
| 31 | Vic Thomas - BBN/GPO (yes) |
| 32 | Evan Zhang – BBN/GPO (yes) |
| 33 | OML (ORBIT Measurement Library) OMF (ORBIT Management Framework) |
| 34 | Max Ott – NICTA (yes, by phone) |
| 35 | Ivan Seskar – Rutgers WINLAB (yes) |
| 36 | Instrumentation Tools |
| 37 | Jim Griffioen - Univ Kentucky (yes) |
| 38 | perfSONAR |
| 39 | Matt Zekauskas - Internet2 (no) |
| 40 | Jason Zurawski – Internet2 (yes) |
| 41 | Martin Swany - Univ Delaware (yes) |
| 42 | Guilherme Fernandes – Univ Delaware (yes) |
| 43 | Ezra Kissel – Univ Delaware (yes) |
| 44 | Scalable Sensing Service (S3) |
| 45 | Sonia Fahmy – Purdue (yes) |
| 46 | Puneet Sharma - HP Labs (yes) |
| 47 | OnTimeMeasure for network measurements |
| 48 | Prasad Calyam - Ohio Supercomputing Ctr (yes) |
| 49 | GENI Meta-Operations Center and NetKArma |
| 50 | Jon-Paul Herron - Indiana Univ |
| 51 | Camilo Viecco - Indiana Univ (yes) |
| 52 | Chris Small - Indiana Univ (yes) |
| 53 | Beth Plale - Indiana Univ (yes) |
| 54 | Virtual Machine Introspection (VMI) |
| 55 | Brian Hay – Univ Alaska (yes) |
| 56 | Data-Intensive Cloud Control for GENI |
| 57 | Michael Zink - UMass Amherst (yes) |
| 58 | Experiment Management Service – Digital Object Registry |
| 59 | Jim French - CNRI (yes) |
| 60 | Giridhar Manepalli - CNRI (yes) |
| 61 | Larry Lannom – CNRI (no) |
| 62 | |
| 63 | == Priority topics == |
| 64 | |
| 65 | The following priority topics were identified at the workshop, and teams of attendees were identified for each topic to discuss it, and write a text summary for review by the WG at GEC8. |
| 66 | |
| 67 | |
| 68 | === 6.1 GENI I&M use cases === |
| 69 | |
| 70 | Team members: |
| 71 | Paul Barford - University of Wisconsin – Madison (no) |
| 72 | Jim Griffioen - Univ Kentucky (yes) |
| 73 | * Prasad Calyam - Ohio Supercomputing Ctr (yes) |
| 74 | Camilo Viecco - Indiana Univ (yes) |
| 75 | Brian Hay – Univ Alaska (yes) |
| 76 | * agreed to organize first discussion and writing |
| 77 | |
| 78 | Identify all user groups, and provide basic use cases: |
| 79 | 1) GMOC operations group (NOC) |
| 80 | 2) Cluster and aggregate operations groups (NOCs) |
| 81 | 3) Archive service providers |
| 82 | 4) Experiment researchers |
| 83 | 5) Experiment (opt-in) users (see http://groups.geni.net/geni/attachment/wiki/041409NYCOptInWGAgenda/071509%20%20GENI-SE-OI-Overview-01.4.pdf for listing of opt-in issues, such as privacy) |
| 84 | 6) Researchers that use measurement data archived by other researchers (DatCat model) |
| 85 | |
| 86 | === 6.2 GENI I&M services === |
| 87 | |
| 88 | Team members: |
| 89 | * Harry Mussman – BBN/GPO (yes) |
| 90 | Evan Zhang – BBN/GPO |
| 91 | Giridhar Manepalli - CNRI (yes) |
| 92 | Chris Small - Indiana Univ (yes) |
| 93 | Beth Plale - Indiana Univ (yes) |
| 94 | * agreed to organize first discussion and writing |
| 95 | |
| 96 | Summarize current view |
| 97 | |
| 98 | Identify different types of services: |
| 99 | Completely dedicated to an experiment |
| 100 | Common portion, plus parts associated with different experiments |
| 101 | Common service, with data provided to multiple experiments |
| 102 | |
| 103 | Need: Basic definition of an archive service |
| 104 | |
| 105 | |
| 106 | === 6.3 GENI I&M resources === |
| 107 | |
| 108 | Team members: |
| 109 | Vic Thomas - BBN/GPO (yes) |
| 110 | * Jim Griffioen - Univ Kentucky (yes) |
| 111 | Martin Swany - Univ Delaware (yes) |
| 112 | Camilo Viecco - Indiana Univ (yes) |
| 113 | Brian Hay – Univ Alaska (yes) |
| 114 | Giridhar Manepalli - CNRI (yes) |
| 115 | * agreed to organize first discussion and writing |
| 116 | |
| 117 | Significant question uncovered at workshop! |
| 118 | Jim on 6/25 via email: We should involve Rob Ricci in the discussion. |
| 119 | |
| 120 | What are resources: |
| 121 | 1) Hosts, VMs, etc. |
| 122 | 2) Network connectivity |
| 123 | 3) Software, e.g., I&M software that can be included in an experiment |
| 124 | 3) I&M services |
| 125 | 4) I&M data flows and file transfers |
| 126 | 5) I&M data files stored in archives |
| 127 | |
| 128 | How are each of these discovered, specified, authorized and assigned: |
| 129 | a) Always by mechanisms provided by the CF? |
| 130 | b) With CF plus additional mechanisms? |
| 131 | Consider example of LS in perfSONAR |
| 132 | Consider example of data file stored in archive, owned by an experimenter |
| 133 | |
| 134 | Goals: |
| 135 | Need to define and then compare these options |
| 136 | Need to understand interop with CF for each option |
| 137 | Does CF setup secondary authorization mechanisms in some cases? If so, how? |
| 138 | |
| 139 | Does each item have: |
| 140 | Unique and persistent name? |
| 141 | Unique and persistent identifier? |
| 142 | Need to carefully consider this for all of GENI |
| 143 | |
| 144 | For each item, consider how to: |
| 145 | Create |
| 146 | Name |
| 147 | Register and discover |
| 148 | Authorize and assign |
| 149 | |
| 150 | For each item, consider: |
| 151 | Ownership |
| 152 | What sort of policies the owner may want to apply |
| 153 | |
| 154 | |
| 155 | |
| 156 | |
| 157 | |
| 158 | |
| 159 | |
| 160 | === 6.4 GENI I&M measurement plane and interfaces === |
| 161 | |
| 162 | Team members: |
| 163 | * Harry Mussman – BBN/GPO (yes) |
| 164 | Ezra Kissel – Univ Delaware (yes) |
| 165 | Chris Small - Indiana Univ (yes) |
| 166 | * agreed to organize first discussion and writing |
| 167 | |
| 168 | Consider: |
| 169 | IP network |
| 170 | Layer 2 (VLAN) connections |
| 171 | |
| 172 | Discuss |
| 173 | Which protocols are active |
| 174 | Access to resources in aggregates, even when resources are in private address space, via GWs or proxies |
| 175 | How to provide authentication and authorization |
| 176 | How to provide QoS to protect measurement traffic |
| 177 | How to provide QoS to protect other traffic when measurement traffic is large. |
| 178 | Reserve bandwidth? |
| 179 | |
| 180 | Martin on 6/28: Consider XSP (extensible session protocol) to provide transport layer GW functions. |
| 181 | 6.5 GENI I&M interfaces and protocols (APIs): manage services |
| 182 | |
| 183 | Vic Thomas - BBN/GPO (yes) |
| 184 | Ivan Seskar – Rutgers WINLAB (yes) |
| 185 | Max Ott – NICTA (yes, by phone) |
| 186 | * Sonia Fahmy – Purdue (yes) |
| 187 | Giridhar Manepalli - CNRI (yes) |
| 188 | * agreed to organize first discussion and writing |
| 189 | |
| 190 | Define an approach based on OMF/OML and S3: |
| 191 | HTTP(S) |
| 192 | REST vs SOAP |
| 193 | Authorization by credentials or ? If credentials, how to revoke? |
| 194 | Pass XML fragments |
| 195 | Define basic API |
| 196 | |
| 197 | === 6.6 GENI I&M interfaces and protocols (APIs): data flows and data file transfers === |
| 198 | |
| 199 | * Harry Mussman – BBN/GPO (yes) |
| 200 | Ivan Seskar – Rutgers WINLAB (yes) |
| 201 | Max Ott – NICTA (yes, by phone) |
| 202 | Ezra Kissel – Univ Delaware (yes) |
| 203 | Prasad Calyam - Ohio Supercomputing Ctr (yes) |
| 204 | Michael Zink - UMass Amherst (yes) |
| 205 | * agreed to organize first discussion and writing |
| 206 | |
| 207 | Consider data flows and data file transfers between all services |
| 208 | |
| 209 | Define range of options: |
| 210 | |
| 211 | What: |
| 212 | Data flows |
| 213 | Data files transfers |
| 214 | |
| 215 | Type: |
| 216 | Pull |
| 217 | Push |
| 218 | Pub/Sub |
| 219 | |
| 220 | Protocol: |
| 221 | SNMP |
| 222 | SCP |
| 223 | FTP and gridFTP |
| 224 | HTTP |
| 225 | XMPP |
| 226 | TCP |
| 227 | SCTP |
| 228 | |
| 229 | Consider: |
| 230 | Naming |
| 231 | Discovery |
| 232 | Connectivity |
| 233 | Authentication and authorization mechanisms |
| 234 | |
| 235 | Map to current projects, giving examples: |
| 236 | Consider: Minimum set required for GENI |
| 237 | |
| 238 | |
| 239 | |
| 240 | |
| 241 | === 6.7 GENI I&M interfaces and protocols (APIs): service registration and discovery === |
| 242 | |
| 243 | Team members: |
| 244 | * Jason Zurawski – Internet2 (yes) |
| 245 | Prasad Calyam - Ohio Supercomputing Ctr (yes) |
| 246 | * agreed to organize first discussion and writing |
| 247 | |
| 248 | Consider approach used in perfSONAR |
| 249 | |
| 250 | Summarize for: |
| 251 | Services with data flows |
| 252 | Also sources of file transfers? |
| 253 | Also GUIs? |
| 254 | |
| 255 | |
| 256 | === 6.8 GENI I&M interfaces and protocols (APIs): GUIs === |
| 257 | |
| 258 | Team members: |
| 259 | Jeremy Reed - Univ Kentucky (yes) |
| 260 | * Guilherme Fernandes – Univ Delaware (yes) |
| 261 | Puneet Sharma - HP Labs (yes) |
| 262 | * Agreed to organize team |
| 263 | Define overall goals for GENI GUIs |
| 264 | |
| 265 | Types of GUIs: |
| 266 | Control experiments |
| 267 | Display I&M results |
| 268 | Report status |
| 269 | View archive service |
| 270 | |
| 271 | Consider portal, for access to multiple GUIs |
| 272 | |
| 273 | Consider need for authentication and authroization |
| 274 | |
| 275 | === 6.9 GENI measurement data schema === |
| 276 | |
| 277 | Team members: |
| 278 | Bruce Maggs – Duke University and Akamai (yes) |
| 279 | Max Ott – NICTA (yes, by phone) |
| 280 | Ivan Seskar – Rutgers WINLAB (yes) |
| 281 | * Martin Swany - Univ Delaware (yes) |
| 282 | Camilo Viecco - Indiana Univ (yes) |
| 283 | Michael Zink - UMass Amherst (yes) |
| 284 | Jim French - CNRI (yes) |
| 285 | * agreed to organize first discussion and writing |
| 286 | |
| 287 | |
| 288 | Consider: |
| 289 | Measurement data schema |
| 290 | Metadata schema |
| 291 | Metadata contents |
| 292 | |
| 293 | |
| 294 | Consider measurement data schema and/or metadata schema from: |
| 295 | perfSONAR |
| 296 | GMOC-provided |
| 297 | Current OML |
| 298 | Proposed using IPFIX |
| 299 | NetCDF (as used by DI Cloud) |
| 300 | |
| 301 | Consider: Minimum set required for GENI |
| 302 | |
| 303 | Provide overall template for GENI metadata, considering above. |
| 304 | Which items in GENI metadata template are: |
| 305 | Required? |
| 306 | Invariant? |
| 307 | |
| 308 | |
| 309 | == Figures == |
| 310 | |
| 311 | All figures |
| 312 | |
| 313 | |
| 314 | |
| 315 | == References == |
| 316 | |
| 317 | |
| 318 | Ref GIMS_Design_UseCases: “Use-cases for GENI Instrumentation and Measurement Architecture Design” |
| 319 | |
| 320 | Ref MeasPlane-1: “RESTful Web Services vs. “Big” Web Services: Making the Right Architectural Decision” |
| 321 | |
| 322 | Ref OMF_OML-1: “XDR: External Data Representation Standard” |
| 323 | |
| 324 | Ref OMF_OML-2: “ORBIT Measurements Framework and Library (OML): Motivations, Design, Implementation, and Features” |
| 325 | |
| 326 | Ref OMF-OML-3: “OML Overview” slides |
| 327 | |
| 328 | Ref OMF-OML-4: “Measurement Architectures for Network Experiments with Disconnected Mobile Nodes” |
| 329 | |
| 330 | Ref InsTools-1: “Architectural Design and Specification of the INSTOOLS Measurement System” |
| 331 | |
| 332 | Ref perfSONAR-1: “Scalable Framework for Representation and Exchange of Network Measurements” |
| 333 | |
| 334 | Ref perfSONAR-2: “An Extensible Schema for Network Measurement and Performance Data” |
| 335 | |
| 336 | Ref perfSONAR-3: “NM-WG/perfSONAR Topology Schema” |
| 337 | |
| 338 | Ref GMOC-1: “GMOC Topology-Entity Data Exchange Format Specification” |
| 339 | |
| 340 | Ref GMOC-2: “Proposal: Use of URN's as GENI Identifiers” |