[[PageOutline(1-2)]] = Mid-Atlantic Crossroads InstaGENI Confirmation Tests = For details about the tests in this page, see the '''[wiki:GENIRacksHome/InstageniRacks/SiteConfirmationTests InstaGENI Confirmation Tests]''' page.[[BR]] For site status see the '''[wiki:GENIRacksHome/InstageniRacks/ConfirmationTestStatus InstaGENI New Site Confirmation Tests Status]''' page. __Note:__ Omni nick_names for site aggregate used for these tests are: {{{ ig-gpo=urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm,https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am/2.0 ig-of-gpo=urn:publicid:IDN+instageni.gpolab.bbn.com+authority+cm,https://boss.instageni.gpolab.bbn.com:12369/protogeni/xmlrpc/am/2.0 ig-max=urn:publicid:IDN+instageni.maxgigapop.net+authority+cm,https://instageni.maxgigapop.net:12369/protogeni/xmlrpc/am max-ig=urn:publicid:IDN+instageni.maxgigapop.net+authority+cm,https://instageni.maxgigapop.net:12369/protogeni/xmlrpc/am ig-of-max=urn:publicid:IDN+openflow:foam:foam.instageni.maxgigapop.net+authority+am,https://foam.instageni.maxgigapop.net:3626/foam/gapi/1 max-ig-of=urn:publicid:IDN+openflow:foam:foam.instageni.maxgigapop.net+authority+am,https://foam.instageni.maxgigapop.net:3626/foam/gapi/1 }}} == IG-CT-1 - Access to New Site VM resources == Got Aggregate version, which showed AM API V1, V2, and V3 are supported and V2 is default: {{{ $ omni.py getversion -a max-ig 14:14:17 INFO omni: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache' 14:14:17 INFO omni: Loading config file /home/lnevers/.gcf/omni_config 14:14:17 INFO omni: Using control framework portal 14:14:17 INFO omni: Substituting AM nickname max-ig with URL https://instageni.maxgigapop.net:12369/protogeni/xmlrpc/am, URN urn:publicid:IDN+instageni.maxgigapop.net+authority+cm 14:14:18 INFO omni: (PG log url - look here for details on any failures: https://www.instageni.maxgigapop.net/spewlogfile.php3?logfile=1f5c90d7eb0327e51d1519b1f7b86f09) 14:14:18 INFO omni: AM URN: urn:publicid:IDN+instageni.maxgigapop.net+authority+cm (url: https://instageni.maxgigapop.net:12369/protogeni/xmlrpc/am) has version: ( (PG log url - look here for details on any failures: https://www.instageni.maxgigapop.net/spewlogfile.php3?logfile=1f5c90d7eb0327e51d1519b1f7b86f09).) 14:14:18 INFO omni: { 'code_tag': 'bdcc521e90e9bea5a006ebeee8f1b3219d49979e', 'geni_ad_rspec_versions': [ { 'extensions': [], 'namespace': 'http://www.protogeni.net/resources/rspec/0.1', 'schema': 'http://www.protogeni.net/resources/rspec/0.1/ad.xsd', 'type': 'ProtoGENI', 'version': '0.1'}, { 'extensions': [], 'namespace': 'http://www.protogeni.net/resources/rspec/0.2', 'schema': 'http://www.protogeni.net/resources/rspec/0.2/ad.xsd', 'type': 'ProtoGENI', 'version': '0.2'}, { 'extensions': [ 'http://www.protogeni.net/resources/rspec/ext/emulab/1'], 'namespace': 'http://www.protogeni.net/resources/rspec/2', 'schema': 'http://www.protogeni.net/resources/rspec/2/ad.xsd', 'type': 'ProtoGENI', 'version': '2'}, { 'extensions': [ 'http://www.protogeni.net/resources/rspec/ext/emulab/1'], 'namespace': 'http://www.geni.net/resources/rspec/3', 'schema': 'http://www.geni.net/resources/rspec/3/ad.xsd', 'type': 'GENI', 'version': '3'}], 'geni_api': 2, 'geni_api_versions': { '1': 'https://boss.instageni.maxgigapop.net:12369/protogeni/xmlrpc/am/1.0', '2': 'https://boss.instageni.maxgigapop.net:12369/protogeni/xmlrpc/am/2.0', '3': 'https://boss.instageni.maxgigapop.net:12369/protogeni/xmlrpc/am/3.0'}, 'geni_request_rspec_versions': [ { 'extensions': [], 'namespace': 'http://www.protogeni.net/resources/rspec/0.1', 'schema': 'http://www.protogeni.net/resources/rspec/0.1/request.xsd', 'type': 'ProtoGENI', 'version': '0.1'}, { 'extensions': [], 'namespace': 'http://www.protogeni.net/resources/rspec/0.2', 'schema': 'http://www.protogeni.net/resources/rspec/0.2/request.xsd', 'type': 'ProtoGENI', 'version': '0.2'}, { 'extensions': [ 'http://www.protogeni.net/resources/rspec/ext/emulab/1'], 'namespace': 'http://www.protogeni.net/resources/rspec/2', 'schema': 'http://www.protogeni.net/resources/rspec/2/request.xsd', 'type': 'ProtoGENI', 'version': '2'}, { 'extensions': [ 'http://www.protogeni.net/resources/rspec/ext/emulab/1'], 'namespace': 'http://www.geni.net/resources/rspec/3', 'schema': 'http://www.geni.net/resources/rspec/3/request.xsd', 'type': 'GENI', 'version': '3'}], 'hostname': 'boss.instageni.maxgigapop.net', 'hrn': 'maxinstageni.cm', 'interface': 'aggregate', 'url': 'https://boss.instageni.maxgigapop.net:12369/protogeni/xmlrpc/am', 'urn': 'urn:publicid:IDN+instageni.maxgigapop.net+authority+cm'} 14:14:18 INFO omni: ------------------------------------------------------------ 14:14:18 INFO omni: Completed getversion: Args: getversion Result Summary: Got version for https://instageni.maxgigapop.net:12369/protogeni/xmlrpc/am 14:14:18 INFO omni: ============================================================ }}} The InstaGENI version in" 'code_tag':'bdcc521e90e9bea5a006ebeee8f1b3219d49979e'" is the same as the other available InstaGENI sites: || '''Site''' || ''' InstaGENI Code tag ''' || ||Kettering || bdcc521e90e9bea5a006ebeee8f1b3219d49979e || ||NYU || bdcc521e90e9bea5a006ebeee8f1b3219d49979e || ||Clemson || bdcc521e90e9bea5a006ebeee8f1b3219d49979e || ||Princeton || bdcc521e90e9bea5a006ebeee8f1b3219d49979e || ||GPO || bdcc521e90e9bea5a006ebeee8f1b3219d49979e || ||MAX || bdcc521e90e9bea5a006ebeee8f1b3219d49979e || ||Northwestern || 46973e1c1a689d3c408da530580f52c6766a8552 || ||NYSERNet || 84a86a8dcbda2da9833488d267b9ba76be472f0b || ||GATech || bdcc521e90e9bea5a006ebeee8f1b3219d49979e || ||UKY || bdcc521e90e9bea5a006ebeee8f1b3219d49979e || ||Utah || 46973e1c1a689d3c408da530580f52c6766a8552 || ||UtahDDC || bdcc521e90e9bea5a006ebeee8f1b3219d49979e || Get list of "available" compute resources: {{{ $ omni.py -a ig-max listresources --available -o 14:16:39 INFO omni: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache' 14:16:39 INFO omni: Loading config file /home/lnevers/.gcf/omni_config 14:16:39 INFO omni: Using control framework portal 14:16:39 INFO omni: Substituting AM nickname ig-max with URL https://instageni.maxgigapop.net:12369/protogeni/xmlrpc/am, URN urn:publicid:IDN+instageni.maxgigapop.net+authority+cm 14:16:39 INFO omni: Saving output to a file. 14:16:42 INFO omni: Listed advertised resources at 1 out of 1 possible aggregates. 14:16:42 INFO omni: (PG log url - look here for details on any failures: https://www.instageni.maxgigapop.net/spewlogfile.php3?logfile=a452fa27ff854a589a7aca07e81ec66d) 14:16:42 INFO omni: Writing to 'rspec-instageni-maxgigapop-net.xml' 14:16:42 INFO omni: ------------------------------------------------------------ 14:16:42 INFO omni: Completed listresources: Args: listresources Result Summary: Queried resources from 1 of 1 aggregate(s). Wrote rspecs from 1 aggregate(s) to 1 file(s) Saved listresources RSpec from 'urn:publicid:IDN+instageni.maxgigapop.net+authority+cm' (url 'https://instageni.maxgigapop.net:12369/protogeni/xmlrpc/am') to file rspec-instageni-maxgigapop-net.xml; 14:16:42 INFO omni: ============================================================ }}} Verified that Advertisement RSpec only includes available resources, as requested: {{{ $ egrep "node comp|available now" rspec-instageni-maxgigapop-net.xml }}} Created a slice: {{{ $ omni.py createslice IG-CT-1 14:17:17 INFO omni: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache' 14:17:17 INFO omni: Loading config file /home/lnevers/.gcf/omni_config 14:17:17 INFO omni: Using control framework portal 14:17:18 INFO omni: Created slice with Name IG-CT-1, URN urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-CT-1, Expiration 2013-09-23 12:39:31 14:17:18 INFO omni: ------------------------------------------------------------ 14:17:18 INFO omni: Completed createslice: Args: createslice IG-CT-1 Result Summary: Created slice with Name IG-CT-1, URN urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-CT-1, Expiration 2013-09-23 12:39:31 14:17:18 INFO omni: ============================================================ }}} Created a 4 VMs sliver using the RSpec [http://groups.geni.net/geni/browser/trunk/GENIRacks/InstaGENI/Spiral5/RSpecs/ConfirmationTests/MAX/IG-CT-1-max.rspec IG-CT-1-max.rspec]: {{{ $ omni.py createsliver -a ig-max IG-CT-1 IG-CT-1-max.rspec 14:17:33 INFO omni: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache' 14:17:33 INFO omni: Loading config file /home/lnevers/.gcf/omni_config 14:17:33 INFO omni: Using control framework portal 14:17:33 INFO omni: Substituting AM nickname ig-max with URL https://instageni.maxgigapop.net:12369/protogeni/xmlrpc/am, URN urn:publicid:IDN+instageni.maxgigapop.net+authority+cm 14:17:34 INFO omni: Slice urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-CT-1 expires on 2013-09-23 12:39:31 UTC 14:17:34 INFO omni: Creating sliver(s) from rspec file IG-CT-1-max.rspec for slice urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-CT-1 14:17:52 INFO omni: (PG log url - look here for details on any failures: https://www.instageni.maxgigapop.net/spewlogfile.php3?logfile=8a481b88d79b3bd73368c53287fb08cf) 14:17:52 INFO omni: Got return from CreateSliver for slice IG-CT-1 at https://instageni.maxgigapop.net:12369/protogeni/xmlrpc/am: 14:17:52 INFO omni: 14:17:52 INFO omni: 14:17:52 INFO omni: ------------------------------------------------------------ 14:17:52 INFO omni: Completed createsliver: Args: createsliver IG-CT-1 IG-CT-1-max.rspec Result Summary: Got Reserved resources RSpec from instageni-maxgigapop-net 14:17:52 INFO omni: ============================================================ }}} The following is login information for the sliver: {{{ $ readyToLogin.py -a ig-max IG-CT-1 <...> ================================================================================ LOGIN INFO for AM: https://instageni.maxgigapop.net:12369/protogeni/xmlrpc/am ================================================================================ For more login info, see the section entitled: 'Providing a private key to ssh' in 'readyToLogin.py -h' xen4's geni_status is: changing (am_status:ready) User lnevers logs in to xen4 using: ssh -p 30013 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.instageni.maxgigapop.net xen2's geni_status is: changing (am_status:ready) User lnevers logs in to xen2 using: ssh -p 30011 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.instageni.maxgigapop.net xen1's geni_status is: changing (am_status:ready) User lnevers logs in to xen1 using: ssh -p 30010 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.instageni.maxgigapop.net xen3's geni_status is: ready (am_status:ready) User lnevers logs in to xen3 using: ssh -p 30012 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.instageni.maxgigapop.net }}} === Measurements === Log into specified host and collect iperf and ping statistics. All measurements are collected over 60 seconds, using default images and default link bandwidth: '''Iperf InstaGENI MAX VM-2 to VM-1 (TCP) ''Collected: 2013-09-17'' __One Client_ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 718 MBytes 100 Mbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.1 sec 144 MBytes 20.0 Mbits/sec [ 7] 0.0-60.1 sec 144 MBytes 20.1 Mbits/sec [ 4] 0.0-60.1 sec 144 MBytes 20.2 Mbits/sec [ 5] 0.0-60.1 sec 144 MBytes 20.0 Mbits/sec [ 6] 0.0-60.1 sec 144 MBytes 20.2 Mbits/sec [SUM] 0.0-60.1 sec 720 MBytes 101 Mbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 6] 0.0-60.1 sec 76.2 MBytes 10.6 Mbits/sec [ 3] 0.0-60.1 sec 77.0 MBytes 10.7 Mbits/sec [ 7] 0.0-60.1 sec 76.2 MBytes 10.6 Mbits/sec [ 9] 0.0-60.1 sec 64.8 MBytes 9.03 Mbits/sec [ 8] 0.0-60.2 sec 77.0 MBytes 10.7 Mbits/sec [ 11] 0.0-60.2 sec 65.4 MBytes 9.11 Mbits/sec [ 10] 0.0-60.2 sec 65.6 MBytes 9.15 Mbits/sec [ 4] 0.0-60.2 sec 76.2 MBytes 10.6 Mbits/sec [ 12] 0.0-60.2 sec 65.8 MBytes 9.16 Mbits/sec [ 5] 0.0-60.2 sec 77.8 MBytes 10.8 Mbits/sec [SUM] 0.0-60.2 sec 722 MBytes 101 Mbits/sec }}} '''Iperf InstaGENI MAX VM-2 to the VM-1 (UDP) {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 719 MBytes 101 Mbits/sec [ 3] Sent 512772 datagrams [ 3] Server Report: [ 3] 0.0-59.9 sec 693 MBytes 97.0 Mbits/sec 0.133 ms 18617/512771 (3.6%) [ 3] 0.0-59.9 sec 1 datagrams received out-of-order }}} '''Ping from InstaGENI MAX VM-2 to the VM-1 ''' {{{ 60 packets transmitted, 60 received, 0% packet loss, time 58995ms rtt min/avg/max/mdev = 0.227/0.303/0.476/0.071 ms }}} == IG-CT-2 - Access to New Site bare metal and VM resources == Create a slice: {{{ $ omni.py createslice IG-CT-2 14:43:05 INFO omni: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache' 14:43:05 INFO omni: Loading config file /home/lnevers/.gcf/omni_config 14:43:05 INFO omni: Using control framework portal 14:43:06 INFO omni: Created slice with Name IG-CT-2, URN urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-CT-2, Expiration 2013-09-23 12:53:05 14:43:06 INFO omni: ------------------------------------------------------------ 14:43:06 INFO omni: Completed createslice: Args: createslice IG-CT-2 Result Summary: Created slice with Name IG-CT-2, URN urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-CT-2, Expiration 2013-09-23 12:53:05 14:43:06 INFO omni: ============================================================ }}} Created a sliver with one VM and one Raw PC using RSpec [http://groups.geni.net/geni/browser/trunk/GENIRacks/InstaGENI/Spiral5/RSpecs/ConfirmationTests/MAX/IG-CT-2-max.rspec IG-CT-2-max.rspec] {{{ $ omni.py createsliver -a ig-max IG-CT-2 IG-CT-2-max.rspec 14:43:25 INFO omni: Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache' 14:43:25 INFO omni: Loading config file /home/lnevers/.gcf/omni_config 14:43:25 INFO omni: Using control framework portal 14:43:25 INFO omni: Substituting AM nickname ig-max with URL https://instageni.maxgigapop.net:12369/protogeni/xmlrpc/am, URN urn:publicid:IDN+instageni.maxgigapop.net+authority+cm 14:43:26 INFO omni: Slice urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-CT-2 expires on 2013-09-23 12:53:05 UTC 14:43:26 INFO omni: Creating sliver(s) from rspec file IG-CT-2-max.rspec for slice urn:publicid:IDN+ch.geni.net:ln-prj+slice+IG-CT-2 14:43:40 INFO omni: (PG log url - look here for details on any failures: https://www.instageni.maxgigapop.net/spewlogfile.php3?logfile=808042cb1073ac0b1eaf7375bd18af94) 14:43:40 INFO omni: Got return from CreateSliver for slice IG-CT-2 at https://instageni.maxgigapop.net:12369/protogeni/xmlrpc/am: 14:43:40 INFO omni: 14:43:40 INFO omni: 14:43:40 INFO omni: ------------------------------------------------------------ 14:43:40 INFO omni: Completed createsliver: Args: createsliver IG-CT-2 IG-CT-2-max.rspec Result Summary: Got Reserved resources RSpec from instageni-maxgigapop-net 14:43:40 INFO omni: ============================================================ }}} Determined login information: {{{ $ readyToLogin.py -a ig-max IG-CT-2 <...> ================================================================================ LOGIN INFO for AM: https://instageni.maxgigapop.net:12369/protogeni/xmlrpc/am ================================================================================ For more login info, see the section entitled: 'Providing a private key to ssh' in 'readyToLogin.py -h' VM's geni_status is: ready (am_status:ready) User lnevers logs in to VM using: ssh -p 30778 -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc3.instageni.maxgigapop.net PC's geni_status is: ready (am_status:ready) User lnevers logs in to PC using: ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@pc4.instageni.maxgigapop.net }}} === Measurements === Log into specified host and collect iperf and ping statistics. All measurements are collected over 60 seconds, using default images and default link bandwidth: '''Iperf InstaGENI MAX PC to VM (TCP) ''Collected: 2013-09-17'' __One Client_ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 714 MBytes 99.8 Mbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 4] 0.0-60.0 sec 143 MBytes 20.0 Mbits/sec [ 5] 0.0-60.0 sec 143 MBytes 20.0 Mbits/sec [ 6] 0.0-60.1 sec 143 MBytes 20.0 Mbits/sec [ 3] 0.0-60.1 sec 143 MBytes 20.0 Mbits/sec [ 7] 0.0-60.1 sec 143 MBytes 20.0 Mbits/sec [SUM] 0.0-60.1 sec 716 MBytes 99.8 Mbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 8] 0.0-60.0 sec 71.8 MBytes 10.0 Mbits/sec [ 9] 0.0-60.1 sec 71.5 MBytes 9.99 Mbits/sec [ 6] 0.0-60.1 sec 71.9 MBytes 10.0 Mbits/sec [ 10] 0.0-60.2 sec 71.8 MBytes 10.0 Mbits/sec [ 11] 0.0-60.2 sec 71.6 MBytes 9.98 Mbits/sec [ 12] 0.0-60.2 sec 71.8 MBytes 10.0 Mbits/sec [ 7] 0.0-60.2 sec 71.8 MBytes 9.99 Mbits/sec [ 4] 0.0-60.3 sec 72.5 MBytes 10.1 Mbits/sec [ 3] 0.0-60.3 sec 72.0 MBytes 10.0 Mbits/sec [ 5] 0.0-60.3 sec 71.8 MBytes 9.98 Mbits/sec [SUM] 0.0-60.3 sec 718 MBytes 99.9 Mbits/sec }}} '''Iperf InstaGENI MAX PC to the VM (UDP) {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 770 MBytes 108 Mbits/sec [ 3] Sent 549531 datagrams [ 3] Server Report: [ 3] 0.0-60.2 sec 687 MBytes 95.9 Mbits/sec 0.067 ms 59155/549530 (11%) [ 3] 0.0-60.2 sec 1 datagrams received out-of-order }}} '''Ping from InstaGENI MAX PC to VM ''' {{{ 60 packets transmitted, 60 received, 0% packet loss, time 58999ms rtt min/avg/max/mdev = 0.342/0.416/0.546/0.057 ms }}} '''Iperf InstaGENI MAX VM to PC (TCP) ''Collected: 2013-09-17'' __One Client_ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 718 MBytes 100 Mbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 7] 0.0-60.0 sec 143 MBytes 20.0 Mbits/sec [ 5] 0.0-60.0 sec 144 MBytes 20.1 Mbits/sec [ 6] 0.0-60.1 sec 143 MBytes 20.0 Mbits/sec [ 4] 0.0-60.1 sec 145 MBytes 20.3 Mbits/sec [ 3] 0.0-60.1 sec 145 MBytes 20.2 Mbits/sec [SUM] 0.0-60.1 sec 720 MBytes 100 Mbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 9] 0.0-60.1 sec 83.1 MBytes 11.6 Mbits/sec [ 7] 0.0-60.1 sec 62.2 MBytes 8.69 Mbits/sec [ 8] 0.0-60.1 sec 68.5 MBytes 9.56 Mbits/sec [ 10] 0.0-60.2 sec 54.2 MBytes 7.56 Mbits/sec [ 6] 0.0-60.2 sec 80.8 MBytes 11.3 Mbits/sec [ 11] 0.0-60.2 sec 70.5 MBytes 9.82 Mbits/sec [ 5] 0.0-60.3 sec 111 MBytes 15.5 Mbits/sec [ 4] 0.0-60.3 sec 50.1 MBytes 6.98 Mbits/sec [ 3] 0.0-60.3 sec 76.4 MBytes 10.6 Mbits/sec [ 12] 0.0-60.3 sec 60.6 MBytes 8.44 Mbits/sec [SUM] 0.0-60.3 sec 718 MBytes 99.9 Mbits/sec }}} '''Iperf InstaGENI MAX VM to the PC (UDP) {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 719 MBytes 100 Mbits/sec [ 3] Sent 512744 datagrams [ 3] Server Report: [ 3] 0.0-60.2 sec 693 MBytes 96.6 Mbits/sec 15.495 ms 18060/512743 (3.5%) [ 3] 0.0-60.2 sec 1 datagrams received out-of-order }}} '''Ping from InstaGENI MAX VM to PC ''' {{{ 60 packets transmitted, 60 received, 0% packet loss, time 58998ms rtt min/avg/max/mdev = 0.348/0.412/0.551/0.059 ms }}} == IG-CT-3 - Multiple sites experiment == == IG-CT-4 - Multiple sites !OpenFlow experiment and interoperability == == IG-CT-5 - Experiment Monitoring == == IG-CT-6 - Administrative Tests == ---- {{{ #!html Email help@geni.net for GENI support or email me with feedback on this page! }}}