[[PageOutline(1-2)]] __Note:__ Omni nick_names for site aggregates used for these tests are: {{{ psc-eg=urn:publicid:IDN+exogeni.net:pscvmsite+authority+am,https://psc-hn.exogeni.net:11443/orca/xmlrpc }}} == EG-CT-1 - Access to New Site VM resources == First determine orca_version running at this aggregate: {{{ $ omni -a psc-eg getversion ... 16:12:57 INFO : AM psc-eg URN: urn:publicid:IDN+exogeni.net:pscvmsite+authority+am (url: https://psc-hn.exogeni.net:11443/orca/xmlrpc) has version: 16:12:57 INFO : { 'geni_ad_rspec_versions': [ { 'extensions': [ 'http://hpn.east.isi.edu/rspec/ext/stitch/0.1/stitch-schema.xsd', 'http://www.protogeni.net/resources/rspec/ext/emulab/1/ptop_extension.xsd'], 'namespace': 'http://www.geni.net/resources/rspec/3', 'schema': 'http://www.geni.net/resources/rspec/3/ad.xsd', 'type': 'GENI', 'version': '3'}], 'geni_am_type': 'orca', 'geni_api': 2, 'geni_api_versions': { '2': 'https://psc-hn.exogeni.net:11443/orca/xmlrpc'}, 'geni_request_rspec_versions': [ { 'extensions': [ 'http://www.geni.net/resources/rspec/ext/shared-vlan/1', 'http://www.geni.net/resources/rspec/ext/postBootScript/1', 'http://hpn.east.isi.edu/rspec/ext/stitch/0.1/'], 'namespace': 'http://www.geni.net/resources/rspec/3', 'schema': 'http://www.geni.net/resources/rspec/3/request.xsd', 'type': 'GENI', 'version': '3'}], 'orca_version': 'ORCA 5.0 Eastsound: v.5.1.4.build-6a5cb64eaa09996b516c1879fddae07284a9c124'} 16:12:57 INFO : ------------------------------------------------------ 16:12:57 INFO : Completed getversion: Options as run: aggregate: ['psc-eg'] framework: portal noGetVersionCache: True project: ln-test Args: getversion Result Summary: Got version for psc-eg }}} Compared with versions in other racks, the following version were found: ||''' Site''' ||''' Orca Version ''' || || bbn || ORCA 5.0 Eastsound: v.5.1.4.build-6a5cb64eaa09996b516c1879fddae07284a9c124 || || fiu || ORCA 5.0 Eastsound: v.5.1.4.build-6a5cb64eaa09996b516c1879fddae07284a9c124 || || gwu || ORCA 5.0 Eastsound: v.5.1.4.build-6a5cb64eaa09996b516c1879fddae07284a9c124 || || osf || ORCA 5.0 Eastsound: v.5.1.4.build-6a5cb64eaa09996b516c1879fddae07284a9c124 || || psc || ORCA 5.0 Eastsound: v.5.1.4.build-6a5cb64eaa09996b516c1879fddae07284a9c124 || || rci || ORCA 5.0 Eastsound: v.5.1.4.build-6a5cb64eaa09996b516c1879fddae07284a9c124 || || sl || ORCA 5.0 Eastsound: v.5.1.4.build-6a5cb64eaa09996b516c1879fddae07284a9c124 || || tamu || ORCA 5.0 Eastsound: v.5.1.4.build-6a5cb64eaa09996b516c1879fddae07284a9c124 || || uaf || ORCA 5.0 Eastsound: v.5.1.4.build-6a5cb64eaa09996b516c1879fddae07284a9c124 || || ufl || ORCA 5.0 Eastsound: v.5.1.4.build-6a5cb64eaa09996b516c1879fddae07284a9c124 || || uh || ORCA 5.0 Eastsound: v.5.1.4.build-6a5cb64eaa09996b516c1879fddae07284a9c124 || || umass || ORCA 5.0 Eastsound: v.5.1.4.build-6a5cb64eaa09996b516c1879fddae07284a9c124 || || unf || ORCA 5.0 Eastsound: v.5.1.4.build-6a5cb64eaa09996b516c1879fddae07284a9c124 || || wsu || ORCA 5.0 Eastsound: v.5.1.4.build-6a5cb64eaa09996b516c1879fddae07284a9c124 || || exosm || ORCA 5.0 Eastsound: v.5.1.4.build-6a5cb64eaa09996b516c1879fddae07284a9c124 || Created a slice and then created a 4 VMs sliver using the RSpec [http://groups.geni.net/geni/browser/trunk/GENIRacks/ExoGENI/Spiral5/RSpecs/ConfirmationTests/PSC/EG-CT-1.rspec EG-CT-1.rspec] {{{ $ omni createsliver -a psc-eg EG-CT-1 EG-CT-1.rspec 11:35:52 INFO : Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache' 11:35:52 INFO : Loading config file '/home/lnevers/.gcf/omni_config' 11:35:52 INFO : Using control framework portal 11:35:52 INFO : Member Authority is https://ch.geni.net/MA (from config) 11:35:52 INFO : Slice Authority is https://ch.geni.net/SA (from config) 11:35:52 INFO : Substituting AM nickname psc-eg with URL https://psc-hn.exogeni.net:11443/orca/xmlrpc, URN urn:publicid:IDN+exogeni.net:pscvmsite+authority+am 11:35:52 INFO : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-CT-1 expires on 2017-05-03 15:25:02 UTC 11:35:52 INFO : Creating sliver(s) from rspec file EG-CT-1.rspec for slice urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-CT-1 11:35:57 INFO : Got return from CreateSliver for slice EG-CT-1 at psc-eg: 11:35:57 INFO : 11:35:57 INFO : 11:35:57 INFO : 11:35:57 INFO : ------------------------------------------------------ 11:35:57 INFO : Completed createsliver: Options as run: aggregate: ['psc-eg'] framework: portal project: ln-test Args: createsliver EG-CT-1 EG-CT-1.rspec Result Summary: Got Reserved resources RSpec from exogeni-net-pscvmsite }}} Determine login information: {{{ $ readyToLogin -a psc-eg EG-CT-1 <....> VM-4's geni_status is: ready User lnevers logs in to VM-4 using: ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@147.72.248.4 VM-1's geni_status is: ready User lnevers logs in to VM-1 using: ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@147.72.248.6 VM-2's geni_status is: ready User lnevers logs in to VM-2 using: ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@147.72.248.7 VM-3's geni_status is: ready User lnevers logs in to VM-3 using: ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@147.72.248.5 }}} === Measurements === Login to two of the nodes and collect iperf and ping statistics. All measurements are collected over 60 seconds: ''Collected: 2017-04-26'' '''Iperf ExoGENI VM-2 to VM-1 (TCP) - TCP window size: 85.0 KB ''' __One Client_ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 112 GBytes 16.0 Gbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 4] 0.0-60.0 sec 26.9 GBytes 3.85 Gbits/sec [ 3] 0.0-60.0 sec 27.0 GBytes 3.87 Gbits/sec [ 5] 0.0-60.0 sec 27.0 GBytes 3.87 Gbits/sec [ 6] 0.0-60.0 sec 26.8 GBytes 3.84 Gbits/sec [ 7] 0.0-60.0 sec 27.1 GBytes 3.88 Gbits/sec [SUM] 0.0-60.0 sec 135 GBytes 19.3 Gbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 4] 0.0-60.0 sec 13.8 GBytes 1.98 Gbits/sec [ 5] 0.0-60.0 sec 13.8 GBytes 1.98 Gbits/sec [ 3] 0.0-60.0 sec 13.8 GBytes 1.98 Gbits/sec [ 7] 0.0-60.0 sec 13.9 GBytes 1.98 Gbits/sec [ 8] 0.0-60.0 sec 13.8 GBytes 1.97 Gbits/sec [ 12] 0.0-60.0 sec 13.9 GBytes 1.99 Gbits/sec [ 6] 0.0-60.0 sec 13.9 GBytes 1.99 Gbits/sec [ 10] 0.0-60.0 sec 13.9 GBytes 1.98 Gbits/sec [ 11] 0.0-60.0 sec 13.8 GBytes 1.98 Gbits/sec [ 9] 0.0-60.0 sec 13.9 GBytes 1.99 Gbits/sec [SUM] 0.0-60.0 sec 138 GBytes 19.8 Gbits/sec }}} '''Iperf ExoGENI VM-2 to the VM-1 (UDP) - 1470 byte datagrams & UDP buffer size: 208 KByte ''' {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 719 MBytes 101 Mbits/sec [ 3] Sent 512814 datagrams [ 3] Server Report: [ 3] 0.0-60.0 sec 719 MBytes 101 Mbits/sec 0.001 ms 0/512813 (0%) [ 3] 0.0-60.0 sec 1 datagrams received out-of-order }}} '''Ping ExoGENI VM-2 to the VM-1 ''' {{{ 60 packets transmitted, 60 received, 0% packet loss, time 59000ms rtt min/avg/max/mdev = 0.083/0.133/0.255/0.045 ms }}} == EG-CT-2 - Access to New Site bare metal and VM resources == Create a slice and a sliver with one VM and one bare metal node using RSpec [http://groups.geni.net/geni/browser/trunk/GENIRacks/ExoGENI/Spiral5/RSpecs/ConfirmationTests/PSC/EG-CT-2.rspec EG-CT-2.rspec]. Note: Bare metal only available via ExoSM. {{{ $ omni createsliver EG-CT-2a -a eg-sm ./EG-CT-2.rspec 12:00:16 INFO : Loading agg_nick_cache file '/home/lnevers/.gcf/agg_nick_cache' 12:00:16 INFO : Loading config file '/home/lnevers/.gcf/omni_config' 12:00:16 INFO : Using control framework portal 12:00:16 INFO : Member Authority is https://ch.geni.net/MA (from config) 12:00:16 INFO : Slice Authority is https://ch.geni.net/SA (from config) 12:00:17 INFO : Substituting AM nickname eg-sm with URL https://geni.renci.org:11443/orca/xmlrpc, URN urn:publicid:IDN+exogeni.net+authority+am 12:00:17 INFO : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-CT-2a expires on 2017-05-03 16:00:16 UTC 12:00:17 INFO : Creating sliver(s) from rspec file ./EG-CT-2.rspec for slice urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-CT-2a 12:00:27 INFO : Got return from CreateSliver for slice EG-CT-2a at eg-sm: 12:00:27 INFO : 12:00:27 INFO : 12:00:27 INFO : 12:00:27 INFO : ------------------------------------------------------ 12:00:27 INFO : Completed createsliver: Options as run: aggregate: ['eg-sm'] framework: portal project: ln-test Args: createsliver EG-CT-2a ./EG-CT-2.rspec Result Summary: Got Reserved resources RSpec from exogeni-net }}} Determine login information: {{{ $ readyToLogin EG-CT-2a -a eg-sm <...> BM-1's geni_status is: ready User lnevers logs in to BM-1 using: ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@147.72.248.126 VM-1's geni_status is: ready User lnevers logs in to VM-1 using: ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@147.72.248.8 }}} === Measurements === ''Collected: 2017-04-26'' '''Iperf ExoGENI BM-1 to VM-1 (TCP) - TCP window size: 19.3 KB ''' __One Client_ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 65.5 GBytes 9.38 Gbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 11.9 GBytes 1.70 Gbits/sec [ 4] 0.0-60.0 sec 11.9 GBytes 1.70 Gbits/sec [ 5] 0.0-60.0 sec 12.0 GBytes 1.71 Gbits/sec [ 7] 0.0-60.0 sec 19.4 GBytes 2.78 Gbits/sec [ 6] 0.0-60.0 sec 10.4 GBytes 1.50 Gbits/sec [SUM] 0.0-60.0 sec 65.6 GBytes 9.39 Gbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 12] 0.0-60.0 sec 5.44 GBytes 779 Mbits/sec [ 4] 0.0-60.0 sec 8.22 GBytes 1.18 Gbits/sec [ 6] 0.0-60.0 sec 7.10 GBytes 1.02 Gbits/sec [ 7] 0.0-60.0 sec 7.28 GBytes 1.04 Gbits/sec [ 3] 0.0-60.0 sec 5.95 GBytes 851 Mbits/sec [ 8] 0.0-60.0 sec 6.08 GBytes 870 Mbits/sec [ 10] 0.0-60.0 sec 7.34 GBytes 1.05 Gbits/sec [ 5] 0.0-60.0 sec 5.81 GBytes 831 Mbits/sec [ 9] 0.0-60.0 sec 5.71 GBytes 817 Mbits/sec [ 11] 0.0-60.0 sec 6.65 GBytes 952 Mbits/sec [SUM] 0.0-60.0 sec 65.6 GBytes 9.39 Gbits/sec }}} '''Iperf ExoGENI BM-1 to the VM-1 (UDP) - 1470 byte datagrams & UDP buffer size: 4.00 MByte ''' {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 719 MBytes 101 Mbits/sec [ 3] Sent 512821 datagrams [ 3] Server Report: [ 3] 0.0-60.0 sec 719 MBytes 101 Mbits/sec 0.008 ms 0/512820 (0%) [ 3] 0.0-60.0 sec 1 datagrams received out-of-order }}} '''Ping from ExoGENI BM-1 the VM-1 ''' {{{ 60 packets transmitted, 60 received, 0% packet loss, time 59002ms rtt min/avg/max/mdev = 0.093/0.310/3.835/0.463 ms }}} ''Collected: 2017-04-26'' '''Iperf ExoGENI VM-1 to BM-1 (TCP) - TCP window size: 85.0 KB ''' __One Client_ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 65.2 GBytes 9.34 Gbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 4] 0.0-60.0 sec 13.5 GBytes 1.94 Gbits/sec [ 5] 0.0-60.0 sec 9.90 GBytes 1.42 Gbits/sec [ 6] 0.0-60.0 sec 14.6 GBytes 2.09 Gbits/sec [ 3] 0.0-60.0 sec 14.3 GBytes 2.05 Gbits/sec [ 7] 0.0-60.0 sec 13.0 GBytes 1.87 Gbits/sec [SUM] 0.0-60.0 sec 65.4 GBytes 9.36 Gbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 5] 0.0-60.0 sec 5.35 GBytes 766 Mbits/sec [ 7] 0.0-60.0 sec 7.48 GBytes 1.07 Gbits/sec [ 6] 0.0-60.0 sec 5.67 GBytes 812 Mbits/sec [ 8] 0.0-60.0 sec 5.21 GBytes 746 Mbits/sec [ 10] 0.0-60.0 sec 9.27 GBytes 1.33 Gbits/sec [ 11] 0.0-60.0 sec 6.30 GBytes 901 Mbits/sec [ 12] 0.0-60.0 sec 6.39 GBytes 914 Mbits/sec [ 4] 0.0-60.0 sec 4.39 GBytes 628 Mbits/sec [ 9] 0.0-60.0 sec 7.06 GBytes 1.01 Gbits/sec [ 3] 0.0-60.0 sec 8.14 GBytes 1.17 Gbits/sec [SUM] 0.0-60.0 sec 65.3 GBytes 9.34 Gbits/sec }}} '''Iperf ExoGENI VM-1 to BM-1 (UDP) - 1470 byte datagrams & UDP buffer size: 208 KByte ''' {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 719 MBytes 101 Mbits/sec [ 3] Sent 512821 datagrams [ 3] Server Report: [ 3] 0.0-60.0 sec 719 MBytes 101 Mbits/sec 0.000 ms 0/512820 (0%) [ 3] 0.0-60.0 sec 1 datagrams received out-of-order }}} '''Ping from ExoGENI VM-1 to BM-1 ''' {{{ 60 packets transmitted, 60 received, 0% packet loss, time 58997ms rtt min/avg/max/mdev = 0.095/0.186/0.253/0.028 ms }}} == EG-CT-3 - Multiple sites experiment == The GPO and PSC racks are used in this experiment. First create a slice and a sliver via the ExoSM that includes both GPO and PSC VMs using the RSpec the RSpec [http://groups.geni.net/geni/browser/trunk/GENIRacks/ExoGENI/Spiral5/RSpecs/ConfirmationTests/PSC/EG-CT-3.rspec EG-CT-3.rspec] {{{ $ stitcher createsliver -a eg-sm EG-CT-3b ./EG-CT-3.rspec --defaultCapacity=100000 -o 15:17:07 INFO : Configured logging from file /home/lnevers/geni-tools-2.10/src/gcf/stitcher_logging.conf 15:17:07 INFO : Reading slice EG-CT-3b credential... 15:17:07 INFO : Slice urn:publicid:IDN+ch.geni.net:ln-test+slice+EG-CT-3b expires on 2017-05-03 16:53:48 UTC 15:17:07 INFO : Multi-AM reservation will include resources from these aggregates: 15:17:07 INFO : 15:17:07 INFO : Stitcher doing createsliver at ... 15:17:30 INFO : ... Allocation at complete. 15:17:30 INFO : All aggregates are complete. 15:17:30 INFO : Your resources expire at 2017-05-02T19:07:07 (UTC). 15:17:30 INFO : Saved combined reservation RSpec at 1 AM(s) to file '/home/lnevers/gcf-test/exorspec/PSC/EG-CT-3b-manifest-rspec-multiam-combined.xml' Success: Reserved resources in slice EG-CT-3b at 1 Aggregates. }}} Determine login information for allocated nodes: {{{ $ readyToLogin -a eg-sm EG-CT-3b <...> psc's geni_status is: ready User lnevers logs in to psc using: ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@147.72.248.9 gpo's geni_status is: ready User lnevers logs in to gpo using: ssh -i /home/lnevers/.ssh/geni_cert_portal_key lnevers@192.1.242.40 }}} === Measurements === ''Collected: 2017-04-26'' '''Iperf ExoGENI GPO VM to PSC VM (TCP) - TCP window size: 85.0 KB ''' __One Client__ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 702 MBytes 98.1 Mbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 4] 0.0-60.0 sec 130 MBytes 18.2 Mbits/sec [ 5] 0.0-60.1 sec 141 MBytes 19.7 Mbits/sec [ 6] 0.0-60.1 sec 154 MBytes 21.5 Mbits/sec [ 7] 0.0-60.2 sec 139 MBytes 19.4 Mbits/sec [ 3] 0.0-60.4 sec 132 MBytes 18.4 Mbits/sec [SUM] 0.0-60.4 sec 696 MBytes 96.8 Mbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 9] 0.0-60.0 sec 70.1 MBytes 9.80 Mbits/sec [ 4] 0.0-60.0 sec 58.6 MBytes 8.19 Mbits/sec [ 10] 0.0-60.1 sec 61.5 MBytes 8.59 Mbits/sec [ 5] 0.0-60.1 sec 71.1 MBytes 9.93 Mbits/sec [ 7] 0.0-60.1 sec 69.4 MBytes 9.68 Mbits/sec [ 12] 0.0-60.2 sec 75.8 MBytes 10.6 Mbits/sec [ 3] 0.0-60.3 sec 70.9 MBytes 9.87 Mbits/sec [ 8] 0.0-60.3 sec 76.8 MBytes 10.7 Mbits/sec [ 11] 0.0-60.5 sec 74.0 MBytes 10.3 Mbits/sec [ 6] 0.0-60.6 sec 68.9 MBytes 9.53 Mbits/sec [SUM] 0.0-60.6 sec 697 MBytes 96.5 Mbits/sec }}} '''Iperf ExoGENI GPO VM to PSC VM (UDP) - 1470 byte datagrams & UDP buffer size: 208 KByte ''' {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 719 MBytes 101 Mbits/sec [ 3] Sent 512820 datagrams [ 3] Server Report: [ 3] 0.0-60.0 sec 701 MBytes 98.0 Mbits/sec 0.019 ms 12947/512819 (2.5%) [ 3] 0.0-60.0 sec 1 datagrams received out-of-order }}} '''Ping from GPO VM to PSC VM ''' {{{ 60 packets transmitted, 60 received, 0% packet loss, time 59102ms rtt min/avg/max/mdev = 16.365/16.620/17.251/0.200 ms }}} ''Collected: 2017-04-26'' '''Iperf ExoGENI PSC VM to GPO VM (TCP) - TCP window size: 85.0 KB ''' __One Client__ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 690 MBytes 96.4 Mbits/sec }}} __Five Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 7] 0.0-60.0 sec 169 MBytes 23.6 Mbits/sec [ 6] 0.0-60.1 sec 132 MBytes 18.4 Mbits/sec [ 5] 0.0-60.1 sec 142 MBytes 19.8 Mbits/sec [ 3] 0.0-60.1 sec 106 MBytes 14.8 Mbits/sec [ 4] 0.0-60.3 sec 144 MBytes 20.0 Mbits/sec [SUM] 0.0-60.3 sec 692 MBytes 96.2 Mbits/sec }}} __Ten Clients__ {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 70.8 MBytes 9.89 Mbits/sec [ 10] 0.0-60.0 sec 67.1 MBytes 9.38 Mbits/sec [ 12] 0.0-60.2 sec 81.2 MBytes 11.3 Mbits/sec [ 5] 0.0-60.2 sec 59.9 MBytes 8.35 Mbits/sec [ 7] 0.0-60.3 sec 70.8 MBytes 9.84 Mbits/sec [ 11] 0.0-60.3 sec 61.1 MBytes 8.50 Mbits/sec [ 9] 0.0-60.4 sec 68.9 MBytes 9.56 Mbits/sec [ 6] 0.0-60.5 sec 74.1 MBytes 10.3 Mbits/sec [ 4] 0.0-60.6 sec 73.1 MBytes 10.1 Mbits/sec [ 8] 0.0-60.8 sec 71.2 MBytes 9.83 Mbits/sec [SUM] 0.0-60.8 sec 698 MBytes 96.3 Mbits/sec }}} '''Iperf ExoGENI PSC VM to GPO VM (UDP) - 1470 byte datagrams & UDP buffer size: 208 KByte ''' {{{ [ ID] Interval Transfer Bandwidth [ 3] 0.0-60.0 sec 719 MBytes 101 Mbits/sec [ 3] Sent 512821 datagrams [ 3] Server Report: [ 3] 0.0-60.0 sec 705 MBytes 98.5 Mbits/sec 0.041 ms 10138/512820 (2%) [ 3] 0.0-60.0 sec 1 datagrams received out-of-order }}} '''Ping from GPO VM to PSC VM ''' {{{ 60 packets transmitted, 60 received, 0% packet loss, time 59099ms rtt min/avg/max/mdev = 16.407/16.575/16.732/0.154 ms }}} == EG-CT-4 - Multiple sites !OpenFlow experiment and interoperability == No meso-scale available, see PSC Stitching !OpenFlow test [wiki:GeniNetworkStitchingConfirmationTestStatus/PSC#IG-ST-6NewSiteOpenFlowtopology IG-ST-6] status. == EG-CT-6 - Administrative Tests == Administrator accounts on an ExoGENI rack are documented at https://wiki.exogeni.net/doku.php?id=public:operators:start, with https://wiki.exogeni.net/doku.php?id=public:operators:start#authentication_authorization proving insight into accounts creation and usage. With requested account accessed rack head node and verified root access and group membership: {{{ LNM:~$ ssh psc-hn.exogeni.net lnevers@psc-hn.exogeni.net's password: Last login: Sat Apr 29 01:43:41 2017 from dhcp152-54-9-188.europa.renci.org |-----------------------------------------------------------------| | ____ ____ ____ ____ ____ ____ ____ | | ||E |||x |||o |||G |||E |||N |||I || | | ||__|||__|||__|||__|||__|||__|||__|| | | |/__\|/__\|/__\|/__\|/__\|/__\|/__\| | | | |-----------------------------------------------------------------| [lnevers@psc-hn ~]$ sudo whoami [sudo] password for lnevers: root [lnevers@psc-hn ~]$ id uid=2556(lnevers) gid=2000(nonrenci) groups=2000(nonrenci),2500(fiuadmins),2501(uhadmins),2507(ufladmins),2508(osfadmins),2510(sladmins),2511(wvnadmins),2513(tamuadmins),2515(wsuadmins),2519(cienaadmins),2523(unfadmins),2524(ciena2admins),9500(xoadmins),9503(geni-imf),9510(bbnadmins) [lnevers@psc-hn ~]$ }}} From head node verified login and administrative access to each of the worker nodes that supply VMs. {{{ [lnevers@psc-hn ~]$ for i in 1 2 3 4 5 6 7 8; do sudo ssh root@psc-w$i "echo -n 'Executing on: ' ; hostname;whoami;uname -a"; done Executing on: psc-w1 root Linux psc-w1 2.6.32-642.11.1.el6.x86_64 #1 SMP Fri Nov 18 19:25:05 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Executing on: psc-w2 root Linux psc-w2 2.6.32-642.11.1.el6.x86_64 #1 SMP Fri Nov 18 19:25:05 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Executing on: psc-w3 root Linux psc-w3 2.6.32-642.11.1.el6.x86_64 #1 SMP Fri Nov 18 19:25:05 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Executing on: psc-w4 root Linux psc-w4 2.6.32-642.11.1.el6.x86_64 #1 SMP Fri Nov 18 19:25:05 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Executing on: psc-w5 root Linux psc-w5 2.6.32-642.11.1.el6.x86_64 #1 SMP Fri Nov 18 19:25:05 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Executing on: psc-w6 root Linux psc-w6 2.6.32-642.11.1.el6.x86_64 #1 SMP Fri Nov 18 19:25:05 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Executing on: psc-w7 root Linux psc-w7 2.6.32-642.11.1.el6.x86_64 #1 SMP Fri Nov 18 19:25:05 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Executing on: psc-w8 root Linux psc-w8 2.6.32-642.11.1.el6.x86_64 #1 SMP Fri Nov 18 19:25:05 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux [lnevers@psc-hn ~]$ }}} Connect to the management switch: {{{ [lnevers@psc-hn ~]$ ssh psc-8052.psc.xo The authenticity of host 'psc-8052.psc.xo (192.168.118.2)' can't be established. DSA key fingerprint is 9d:2b:da:99:3b:70:33:19:b8:49:a4:13:28:03:45:0a. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'psc-8052.psc.xo,192.168.118.2' (DSA) to the list of known hosts. Enter radius password: IBM Networking Operating System RackSwitch G8052. psc-8052.psc.xo>ena Enable privilege granted. psc-8052.psc.xo#show interface status ------------------------------------------------------------------ Alias Port Speed Duplex Flow Ctrl Link Name ------- ---- ----- -------- --TX-----RX-- ------ ------ 1 1 any any no no down 1 2 2 100 full no no up 2 3 3 1000 full no no up 3 4 4 1000 full no no up 4 5 5 1000 full no no up 5 6 6 1000 full no no up 6 7 7 1000 full no no up 7 8 8 1000 full no no up 8 9 9 1000 full no no up 9 10 10 1000 full no no up 10 11 11 1000 full no no up 11 12 12 1000 full no no up 12 13 13 1000 full no no up 13 14 14 1000 full no no up 14 15 15 any any no no down 15 16 16 any any no no down 16 17 17 any any no no down 17 18 18 any any no no down 18 19 19 any any no no down 19 20 20 any any no no down 20 21 21 any any no no down 21 22 22 any any no no down 22 23 23 any any no no down 23 24 24 any any no no down 24 25 25 any any no no down 25 26 26 any any no no down 26 27 27 any any no no down 27 28 28 any any no no down 28 29 29 any any no no down 29 30 30 any any no no down 30 31 31 any any no no down 31 32 32 any any no no down 32 33 33 any any no no down 33 34 34 any any no no down 34 35 35 1000 full no no up iSCSI Appliance 36 36 1000 full no no up headnode second embedded nic (em3) 37 37 1000 full no no up 37 38 38 1000 full no no up 38 39 39 1000 full no no up 39 40 40 1000 full no no up 40 41 41 1000 full no no up 41 42 42 1000 full no no up 42 43 43 1000 full no no up 43 44 44 1000 full no no up 44 45 45 100 full no no up 45 46 46 any any no no down 46 47 47 any any no no down 47 48 48 any any no no down 48 XGE1 49 10000* full* no* no* down XGE1 XGE2 50 10000 full no no up XGE2 XGE3 51 10000 full yes yes up XGE3 XGE4 52 10000 full no no up XGE4 * = value set by configuration; not autonegotiated. psc-8052.psc.xo# psc-8052.psc.xo#show version System Information at 9:35:07 Mon May 1, 2017 Time zone: America/US/Eastern Daylight Savings Time Status: Enabled IBM Networking Operating System RackSwitch G8052 Switch has been up for 139 days, 9 hours, 45 minutes and 5 seconds. Last boot: 8:27:17 Wed Dec 14, 2016 (power cycle) MAC address: a8:97:dc:c0:a7:00 IP (If 1) address: 192.168.118.2 Hardware Revision: Board Revision: Switch Serial No: Y014CM45M008 Hardware Part No: 00AY327 Spare Part No: 00AY327 Manufacturing date: 14/21 MTM: 7309HC1 ESN: MM48440 Software Version 7.2.2.0 (FLASH image1), active configuration. Temperature Top: 31 C Temperature Bottom: 36 C Temperature Fan Ctrl 88: 33 C Temperature Fan Ctrl 8a: 62 C Temperature Fan Ctrl 8c: 45 C Temperature Phy 0x01: 67 C Temperature Phy 0x09: 61 C Temperature Phy 0x11: 45 C Temperature Phy 0x21: 47 C Temperature Phy 0x29: 70 C Temperature Phy 0x31: 59 C Warning at 55 C and Recover at 80 C Fan 1 in Module 1: Not Installed Fan 2 in Module 1: Not Installed Fan 3 in Module 2: RPM= 8059 PWM= 25 ( 9%) Back-To-Front [J] Fan 4 in Module 2: RPM= 3266 PWM= 25 ( 9%) Back-To-Front [J] Fan 5 in Module 3: RPM= 7627 PWM= 25 ( 9%) Back-To-Front [J] Fan 6 in Module 3: RPM= 3197 PWM= 25 ( 9%) Back-To-Front [J] Fan 7 in Module 4: RPM= 7552 PWM= 25 ( 9%) Back-To-Front [J] Fan 8 in Module 4: RPM= 3099 PWM= 25 ( 9%) Back-To-Front [J] System Fan Airflow: Back-To-Front Power Supply 1: OK Power Supply 2: OK Power Faults: () Fan Faults: () Service Faults: () psc-8052.psc.xo#show vlan VLAN Name Status Ports ---- -------------------------------- ------ ------------------------- 1 Default VLAN ena 17-34 37-44 47 1006 ExoGENI Management ena 1-16 48-XGE4 1007 openstack workers ena 35 37-44 XGE2 XGE4 1008 baremetal workers ena 45 46 XGE2 XGE4 1010 Public Connectivity ena 36 1011 openstack VMs ena 37-44 XGE2 XGE4 psc-8052.psc.xo# }}} Connect to the !OpenFlow switch: {{{ [lnevers@psc-hn ~]$ ssh lnevers@psc-8264.psc.xo The authenticity of host 'psc-8264.psc.xo (192.168.118.4)' can't be established. RSA key fingerprint is d5:ec:37:aa:86:b3:bb:b9:f2:ca:36:9b:0b:06:a8:27. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'psc-8264.psc.xo,192.168.118.4' (RSA) to the list of known hosts. Enter radius password: IBM Networking Operating System RackSwitch G8264. ------------------------------------------------------------------ Note: The current running configuration includes changes that have NOT been saved to FLASH. ------------------------------------------------------------------ psc-8264.psc.xo>ena Enable privilege granted. psc-8264.psc.xo#show interface status ----------------------------------------------------------------------- Alias Port Speed Duplex Flow Ctrl Link Description ------- ---- ----- -------- --TX-----RX-- ------ ------------- 1 1 40000 full no no down w9 p2p1 5 5 40000 full no no down w10 p2p2 9 9 40000 full no no down w9 p2p2 13 13 40000 full no no down w10 p2p1 17 17 10000 full no no up storage p2p1 18 18 10000 full no no up storage p5p1 19 19 10000 full no no up storage p2p2 20 20 10000 full no no up storage p5p2 21 21 10000 full no no up Headnode p5p2 22 22 10000 full no no up Headnode p2p2 23 23 10000 full no no up 23 24 24 10000 full no no up 24 25 25 10000 full no no up 25 26 26 10000 full no no up 26 27 27 10000 full no no up 27 28 28 10000 full no no up 28 29 29 10000 full no no up 29 30 30 10000 full no no up 30 31 31 1G/10G full no no down 31 32 32 1G/10G full no no down 32 33 33 1G/10G full no no down 33 34 34 1G/10G full no no down 34 35 35 1G/10G full no no down 35 36 36 1G/10G full no no down 36 37 37 10000 full no no up Hybrid mode IXC port (to port 38); OpenFlow side 38 38 10000 full no no up Hybrid mode IXC port (to port 37); Traditional Ethernet side 39 39 1G/10G full no no down 39 40 40 1G/10G full no no down 40 41 41 10000 full no no up 41 42 42 10000 full no no up 42 43 43 10000 full no no up 43 44 44 10000 full no no up 44 45 45 10000 full no no up 45 46 46 10000 full no no up 46 47 47 10000 full no no up 47 48 48 10000 full no no up 48 49 49 1G/10G full no no down 49 50 50 1G/10G full no no down 50 51 51 1G/10G full no no down 51 52 52 1G/10G full no no down 52 53 53 1G/10G full no no down 53 54 54 1G/10G full no no down 54 55 55 1G/10G full no no down 55 56 56 1G/10G full no no down 56 57 57 1G/10G full no no down 57 58 58 1G/10G full no no down 58 59 59 1G/10G full no no down 59 60 60 1G/10G full no no down 60 61 61 1G/10G full no no down 61 62 62 1G/10G full no no down 62 63 63 10000 full no no up Mngt plane <--> port 51 (XGE3) 64 64 10000 full no no up Data plane connection MGT 65 any auto yes yes down MGT psc-8264.psc.xo# show version System Information at 9:41:27 Mon May 1, 2017 Time zone: America/US/Eastern Daylight Savings Time Status: Enabled IBM Networking Operating System RackSwitch G8264 Switch has been up for 138 days, 0 hours, 13 minutes and 3 seconds. Last boot: 8:28:12 Wed Dec 14, 2016 (power cycle) MAC address: a8:97:dc:c7:07:00 IP (If 1) address: 192.168.49.50 Management Port MAC Address: a8:97:dc:c7:07:fe Management Port IP Address (if 128): 0.0.0.0 Hardware Revision: 0 Hardware Part No: 00Y5484 Switch Serial No: Y019CM469239 Manufacturing date: 14/23 MTM Value: 7309-HC3 ESN: MM43502 Software Version 7.9.10 (FLASH image1), active configuration. Boot kernel version 7.9.10 USB Boot: disabled Temperature Mother Top : 43 C Temperature Mother Bottom : 31 C Temperature Daughter Top : 40 C Temperature Daughter Bottom : 27 C Temperature Switch Asic Max : 52 C System Warning at 75 C / Shutdown at 90 C Fan 1 Module 1: 7736rpm 15pwm( 5% bias:0) Back-To-Front Fan 2 Module 1: 3105rpm 15pwm( 5% bias:0) Back-To-Front Fan 3 Module 2: 7627rpm 15pwm( 5% bias:0) Back-To-Front Fan 4 Module 2: 3233rpm 15pwm( 5% bias:0) Back-To-Front Fan 5 Module 3: 7929rpm 15pwm( 5% bias:0) Back-To-Front Fan 6 Module 3: 3119rpm 15pwm( 5% bias:0) Back-To-Front Fan 7 Module 4: 7500rpm 15pwm( 5% bias:0) Back-To-Front Fan 8 Module 4: 3068rpm 15pwm( 5% bias:0) Back-To-Front System Fan Airflow: Back-To-Front Power Supply 1: Back-To-Front [DS450-3-002_REV0] Power Supply 2: Back-To-Front [DS450-3-002_REV0] Power Faults: None Fan Faults: None Service Faults: None psc-8264.psc.xo#show vlan VLAN Name Status Ports ---- -------------------------------- ------ ------------------------- 1 Default VLAN ena 1 5 23-37 39 40 51-62 2 orca_vlan_2 ena 1 41-48 3 orca_vlan_3 ena 1 41-48 4 orca_vlan_4 ena 1 41-48 5 orca_vlan_5 ena 1 41-48 6 orca_vlan_6 ena 1 41-48 7 orca_vlan_7 ena 1 41-48 8 orca_vlan_8 ena 1 41-48 9 orca_vlan_9 ena 1 41-48 10 orca_vlan_10 ena 1 41-48 11 orca_vlan_11 ena 1 41-48 12 orca_vlan_12 ena 1 41-48 13 orca_vlan_13 ena 1 41-48 14 orca_vlan_14 ena 1 41-48 15 orca_vlan_15 ena 1 41-48 16 orca_vlan_16 ena 1 41-48 17 orca_vlan_17 ena 1 41-48 18 orca_vlan_18 ena 1 41-48 19 orca_vlan_19 ena 1 41-48 20 orca_vlan_20 ena 1 41-48 21 orca_vlan_21 ena 1 41-48 22 orca_vlan_22 ena 1 41-48 23 orca_vlan_23 ena 1 41-48 24 orca_vlan_24 ena 1 41-48 25 orca_vlan_25 ena 1 41-48 26 orca_vlan_26 ena 1 41-48 27 orca_vlan_27 ena 1 41-48 28 orca_vlan_28 ena 1 41-48 29 orca_vlan_29 ena 1 41-48 30 orca_vlan_30 ena 1 41-48 31 orca_vlan_31 ena 1 41-48 32 orca_vlan_32 ena 1 41-48 33 orca_vlan_33 ena 1 41-48 34 orca_vlan_34 ena 1 41-48 35 orca_vlan_35 ena 1 41-48 36 orca_vlan_36 ena 1 41-48 37 orca_vlan_37 ena 1 41-48 38 orca_vlan_38 ena 1 41-48 39 orca_vlan_39 ena 1 41-48 40 orca_vlan_40 ena 1 41-48 41 orca_vlan_41 ena 1 41-48 42 orca_vlan_42 ena 1 41-48 43 orca_vlan_43 ena 1 41-48 44 orca_vlan_44 ena 1 41-48 45 orca_vlan_45 ena 1 41-48 46 orca_vlan_46 ena 1 41-48 47 orca_vlan_47 ena 1 41-48 48 orca_vlan_48 ena 1 41-48 49 orca_vlan_49 ena 1 41-48 50 orca_vlan_50 ena 1 41-48 51 orca_vlan_51 ena 1 41-48 52 orca_vlan_52 ena 1 41-48 53 orca_vlan_53 ena 1 41-48 54 orca_vlan_54 ena 1 41-48 55 orca_vlan_55 ena 1 41-48 1006 Management subnet ena 1 63 1009 ORCA iSCSI A ena 1 9 13 17 41-48 1012 Headnode iSCSI A ena 1 18 21 22 1013 Headnode iSCSI B ena 1 19 21 22 1014 ORCA iSCSI B ena 1 20 1821 VLAN 1821 ena 1 1822 VLAN 1822 ena 1 1823 VLAN 1823 ena 1 1824 VLAN 1824 ena 1 1825 VLAN 1825 ena 1 1826 VLAN 1826 ena 1 1827 VLAN 1827 ena 1 1828 VLAN 1828 ena 1 1829 VLAN 1829 ena 1 1830 VLAN 1830 ena 1 1831 VLAN 1831 ena 1 1832 VLAN 1832 ena 1 1833 VLAN 1833 ena 1 1834 VLAN 1834 ena 1 1835 VLAN 1835 ena 1 1836 VLAN 1836 ena 1 1837 VLAN 1837 ena 1 1838 VLAN 1838 ena 1 1839 VLAN 1839 ena 1 1840 VLAN 1840 ena 1 3991 orca_vlan_3991 ena 38 41-48 64 3992 orca_vlan_3992 ena 38 41-48 64 4001 VLAN 4001 ena 1 9 13 21 22 38 41-50 64 4095 Mgmt VLAN ena MGT Primary Secondary Type Ports vPorts ------- --------- --------------- --------------------- --------------------- psc-8264.psc.xo# }}} Verify FOAM and !FlowVisor configuration files ownership and paths: {{{ [lnevers@psc-hn ~]$ ls -l /etc/foam.passwd /etc/flowvisor.passwd /etc/flowvisor/fvpasswd /opt/foam/etc/foampasswd lrwxrwxrwx 1 root flowvisor 21 Nov 24 2014 /etc/flowvisor/fvpasswd -> /etc/flowvisor.passwd -r--r----- 1 flowvisor pscadmins 25 Nov 24 2014 /etc/flowvisor.passwd -r--r----- 1 root pscadmins 25 Nov 24 2014 /etc/foam.passwd lrwxrwxrwx 1 root root 16 Nov 24 2014 /opt/foam/etc/foampasswd -> /etc/foam.passwd }}} Check FOAM version and FOAM configuration for site.admin.email, geni.site-tag, email.from settings on the PSC head node: {{{ [lnevers@psc-hn ~]$ sudo foamctl admin:get-version --passwd-file=/etc/foam.passwd { "version": "0.14.0" } [lnevers@psc-hn ~]$ [lnevers@psc-hn ~]$ sudo foamctl admin:get-version --passwd-file=/etc/foam.passwd { "version": "0.14.0" } [lnevers@psc-hn ~]$ sudo foamctl config:get-value --key="site.admin.email" --passwd-file=/opt/foam/etc/foampasswd { "value": "foam-admin@gpolab.bbn.com" } [lnevers@psc-hn ~]$ sudo foamctl config:get-value --key="geni.site-tag" --passwd-file=/opt/foam/etc/foampasswd { "value": "psc-hn.exogeni.net" } [lnevers@psc-hn ~]$ sudo foamctl config:get-value --key="email.from" --passwd-file=/opt/foam/etc/foampasswd { "value": null } [lnevers@psc-hn ~]$ sudo foamctl config:get-value --key="geni.approval.approve-on-creation" --passwd-file=/opt/foam/etc/foampasswd { "value": 0 } [lnevers@psc-hn ~]$ }}} Show FOAM slivers details: {{{ [lnevers@psc-hn ~]$ sudo foamctl geni:list-slivers --passwd-file=/opt/foam/etc/foampasswd { "slivers": [] } [lnevers@psc-hn ~]$ }}} Check the !FlowVisor version, list of devices, get details for a device, list of active slices, and details for one of the slices on the PSC Head node: {{{ [lnevers@psc-hn ~]$ sudo /opt/flowvisor/bin/fvctl --passwd-file=/etc/flowvisor/fvpasswd ping hello Got reply: PONG(fvadmin): FV version=flowvisor-0.8.1::hello [lnevers@psc-hn ~]$ sudo /opt/flowvisor/bin/fvctl --passwd-file=/etc/flowvisor/fvpasswd listDevices [lnevers@psc-hn ~]$ sudo /opt/flowvisor/bin/fvctl --passwd-file=/etc/flowvisor/fvpasswd getDeviceInfo command 'getDeviceInfo' takes 1 args: only 0 given getDeviceInfo [lnevers@psc-hn ~]$ sudo /opt/flowvisor/bin/fvctl --passwd-file=/etc/flowvisor/fvpasswd listSlices Slice 0: bob Slice 1: fvadmin Slice 2: alice lnevers@psc-hn ~]$ sudo /opt/flowvisor/bin/fvctl --passwd-file=/etc/flowvisor/fvpasswd getSliceInfo fvadmin Got reply: contact_email=fvadmin@localhost controller_hostname=localhost controller_port=25838 creator=fvadmin [lnevers@psc-hn ~]$ }}} ---- {{{ #!html Email help@geni.net for GENI support or email me with feedback on this page! }}}