Changes between Version 47 and Version 48 of GENIRacksHome/InstageniRacks/AcceptanceTestStatus/IG-MON-3


Ignore:
Timestamp:
03/06/13 15:47:15 (7 years ago)
Author:
lnevers@bbn.com
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • GENIRacksHome/InstageniRacks/AcceptanceTestStatus/IG-MON-3

    v47 v48  
    953953
    954954
    955 == Step 6: get !OpenFlow state information ==
    956 
    957 '''Using:'''
    958  * On the dataplane switch, get a list of controllers, and see if any additional controllers are serving experiments.
    959  * On the flowvisor VM, get a list of active FV slices from the !FlowVisor
    960  * On the FOAM VM, get a list of active slivers from FOAM
    961  * Use FV, FOAM, or the switch to list the flowspace of a running !OpenFlow experiment.
    962 
    963 '''Verify:'''
    964  * A site administrator can get information about the !OpenFlow resources used by running experiments.
    965  * When an !OpenFlow experiment is started by InstaGENI, a new controller is added directly to the switch.
    966  * No new !FlowVisor slices are added for new !OpenFlow experiments started by InstaGENI.
    967  * No new FOAM slivers are added for new !OpenFlow experiments started by InstaGENI.
     955== Step 6. Get !OpenFlow state information ==
     956
     957As administrator verify ability to determine !OpenFlow resources in use on the dataplane switch, on the !FlowVisor VM, and on the FOAM VM.
     958
     959First, determined list of controllers on dataplane switch for the 3 experiments on this page:
     960{{{
     961$ ssh boss.instageni.gpolab.com
     962[lnevers@boss ~]$ sudo more /usr/testbed/etc/switch.pswd
     963[lnevers@boss ~]$ ssh manager@procurve2
     964
     965manager@procurve2's password:
     966
     967HP-E5406zl# show openflow version
     968
     969 Openflow Version
     970
     971  HP Networking OpenFlow Agent Version 2.02w.
     972  Based on Open vSwitch Reference Source code Version 1.0.0.
     973  Switch software Version K.15.06.5008.
     974
     975HP-E5406zl# show openflow 1750   
     976
     977 Openflow Configuration - VLAN 1750
     978
     979  Openflow state [Disabled] : Enabled   
     980  Controller pseudo-URL : tcp:10.3.1.7:6633 *                               
     981  Listener pseudo-URL :                                                   
     982  Openflow software rate limit [100] : 100   
     983  Openflow connecting max backoff [60] : 60       
     984  Openflow hardware acceleration [Enabled] : Enabled   
     985  Openflow hardware rate limit [0] : 0       
     986  Openflow hardware stats max refresh rate [0] : 0       
     987  Openflow fail-secure [Disabled] : Enabled   
     988  Second Controller pseudo-URL :                                             
     989  Third Controller pseudo-URL :                                             
     990
     991 Openflow Status - VLAN 1750
     992
     993  Switch MAC address : 84:34:97:C6:C9:00
     994  Openflow datapath ID : 06D6843497C6C900
     995  Controller connection status (1/1) : connected ; state: ACTIVE
     996  Listening connection status : listening (1 connections)
     997  SW Dpif n_flows: 1 ; cur_capacity:63 ; n_lost: 0
     998          n_hit: 99113 ; n_missed: 3359938 ; n_frags: 0
     999  Number of hardware rules: 7
     1000
     1001HP-E5406zl#
     1002}}}
     1003
     1004The results show "Controller pseudo-URL : tcp:10.3.1.7:6633", where 10.3.1.7 is the address of the !FlowVisor VM and 6633 is the !FlowVisor port''. On the !FlowVisor node, we can determine the flows and find the ones associate with our experiment:
     1005
     1006{{{
     1007lnevers@flowvisor:~$ /sbin/ifconfig eth1
     1008eth1      Link encap:Ethernet  HWaddr 00:16:3e:f0:a1:03 
     1009          inet addr:10.3.1.7  Bcast:10.3.1.255  Mask:255.255.255.0
     1010          inet6 addr: fe80::216:3eff:fef0:a103/64 Scope:Link
     1011          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
     1012          RX packets:8867080 errors:0 dropped:0 overruns:0 frame:0
     1013          TX packets:17587207 errors:0 dropped:0 overruns:0 carrier:0
     1014          collisions:0 txqueuelen:1000
     1015          RX bytes:854689692 (854.6 MB)  TX bytes:2249284361 (2.2 GB)
     1016          Interrupt:32
     1017$ fvctl --passwd-file=/etc/flowvisor.passwd listFlowSpace
     1018Got reply:
     1019rule 0: FlowEntry[dpid=[06:d6:84:34:97:c6:c9:00],ruleMatch=[OFMatch[dl_type=0x800,nw_dst=10.42.15.0/24,nw_src=10.42.15.0/24]],actionsList=[Slice:8a0abd6f-0f5a-469f-91d2-c7f990b849
     1020rule 1: FlowEntry[dpid=[06:d6:84:34:97:c6:c9:00],ruleMatch=[OFMatch[dl_type=0x806,nw_dst=10.42.15.0/24,nw_src=10.42.15.0/24]],actionsList=[Slice:8a0abd6f-0f5a-469f-91d2-c7f990b849
     1021rule 2: FlowEntry[dpid=[06:d6:84:34:97:c6:c9:00],ruleMatch=[OFMatch[dl_type=0x800,nw_dst=10.42.16.0/24,nw_src=10.42.16.0/24]],actionsList=[Slice:a92990b6-1ede-4dd7-b6f6-7b4a4bd36f
     1022rule 3: FlowEntry[dpid=[06:d6:84:34:97:c6:c9:00],ruleMatch=[OFMatch[dl_type=0x806,nw_dst=10.42.16.0/24,nw_src=10.42.16.0/24]],actionsList=[Slice:a92990b6-1ede-4dd7-b6f6-7b4a4bd36f
     1023rule 4: FlowEntry[dpid=[06:d6:84:34:97:c6:c9:00],ruleMatch=[OFMatch[dl_type=0x800,nw_dst=10.50.0.0/16,nw_src=10.50.0.0/16]],actionsList=[Slice:b7850c93-110f-4e63-a121-26f3449dac44
     1024rule 5: FlowEntry[dpid=[06:d6:84:34:97:c6:c9:00],ruleMatch=[OFMatch[dl_type=0x806,nw_dst=10.50.0.0/16,nw_src=10.50.0.0/16]],actionsList=[Slice:b7850c93-110f-4e63-a121-26f3449dac44
     1025rule 6: FlowEntry[dpid=[06:d6:84:34:97:c6:c9:00],ruleMatch=[OFMatch[dl_type=0x800,nw_dst=10.42.11.0/24,nw_src=10.42.11.0/24]],actionsList=[Slice:03f03910-1176-428b-b00f-d4d4ddaab9
     1026rule 7: FlowEntry[dpid=[06:d6:84:34:97:c6:c9:00],ruleMatch=[OFMatch[dl_type=0x806,nw_dst=10.42.11.0/24,nw_src=10.42.11.0/24]],actionsList=[Slice:03f03910-1176-428b-b00f-d4d4ddaab9
     1027rule 8: FlowEntry[dpid=[06:d6:84:34:97:c6:c9:00],ruleMatch=[OFMatch[dl_type=0x800,nw_dst=10.42.13.0/24,nw_src=10.42.13.0/24]],actionsList=[Slice:33a83d5f-4da1-4d98-8095-8b62623c26
     1028rule 9: FlowEntry[dpid=[06:d6:84:34:97:c6:c9:00],ruleMatch=[OFMatch[dl_type=0x806,nw_dst=10.42.13.0/24,nw_src=10.42.13.0/24]],actionsList=[Slice:33a83d5f-4da1-4d98-8095-8b62623c26
     1029rule 10: FlowEntry[dpid=[06:d6:84:34:97:c6:c9:00],ruleMatch=[OFMatch[dl_type=0x800,nw_dst=10.42.18.0/24,nw_src=10.42.18.0/24]],actionsList=[Slice:8070b745-84c7-47eb-8e04-63a764997
     1030rule 11: FlowEntry[dpid=[06:d6:84:34:97:c6:c9:00],ruleMatch=[OFMatch[dl_type=0x806,nw_dst=10.42.18.0/24,nw_src=10.42.18.0/24]],actionsList=[Slice:8070b745-84c7-47eb-8e04-63a764997
     1031
     1032lnevers@flowvisor:~$ fvctl --passwd-file=/etc/flowvisor.passwd listSlices
     1033Slice 0: fvadmin
     1034Slice 1: 8a0abd6f-0f5a-469f-91d2-c7f990b8494e
     1035Slice 2: a92990b6-1ede-4dd7-b6f6-7b4a4bd36fd7
     1036Slice 3: b7850c93-110f-4e63-a121-26f3449dac44
     1037Slice 4: 03f03910-1176-428b-b00f-d4d4ddaab9ab
     1038Slice 5: 33a83d5f-4da1-4d98-8095-8b62623c26b1
     1039Slice 6: 8070b745-84c7-47eb-8e04-63a764997f3a
     1040
     1041lnevers@flowvisor:~$ fvctl --passwd-file=/etc/flowvisor.passwd getSliceInfo 8070b745-84c7-47eb-8e04-63a764997f3a
     1042Got reply:
     1043drop_policy=exact
     1044connection_1=06:d6:84:34:97:c6:c9:00-->/192.1.242.135:51023-->mallorea.gpolab.bbn.com/192.1.249.185:33018
     1045contact_email=lnevers@bbn.com
     1046controller_hostname=mallorea.gpolab.bbn.com
     1047controller_port=33018
     1048creator=fvadmin
     1049
     1050}}}
     1051From the output above, the experiment IG-MON-3-OF (2 VMS with !OpenFlow) uses network 10.42.18.0, which is the the last two rules (rule 10 and rule 11) and these rules are associated
     1052with slice "Slice:8070b745-84c7-47eb-8e04-63a764997", whose details including controller are shown above.
     1053
    9681054
    9691055== Step 7: verify MAC addresses on the rack dataplane switch ==
    9701056
    971 '''Using:'''
    972  * Establish a privileged login to the dataplane switch
    973  * Obtain a list of the full MAC address table of the switch
    974  * On boss and the experimental hosts, use available data sources to determine which host or VM owns each MAC address.
    975 
    976 '''Verify:'''
    977  * It is possible to identify and classify every MAC address visible on the switch
     1057As administrator, login to dataplane switch and determine all MAC addresses for switch and determine which node owns those MAC addresses:
     1058
     1059{{{
     1060$ ssh boss.instageni.gpolab.com
     1061[lnevers@boss ~]$ sudo more /usr/testbed/etc/switch.pswd
     1062[lnevers@boss ~]$ ssh manager@procurve2
     1063
     1064HP-E5406zl# show mac-address
     1065
     1066 Status and Counters - Port Address Table
     1067
     1068  MAC Address   Port   VLAN
     1069  ------------- ------ ----
     1070  000099-989703 E20    10 
     1071  00163e-f0a103 E20    10 
     1072  10604b-9b69ce E20    10 
     1073  000c29-b07408 E24    1750
     1074  0012e2-b8a5d0 E24    1750
     1075  0026b9-7e6cc8 E24    1750
     1076  0240e5-291a6f E5     1750 
     1077  02c32c-c40467 E1     1750
     1078  02e922-fceb01 E4     1750
     1079  02fd27-710df7 E1     1750
     1080  fe163e-00627e E24    1750
     1081  000c29-90e378 E23    3705
     1082  000c29-96e3c0 E23    3705
     1083  0026b9-7e6cc8 E24    3705
     1084  78fe3d-d87e41 E24    3705
     1085 
     1086HP-E5406zl#
     1087}}}
     1088
     1089Based on earlier step, the IG-MON-3-OF MAC addressed used were:
     1090
     1091|| '''Sliver URN'''                     || '''Physical nodes'''  || '''Component and hostname'''  || '''Dataplane IPs and MACs'''||
     1092||urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+IG-MON-3-OF|| pc2  ||pcvm2-9 (gpo-ig)  ||10.42.18.43(02e922-fceb01) ||
     1093||urn:publicid:IDN+pgeni.gpolab.bbn.com+slice+IG-MON-3-OF|| pc2  ||pcvm2-10 (gpo-ig2)||10.42.18.42(0240e5-291a6f) ||
     1094
     1095So the following are the mapping for our current active experiment IG-MON-3-OF:
     1096{{{
     1097  MAC Address   Port   VLAN
     1098  ------------- ------ ----
     1099  000099-989703 E20    10 
     1100  00163e-f0a103 E20    10 
     1101  10604b-9b69ce E20    10 
     1102  000c29-b07408 E24    1750
     1103  0012e2-b8a5d0 E24    1750
     1104  0026b9-7e6cc8 E24    1750
     1105  0240e5-291a6f E5     1750 <<--pcvm2-10 (gpo-ig2)
     1106  02c32c-c40467 E1     1750
     1107  02e922-fceb01 E4     1750 <<--pcvm2-9 (gpo-ig)
     1108  02fd27-710df7 E1     1750
     1109  fe163e-00627e E24    1750
     1110  000c29-90e378 E23    3705
     1111  000c29-96e3c0 E23    3705
     1112  0026b9-7e6cc8 E24    3705
     1113  78fe3d-d87e41 E24    3705
     1114}}}
    9781115
    9791116== Step 8: verify active dataplane traffic ==
    9801117
    981 '''Using:'''
    982  * Establish a privileged login to the dataplane switch
    983  * Based on the information from Step 7, determine which interfaces are carrying traffic between the experimental VMs
    984  * Collect interface counters for those interfaces over a period of 10 minutes
    985  * Estimate the rate at which the experiment is sending traffic
    986 
    987 '''Verify:'''
    988  * The switch reports interface counters, and an administrator can obtain plausible estimates of dataplane traffic quantities by looking at them.
    989 
     1118As administrator, login to dataplane switch and based on the information from Step 7, determine which interfaces are carrying traffic between the experimental VMs, collect interface counters for those interfaces:
     1119{{{
     1120
     1121$ ssh boss.instageni.gpolab.com
     1122[lnevers@boss ~]$ sudo more /usr/testbed/etc/switch.pswd
     1123[lnevers@boss ~]$ ssh manager@procurve2
     1124
     1125HP-E5406zl# show mac-address vlan
     1126Incomplete input: vlan
     1127HP-E5406zl# show mac-address vlan  1750
     1128
     1129 Status and Counters - Address Table - VLAN 1750
     1130
     1131  MAC Address   Port 
     1132  ------------- ------
     1133  000c29-b07408 E24   
     1134  0012e2-b8a5d0 E24   
     1135  0026b9-7e6cc8 E24   
     1136  0240e5-291a6f E5  <<--pcvm2-10 (gpo-ig2) 
     1137  02c32c-c40467 E1   
     1138  02e922-fceb01 E4  <<--pcvm2-9 (gpo-ig) 
     1139  02fd27-710df7 E1   
     1140  fe163e-00627e E24
     1141
     1142HP-E5406zl# show  interfaces E5
     1143
     1144 Status and Counters - Port Counters for port E5                     
     1145
     1146  Name  :                                                                 
     1147  MAC Address      : 843497-c6d99b
     1148  Link Status      : Up 
     1149  Totals (Since boot or last clear) :                                   
     1150   Bytes Rx        : 1,347,928,360      Bytes Tx        : 2,572,312,413     
     1151   Unicast Rx      : 15,250,766         Unicast Tx      : 53,984,104       
     1152   Bcast/Mcast Rx  : 35,508             Bcast/Mcast Tx  : 772,396           
     1153  Errors (Since boot or last clear) :                                   
     1154   FCS Rx          : 0                  Drops Tx        : 746               
     1155   Alignment Rx    : 0                  Collisions Tx   : 0                 
     1156   Runts Rx        : 0                  Late Colln Tx   : 0                 
     1157   Giants Rx       : 0                  Excessive Colln : 0                 
     1158   Total Rx Errors : 0                  Deferred Tx     : 0                 
     1159  Others (Since boot or last clear) :                                   
     1160   Discard Rx      : 0                  Out Queue Len   : 0                 
     1161   Unknown Protos  : 0                 
     1162  Rates (5 minute weighted average) :
     1163   Total Rx  (bps) : 4,990,672          Total Tx  (bps) : 5,004,784
     1164   Unicast Rx (Pkts/sec) : 1            Unicast Tx (Pkts/sec) : 1         
     1165   B/Mcast Rx (Pkts/sec) : 0            B/Mcast Tx (Pkts/sec) : 2         
     1166   Utilization Rx  : 00.49 %            Utilization Tx  : 00.50 %
     1167
     1168HP-E5406zl# show  interfaces E4
     1169
     1170 Status and Counters - Port Counters for port E4                     
     1171
     1172  Name  :                                                                 
     1173  MAC Address      : 843497-c6d99c
     1174  Link Status      : Up 
     1175  Totals (Since boot or last clear) :                                   
     1176   Bytes Rx        : 2,934,314,299      Bytes Tx        : 2,000,461,763     
     1177   Unicast Rx      : 91,580,161         Unicast Tx      : 56,558,013       
     1178   Bcast/Mcast Rx  : 107,824            Bcast/Mcast Tx  : 2,925,691         
     1179  Errors (Since boot or last clear) :                                   
     1180   FCS Rx          : 0                  Drops Tx        : 0                 
     1181   Alignment Rx    : 0                  Collisions Tx   : 0                 
     1182   Runts Rx        : 0                  Late Colln Tx   : 0                 
     1183   Giants Rx       : 0                  Excessive Colln : 0                 
     1184   Total Rx Errors : 0                  Deferred Tx     : 0                 
     1185  Others (Since boot or last clear) :                                   
     1186   Discard Rx      : 0                  Out Queue Len   : 0                 
     1187   Unknown Protos  : 0                 
     1188  Rates (5 minute weighted average) :
     1189   Total Rx  (bps) : 4,990,816          Total Tx  (bps) : 5,004,792
     1190   Unicast Rx (Pkts/sec) : 1            Unicast Tx (Pkts/sec) : 1         
     1191   B/Mcast Rx (Pkts/sec) : 0            B/Mcast Tx (Pkts/sec) : 3         
     1192   Utilization Rx  : 00.49 %            Utilization Tx  : 00.50 %
     1193
     1194HP-E5406zl#   
     1195
     1196}}}