Context Navigation

← Previous Change
Wiki History
Next Change →

LoadBalancePI

Timestamp:: 05/31/17 14:17:18 (7 years ago)
Author:: Nabeel Akhtar
Comment:: --

Legend:

: Unmodified
: Added
: Removed
: Modified

GENIExperimenter/Tutorials/NFV/Pox/Execute/LoadBalancePI

                       v1
+= [wiki:GENIExperimenter/Tutorials/NFV/Execute NFV Tutorial Part II: Execute] =
+== Experiment 2:  Load Balancing using Proportional Integral (PI) Control ==
+In this experiment, we will use a control theoretic approach to do load balancing. An overview of the system is shown in below figure.
+{{{
+#!html
+<img src="http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image060.gif" hspace=50>
+ }}}
+In this control theoretic approach, the load on VNF1 and VNF2 is monitored, and flow-forwarding decisions are made based on the load information retrieved from the hosting VMs.
+We will run a [http://www.geni.net/?p=3133 RINA] distributed application to get the state (load) of the VNFs to the controller VM. Once the controller has the IDS load information, it will use the Proportional Integral (PI) load balancer to balance the load across the VNF instances based on the load information. This load balancing information is then provided to the OVS controller, which updates the OpenFlow rules on the OVS switch to balance the load.
+=== RINA Distributed Application: ===
+First we will run a RINA distributed application to collect the VNF load information on the controller node.
+{{{
+#!html
+<table id="Table_02" width = "1150" border="0" cellpadding="0" cellspacing="10" >
+ <tr>
+<td> <img src = "http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image068.gif" > </td>
+<td>  We need Java installed on the nodes to run the RINA application. Install java on <i> VNF1, VNF2 </i> and <i> controller </i> nodes (Type Ctrl-C to exit netcat). To install Java, execute: &nbsp;<span style="background:#c0c0c0; font-size: 10pt"><b>sudo apt-get install openjdk-7-jdk </b> </span> <br>
+<b>(If the install fails, you may first run: sudo apt-get update. In some cases, you may need to first run: sudo add-apt-repository ppa:openjdk-r/ppa followed by: sudo apt-get update.)</b>
+ </td></tr></table>
+}}}
+.     In the controller window, download the RINA controller code:
+{{{
+#!html
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>cd ~ <br></b> </span>
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>wget http://csr.bu.edu/rina/grw-bu2016/nfv/Control.tar.gz<br></b> </span>
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>tar -xvf Control.tar.gz<br></b> </span>
+}}}
+.     Type ''ifconfig'' to get the IP address of the controller. Save this address as we will need this address to direct the RINA processes on the VNFs to the RINA process on the controller.
+.     In a new VNF1 window, download the RINA VNF1 code:
+{{{
+#!html
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>cd ~ <br></b> </span>
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>wget http://csr.bu.edu/rina/grw-bu2016/nfv/VNF1.tar.gz<br></b> </span>
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>tar -xvf VNF1.tar.gz<br></b> </span>
+}}}
+.     In a new VNF2 window, download RINA code using following commands to get RINA VNF2 code.
+{{{
+#!html
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>cd ~ <br></b> </span>
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>wget http://csr.bu.edu/rina/grw-bu2016/nfv/VNF2.tar.gz<br></b> </span>
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>tar -xvf VNF2.tar.gz<br></b> </span>
+}}}
+.     Now we will change the IP address in the RINA configuration files for VNF1, VNF2 and controller, so these RINA processes can talk to each other.
+ In the VNF1 window, execute:
+{{{
+#!html
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>cd ~/VNF1 <br></b> </span>
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>nano ipcVNF1.properties<br></b> </span>
+}}}
+ At the bottom of the file, change the '''''rina.dns.name''''' and '''''rina.idd.name''''' to the IP address of the controller. The following screenshot shows an example.
+{{{
+#!html
+<img src="http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image064.gif" hspace=50>
+ }}}
+ In the VNF2 window, execute:
+{{{
+#!html
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>cd ~/VNF2 <br></b> </span>
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>nano ipcVNF2.properties<br></b> </span>
+}}}
+ At the bottom of the file, again change the '''''rina.dns.name''''' and '''''rina.idd.name''''' to the IP address of the controller.
+ In the controller window, execute:
+{{{
+#!html
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>cd ~/Control/RINA/  <br></b> </span>
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>nano ipcControl.properties<br></b> </span>
+}}}
+ At the bottom of the file, again change the rina.dns.name and rina.idd.name to the IP address of the controller.
+.     To run the RINA application, follow these steps (make sure you installed Java as noted above):
+  o   In the controller window, execute the following commands:
+{{{
+#!html
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>cd ~/Control/RINA/ <br></b> </span>
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>./run_controller.sh<br></b> </span>
+}}}
+  o   In the VNF1 window, execute the following commands:
+{{{
+#!html
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>cd ~/VNF1/ <br></b> </span>
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>./run_VNF1.sh<br></b> </span>
+}}}
+  o   In the VNF2 window, execute the following commands:
+{{{
+#!html
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>cd ~/VNF2/ <br></b> </span>
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>./run_VNF2.sh<br></b> </span>
+}}}
+  After waiting for sometime, you should see output on the controller window as shown below:
+{{{
+#!html
+<img src="http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image066.gif" hspace=2>
+ }}}
+{{{
+#!html
+<table id="Table_02" width = "1150" border="0" cellpadding="0" cellspacing="10" >
+ <tr>
+<td> <img src = "http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image068.gif" > </td>
+<td>  <i> The RINA application on VNF1 and VNF2 should be run as soon as possible after the RINA application on the controller  is started. If you wait for too long, you will get <b> null</b> values for CPU usage, as the controller`s RINA app is not able to subscribe to the CPU load of the VNFs. </i> If this is the case, you should restart all RINA processes. The sample output below shows a case where the controller RINA app is not able to subscribe to the CPU load of VNF2 .
+ </td></tr></table>
+}}}
+{{{
+#!html
+<img src="http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image070.gif" hspace=2>
+ }}}
+{{{
+#!html
+<table id="Table_02" width = "650" border="0" cellpadding="0" cellspacing="10" >
+ <tr>
+<td> <img src = "http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image022.gif" > </td>
+<td>  <i> To stop all RINA processes running on a VM, run <b> killall -v java </b> </i>
+ </td></tr></table>
+}}}
+[[BR]][[BR]] [[BR]]
+'''PI controller'''
+ The PI-controller gets the load information of VNF1 and VNF2 using RINA`s distributed application and makes the load balancing decision.
+ Below figure shows the block diagram of the Proportional Integral (PI) controlled NFV system.
+{{{
+#!html
+<table id="Table_02" width = "1150" border="0" cellpadding="0" cellspacing="0" align="center" >
+<tr>
+<td><img src="http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image074.gif" hspace=2/></td></tr>
+<tr><td> <i style="font-size:9px">Block diagram of the PI-controller NFV system. System load L and target load T(s)=T/s of VNF1 is used to compute X, i.e. ratio of traffic diverted to VNF2. K` = K/T.</i></td></tr>
+</table>
+ }}}
+ The RINA-based distributed monitoring application provides the VNF1 state (average CPU load) information L(t) to the PI controller. The maximum capacity of a VNF instance is T. If the load on VNF1 exceeds T, new traffic flows are forwarded to a second VNF instance, VNF2. Assuming instantaneous feedback / measured load L(t), the PI control equation is given by:
+{{{
+#!html
+<img src="http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image076.gif" hspace=70>
+ }}}
+ The code for the PI controller is based on following algorithm. Input ''IDS,,load,,.txt'' is the file generated by the RINA distributed application. This file has load information of the VNFs.
+{{{
+#!html
+<img src="http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image078.gif" hspace=40>
+ }}}
+.     To run the PI-controller, open a new controller window and execute:
+{{{
+#!html
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>cd ~/Control/PI_controller <br></b> </span>
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>python PI_controller.py ~/Control/RINA/NFV1.txt<br></b> </span>
+}}}
+ Note that here we are directing ''PI_controller.py'' to the ''NFV1.txt'' file that is constantly updated by the RINA distributed application with the load information of VNFs.
+.     You should see the VNF state information printed on the screen. A sample output is shown below.
+{{{
+#!html
+<img src="http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image080.gif" hspace=40>
+ }}}
+ Here the target load on VNF1 is 30.0% of CPU usage, i.e. if the CPU load on VNF1 is more than 30.0%, traffic flows will be diverted to VNF2. The `current CPU load` shows the load on VNF1. The next line of the output shows the percentage of flows that will be directed to VNF2 and the last line shows the flows that were being directed to VNF2 before the current control update.
+ '''Do not close this window; leave the PI controller running.'''
+'''PI-based OVS controller:'''
+ Now we will run the OVS controller that will get the load balancing decision from the PI-controller and direct the flows accordingly.
+.     First we will update the ''port.config'' file to direct the controller to the ''NFV_ratio_PI.txt'' file generated by the PI-controller, which has the load balancing decision information. In a new controller window, execute:
+{{{
+#!html
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>cd /tmp/pox/ext <br></b> </span>
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>nano port.config<br></b> </span>
+}}}
+   o   Change the value of '''controller_type''' to '''PI''' [[BR]]
+   o   Change the value of '''''file_path_pi''''' to the text file that has the PI controller`s  output.[[BR]]
+    '''''/users/<!UserName>/Control/PI_controller/NFV_ratio_PI.txt'''''[[BR]]
+    Change the '''''<!UserName>''''' to your user name.[[BR]]
+  Sample values are shown below.
+{{{
+#!html
+<img src="http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image082.gif" hspace=40>
+ }}}
+.     Now we can run the OVS controller. Execute
+{{{
+#!html
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b> cd /tmp/pox <br></b> </span>
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b>python pox.py --verbose NFV_controller<br></b> </span>
+}}}
+ ''' Run Snort and Generate Traffic: '''
+.     First we will run Snort IDS on VNF1 and VNF2. In separate windows for VNF1 and VNF2, execute the following command:
+{{{
+#!html
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b> sudo /usr/local/bin/snort -A console -v -c / -i eth1<br></b> </span>
+}}}
+ You should see the window as shown below in the ''VNF1'' and ''VNF2'' windows:
+{{{
+#!html
+<img src="http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image084.gif" hspace=40>
+ }}}
+.     We will use the iperf application to generate flows between a source and destination. If iperf is not installed on your nodes, execute:
+{{{
+#!html
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b> sudo apt-get install iperf<br></b> </span>
+}}}
+.     Run iperf server on the destination node:
+{{{
+#!html
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b> iperf -u -s <br></b> </span>
+}}}
+.     Now we will generate traffic from the sources (s1 and s2) to the destination node using ''iperf'' and see how it effects the CPU utilization at VNF1 and VNF2 running Snort IDS. Note that if we run multiple instances of ''iperf'', we can generate significant load on the VNF instances. To run ''iperf'' client on a source, execute:
+{{{
+#!html
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b> iperf -u -c destination -t 500 & <br></b> </span>
+}}}
+{{{
+#!html
+<table id="Table_02" width = "1150" border="0" cellpadding="0" cellspacing="10" >
+ <tr>
+<td> <img src = "http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image068.gif" > </td>
+<td>  <i>Note that you can run multiple instances of iperf by running <span style="background:#c0c0c0"> iperf -c destination -t 500 & </span> multiple time in s1 and s2 nodes. This flow lasts for 500 seconds. To kill all the flows generated at a node, run <span style="background:#c0c0c0"> killall –v iperf </span> </i>
+ </td></tr></table>
+}}}
+.     Now if you look at the controller window, which is running the PI-controller, you can see the load on VNF1 has significantly increased. If the load is more than 30%, some percentage of the traffic flows will be diverted to VNF2. A sample output is shown below:
+{{{
+#!html
+<img src="http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image088.gif" hspace=40>
+ }}}
+{{{
+#!html
+<table id="Table_02" width = "500" border="0" cellpadding="0" cellspacing="10" >
+ <tr>
+<td> <img src = "http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image022.gif" > </td>
+<td>   <b> OPTIONAL: Review the PI Controller Code: </b>
+ </td></tr></table>
+}}}
+{{{
+#!html
+<table id="Table_02" width = "1150" border="0" cellpadding="0" cellspacing="10" >
+ <tr>
+<td> <img src = "http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image068.gif" > </td>
+<td>  <i>Optional: Code Review: The OVS controller gets the load balancing information from the output text file generated by the PI-controller. Based on the  value of the control variable  (variable X), it sends each new flow to either VNF1 or VNF2. The algorithm for the PI-based OVS controller is shown below: </i>
+ </td></tr></table>
+}}}
+{{{
+#!html
+<img src="http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image092.gif" hspace=40>
+ }}}
+''The corresponding code can be found in  '''/tmp/pox/ext/NFV_controller.py''' as shown below:''
+{{{
+#!html
+<img src="http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image094.gif" hspace=40>
+ }}}
+''' Real Time Graphs: '''
+On any Linux machine (including MAC OS), you can draw real-time CPU usage graphs for both VNF1 and VNF2 nodes. A Python script is provided to produce these real-time graphs. The script periodically retrieves the CPU usage file from the Controller node and plots the graph for it.
+.     Download the python script ''!RealTimeGraph.py'' to your laptop using the following link.
+{{{
+#!html
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b> http://csr.bu.edu/rina/grw-bu2016/nfv/RealTimeGraph.py <br></b> </span>
+}}}
+.     Run the script and direct it to the CPU usage files (''NFV1.txt'' and ''NFV2.txt'') present at the controller. To run the Python script, type the following in the folder where you saved the ''!RealTimeGraph.py'' file:
+{{{
+#!html
+    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<span style="background:#c0c0c0; font-size: 9pt"><b> python RealTimeGraph.py -n &lt;username&gt;@&lt;controller IP address&gt -k &lt;Path to your ssh key&gt;   ; <br></b> </span>
+}}}
+ Change '''''<username>''''' to your user name,  '''''<controller IP address>''''' to the IP address of the controller and '''''<Path to your ssh key>''''' is the path to your ssh key that you use to log into GENI nodes.
+.     You should see real-time CPU graphs as shown below:
+{{{
+#!html
+<img src="http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image096.gif" hspace=40>
+ }}}
+{{{
+#!html
+<table id="Table_02" width = "1150" border="0" cellpadding="0" cellspacing="10" >
+ <tr>
+<td> <img src = "http://csr.bu.edu/rina/grw-bu2016/tutorial_files/image068.gif" > </td>
+<td>  <i>To run the Python script to plot graphs, you need the python plotting library <b>matplotlib</b>. If you do not have this library on your laptop, you can use the following link to download it to your computer: <a href = "http://matplotlib.org/users/installing.html">http://matplotlib.org/users/installing.html</a>  </i>
+ </td></tr></table>
+}}}
+'''[wiki:GENIExperimenter/Tutorials/NFV/Execute Back to Part II: Execute]'''[[BR]]
+== [wiki:GENIExperimenter/Tutorials/NFV/Finish Next: Finish] ==
+----
+Author: Nabeel Akhtar
+Supervised by: Ibrahim Matta
+Boston University