Expertiza_Wiki - User contributions [en]

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T19:54:06Z

Psinaik: /* Future Scope */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Set up a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the Ubuntu to the specified version.

3. Clone Expertiza from Github.

4. Install packages for Java, Ruby and all the ruby dependencies.

5. Bundle install for installing all the gems in Gemfile.

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref>, configure it and migrate databases.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Make changes in the nginx configuration.

9. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

10. Configure Unicorn and integrate it to work with nginx.

11. Start both Unicorn and Nginx server.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than one unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Expertiza Deployment==

1. We first created a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We recorded the IP address of the newly created droplet and created the associated <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:New_ip.png]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. We then run the bash command in following format<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

This command will run the knife tool that will set up Chef-solo on the node and will execute the recipes.
This needs to be run from the directory where '''setup_vps.sh''' is present.

[[File:New setup vps.png]]

4. '''default.rb''' : This recipe will update the Ubuntu machine packages, install the list of prerequisite packages and set the time zone.

[[File:New default.png]]

5. '''expertiza_clone''' : This recipe will create a directory and clone the Expertiza git source code into that directory.

[[File:New expertiza clone.png ]]

6. '''set_java_home''': This recipe will set the Java configuration. It will then bundle install all the gems used by the Expertiza.

[[File:New_set_java.png]]

7. '''mysql.rb''' : This recipe will install the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:New sql.png]]

8. '''database.rb''' : This recipe will execute scrubbed.sql on MySQL, which in turn will create all the Schema for production, development and test environments. It will also populate the database tables with seed (configuration) data.

[[File:New database.png]]

9. '''nginx.rb''' : This recipe will install nginx which is a web proxy server that will listen on user defined port and redirect the requests for static content(images, css, javascript) to the public folder of the Expertiza rails app.

[[File:New_nginx.png ]]

10. '''unicorn_conf.rb''' : This recipe will install and configure Unicorn web server used in production environment to handle requests for dynamic content passed on by the Nginx server.

[[File:New_unicorn_corn.png]]

11. '''start_server.rb''' : This will restart all the installed services, after which Expertiza can start taking requests.

[[File:New start server1.png]]

==Github link==
https://github.com/amurark/knife-solo/

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==Future Scope==

The cookbook has been created with the assumption of root user as the administer.For security purposes deployment should be done with another user with sudo privileges, and then root login disabled. Also a new user for MySQL with full database privileges needs to be created. But that hasn't been achieved automatically in the resent cookbook. Further, Unicorn configuration is done with a single Unicorn server in mind. It has to be configured for multiple servers for load balancing in events of heavy traffic.
Currently, we are manually creating the digitalOcean droplet which is the remote server where expertiza is deployed. In future, this can be automated using a plugin provided by vagrant for digital ocean.

==References==
<references></references>

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T19:48:13Z

Psinaik: /* Github link */

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T18:33:00Z

Psinaik: /* Sample Chef-Solo Recipe Example */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the Ubuntu to the specified version.

3. Clone Expertiza from Github.

4. Install packages for Java, Ruby and all the ruby dependencies.

5. Bundle install for installing all the gems in Gemfile.

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref>, configure it and migrate databases.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Make changes in the nginx configuration.

9. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

10. Configure Unicorn and integrate it to work with nginx.

11. Start both Unicorn and Nginx server.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than one unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Expertiza Deployment==

1. We first created a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We recorded the IP address of the newly created droplet and created the associated <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:New_ip.png]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. We then run the bash command in following format<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

This command will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be run from the directory where '''setup_vps.sh''' is present.

[[File:New setup vps.png]]

4. '''default.rb''' : This recipe will update the Ubuntu machine packages, install the list of prerequisite packages and set the time zone.

[[File:New default.png]]

5. '''expertiza_clone''' : This recipe will create a directory and clone the Expertiza git source code into that directory.

[[File:New expertiza clone.png ]]

6. '''set_java_home''': This recipe will set the Java configuration. It will then bundle install all the gems used by the Expertiza.

[[File:New_set_java.png]]

7. '''mysql.rb''' : This recipe will install the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:New sql.png]]

8. '''database.rb''' : This recipe will execute scrubbed.sql on MySQL, which in turn will create all the Schema for production, development and test environments. It will also populate the database tables with seed (configuration) data.

[[File:New database.png]]

9. '''nginx.rb''' : This recipe will install nginx which is a web proxy server that will listen on user defined port and redirect the requests for static content(images, css, javascript) to the public folder of the Expertiza rails app.

[[File:New_nginx.png ]]

10. '''unicorn_conf.rb''' : This recipe will install and configure Unicorn web server used in production environment to handle requests for dynamic content passed on by the Nginx server.

[[File:New_unicorn_corn.png]]

11. '''start_server.rb''' : This will restart all the installed services, after which Expertiza can start taking requests.

[[File:New start server1.png]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==Future Scope==

The cookbook has been created with the assumption of root user as the administer.For security purposes deployment should be done with another user with sudo privileges, and then root login disabled. Also a new user for MySQL with full database privileges needs to be created. But that hasn't been achieved automatically in the resent cookbook. Further, Unicorn configuration is done with a single Unicorn server in mind. It has to be configured for multiple servers for load balancing in events of heavy traffic.

==References==
<references></references>

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T18:32:01Z

Psinaik: /* Sample Chef-Solo Recipe Example */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the Ubuntu to the specified version.

3. Clone Expertiza from Github.

4. Install packages for Java, Ruby and all the ruby dependencies.

5. Bundle install for installing all the gems in Gemfile.

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref>, configure it and migrate databases.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Make changes in the nginx configuration.

9. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

10. Configure Unicorn and integrate it to work with nginx.

11. Start both Unicorn and Nginx server.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than one unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Sample Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:

package "git-core" #apt-get install git-core
user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first created a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We recorded the IP address of the newly created droplet and created the associated <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:New_ip.png]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. We then run the bash command in following format<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

This command will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be run from the directory where '''setup_vps.sh''' is present.

[[File:New setup vps.png]]

4. '''default.rb''' : This recipe will update the Ubuntu machine packages, install the list of prerequisite packages and set the time zone.

[[File:New default.png]]

5. '''expertiza_clone''' : This recipe will create a directory and clone the Expertiza git source code into that directory.

[[File:New expertiza clone.png ]]

6. '''set_java_home''': This recipe will set the Java configuration. It will then bundle install all the gems used by the Expertiza.

[[File:New_set_java.png]]

7. '''mysql.rb''' : This recipe will install the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:New sql.png]]

8. '''database.rb''' : This recipe will execute scrubbed.sql on MySQL, which in turn will create all the Schema for production, development and test environments. It will also populate the database tables with seed (configuration) data.

[[File:New database.png]]

9. '''nginx.rb''' : This recipe will install nginx which is a web proxy server that will listen on user defined port and redirect the requests for static content(images, css, javascript) to the public folder of the Expertiza rails app.

[[File:New_nginx.png ]]

10. '''unicorn_conf.rb''' : This recipe will install and configure Unicorn web server used in production environment to handle requests for dynamic content passed on by the Nginx server.

[[File:New_unicorn_corn.png]]

11. '''start_server.rb''' : This will restart all the installed services, after which Expertiza can start taking requests.

[[File:New start server1.png]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==Future Scope==

The cookbook has been created with the assumption of root user as the administer.For security purposes deployment should be done with another user with sudo privileges, and then root login disabled. Also a new user for MySQL with full database privileges needs to be created. But that hasn't been achieved automatically in the resent cookbook. Further, Unicorn configuration is done with a single Unicorn server in mind. It has to be configured for multiple servers for load balancing in events of heavy traffic.

==References==
<references></references>

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T18:31:36Z

Psinaik: /* Chef-Solo Recipe Example */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the Ubuntu to the specified version.

3. Clone Expertiza from Github.

4. Install packages for Java, Ruby and all the ruby dependencies.

5. Bundle install for installing all the gems in Gemfile.

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref>, configure it and migrate databases.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Make changes in the nginx configuration.

9. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

10. Configure Unicorn and integrate it to work with nginx.

11. Start both Unicorn and Nginx server.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than one unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Sample Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first created a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We recorded the IP address of the newly created droplet and created the associated <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:New_ip.png]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. We then run the bash command in following format<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

This command will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be run from the directory where '''setup_vps.sh''' is present.

[[File:New setup vps.png]]

4. '''default.rb''' : This recipe will update the Ubuntu machine packages, install the list of prerequisite packages and set the time zone.

[[File:New default.png]]

5. '''expertiza_clone''' : This recipe will create a directory and clone the Expertiza git source code into that directory.

[[File:New expertiza clone.png ]]

6. '''set_java_home''': This recipe will set the Java configuration. It will then bundle install all the gems used by the Expertiza.

[[File:New_set_java.png]]

7. '''mysql.rb''' : This recipe will install the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:New sql.png]]

8. '''database.rb''' : This recipe will execute scrubbed.sql on MySQL, which in turn will create all the Schema for production, development and test environments. It will also populate the database tables with seed (configuration) data.

[[File:New database.png]]

9. '''nginx.rb''' : This recipe will install nginx which is a web proxy server that will listen on user defined port and redirect the requests for static content(images, css, javascript) to the public folder of the Expertiza rails app.

[[File:New_nginx.png ]]

10. '''unicorn_conf.rb''' : This recipe will install and configure Unicorn web server used in production environment to handle requests for dynamic content passed on by the Nginx server.

[[File:New_unicorn_corn.png]]

11. '''start_server.rb''' : This will restart all the installed services, after which Expertiza can start taking requests.

[[File:New start server1.png]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==Future Scope==

The cookbook has been created with the assumption of root user as the administer.For security purposes deployment should be done with another user with sudo privileges, and then root login disabled. Also a new user for MySQL with full database privileges needs to be created. But that hasn't been achieved automatically in the resent cookbook. Further, Unicorn configuration is done with a single Unicorn server in mind. It has to be configured for multiple servers for load balancing in events of heavy traffic.

==References==
<references></references>

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T18:28:26Z

Psinaik: /* Expertiza Deployment */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the Ubuntu to the specified version.

3. Clone Expertiza from Github.

4. Install packages for Java, Ruby and all the ruby dependencies.

5. Bundle install for installing all the gems in Gemfile.

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref>, configure it and migrate databases.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Make changes in the nginx configuration.

9. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

10. Configure Unicorn and integrate it to work with nginx.

11. Start both Unicorn and Nginx server.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than one unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first created a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We recorded the IP address of the newly created droplet and created the associated <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:New_ip.png]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. We then run the bash command in following format<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

This command will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be run from the directory where '''setup_vps.sh''' is present.

[[File:New setup vps.png]]

4. '''default.rb''' : This recipe will update the Ubuntu machine packages, install the list of prerequisite packages and set the time zone.

[[File:New default.png]]

5. '''expertiza_clone''' : This recipe will create a directory and clone the Expertiza git source code into that directory.

[[File:New expertiza clone.png ]]

6. '''set_java_home''': This recipe will set the Java configuration. It will then bundle install all the gems used by the Expertiza.

[[File:New_set_java.png]]

7. '''mysql.rb''' : This recipe will install the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:New sql.png]]

8. '''database.rb''' : This recipe will execute scrubbed.sql on MySQL, which in turn will create all the Schema for production, development and test environments. It will also populate the database tables with seed (configuration) data.

[[File:New database.png]]

9. '''nginx.rb''' : This recipe will install nginx which is a web proxy server that will listen on user defined port and redirect the requests for static content(images, css, javascript) to the public folder of the Expertiza rails app.

[[File:New_nginx.png ]]

10. '''unicorn_conf.rb''' : This recipe will install and configure Unicorn web server used in production environment to handle requests for dynamic content passed on by the Nginx server.

[[File:New_unicorn_corn.png]]

11. '''start_server.rb''' : This will restart all the installed services, after which Expertiza can start taking requests.

[[File:New start server1.png]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==Future Scope==

The cookbook has been created with the assumption of root user as the administer.For security purposes deployment should be done with another user with sudo privileges, and then root login disabled. Also a new user for MySQL with full database privileges needs to be created. But that hasn't been achieved automatically in the resent cookbook. Further, Unicorn configuration is done with a single Unicorn server in mind. It has to be configured for multiple servers for load balancing in events of heavy traffic.

==References==
<references></references>

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T18:27:17Z

Psinaik: /* Expertiza Deployment */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the Ubuntu to the specified version.

3. Clone Expertiza from Github.

4. Install packages for Java, Ruby and all the ruby dependencies.

5. Bundle install for installing all the gems in Gemfile.

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref>, configure it and migrate databases.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Make changes in the nginx configuration.

9. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

10. Configure Unicorn and integrate it to work with nginx.

11. Start both Unicorn and Nginx server.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than one unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first created a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We recorded the IP address of the newly created droplet and created the associated <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:New_ip.png]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. We then run the bash command in following format<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

This command will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be run from the directory where '''setup_vps.sh''' is present.

[[File:New setup vps.png]]

4. '''default.rb''' : This recipe will update the Ubuntu machine packages, install the list of prerequisite packages and set the time zone.

[[File:New default.png]]

5. '''expertiza_clone''' : This recipe will create a directory and clone the Expertiza git source code into that directory.

[[File:New expertiza clone.png ]]

6. '''set_java_home''': This recipe will set the Java configuration. It will then bundle install all the gems used by the Expertiza.

[[File:New_set_java.png]]

7. '''mysql.rb''' : This recipe will install the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:New sql.png]]

8. '''database.rb''' : This recipe will execute scrubbed.sql on MySQL, which in turn will create all the Schema for production, development and test environments. It will also populate the database tables with seed (configuration) data.

[[File:New database.png]]

9. '''nginx.rb''' : This recipe will install nginx which is a web proxy server that will listen on user defined port and redirect the requests for static content(images, css, javascript) to the public folder of the Expertiza rails app.

[[File:New_nginx.png ]]

10. '''unicorn_conf.rb''' : This recipe will install and configure Unicorn web server used in production environment to handle requests for dynamic content passed on by the Nginx server.

[[File:New_unicorn_corn.png]]

11. '''start_server.rb''' : This will restart all the installed services, after which Expertiza can start taking requests.

[[File:New start server1.png]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==Future Scope==

The cookbook has been created with the assumption of root user as the administer.For security purposes deployment should be done with another user with sudo privileges, and then root login disabled. Also a new user for MySQL with full database privileges needs to be created. But that hasn't been achieved automatically in the resent cookbook. Further, Unicorn configuration is done with a single Unicorn server in mind. It has to be configured for multiple servers for load balancing in events of heavy traffic.

==References==
<references></references>

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T18:20:46Z

Psinaik: /* Expertiza Deployment */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the Ubuntu to the specified version.

3. Clone Expertiza from Github.

4. Install packages for Java, Ruby and all the ruby dependencies.

5. Bundle install for installing all the gems in Gemfile.

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref>, configure it and migrate databases.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Make changes in the nginx configuration.

9. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

10. Configure Unicorn and integrate it to work with nginx.

11. Start both Unicorn and Nginx server.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than one unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first created a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We recorded the IP address of the newly created droplet and created the associated <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:New_ip.png]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. We then run the bash command in following format<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

This command will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be run from the directory where '''setup_vps.sh''' is present.

[[File:New setup vps.png]]

4. '''default.rb''' : This recipe will update the Ubuntu machine packages, install the list of prerequisite packages and set the time zone.

[[File:New default.png]]

5. '''expertiza_clone''' : This recipe will create a directory and clone the Expertiza git source code into that directory.

[[File:New expertiza clone.png ]]

6. '''set_java_home''': This recipe will set the Java configuration. It will then bundle install all the gems used by the Expertiza.

[[File:New_set_java.png]]

7. '''mysql.rb''' : This recipe will install the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:New sql.png]]

8. '''database.rb''' : This recipe will execute scrubbed.sql on MySQL, which in turn will create all the Schema for production, development and test environments. It will also populate the database tables with seed (configuration) data.

[[File:New database.png]]

9. '''nginx.rb''' : This recipe will install nginx which is a web proxy server that will listen on user defined port and redirect the requests for static content(images, css, javascript) to the public folder of the Expertiza rails app.

[[File:New_nginx.png ]]

10. '''unicorn_conf.rb''' : This recipe will install and configure Unicorn web server used in production environment to handle requests for dynamic content passed on by the Nginx server.

[[File:New_unicorn_corn.png]]

11. '''start_server.rb''' : This will restart all the installed services, after which Expertiza can start taking requests.

[[File:New start server1.png]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==Future Scope==

The cookbook has been created with the assumption of root user as the administer.For security purposes deployment should be done with another user with sudo privileges, and then root login disabled. Also a new user for MySQL with full database privileges needs to be created. But that hasn't been achieved automatically in the resent cookbook. Further, Unicorn configuration is done with a single Unicorn server in mind. It has to be configured for multiple servers for load balancing in events of heavy traffic.

==References==
<references></references>

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T18:18:10Z

Psinaik: /* Chef-Solo Recipe Example */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the Ubuntu to the specified version.

3. Clone Expertiza from Github.

4. Install packages for Java, Ruby and all the ruby dependencies.

5. Bundle install for installing all the gems in Gemfile.

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref>, configure it and migrate databases.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Make changes in the nginx configuration.

9. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

10. Configure Unicorn and integrate it to work with nginx.

11. Start both Unicorn and Nginx server.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than one unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first created a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We recorded the IP address of the newly created droplet and created the associated <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:New_ip.png]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. We then run the bash command in following format<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

This command will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be run from the directory where '''setup_vps.sh''' is present.

[[File:New setup vps.png]]

4. '''default.rb''' : This recipe will update the Ubuntu machine packages, install the list of prerequisite packages and set the time zone.

[[File:New default.png]]

5. '''expertiza_clone''' : This recipe will create a directory and clone the Expertiza git source code into that directory.

[[File:New expertiza clone.png ]]

6. '''set_java_home''': This recipe will set the Java configuration. It will then bundle instal all the gems used by the Expertiza.

[[File:New_set_java.png]]

7. '''mysql.rb''' : This recipe will install the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:New sql.png]]

8. '''database.rb''' : This recipe will execute scrubbed.sql on MySQL, which in turn will create all the Schema for production, development and test environments. It will also populate the database tables with seed (configuration) data.

[[File:New database.png]]

9. '''nginx.rb''' : This recipe will install nginx which is a web proxy server that will listen on user defined port and redirect the requests for static content(images, css, javascript) to the public folder of Expertiza rails app.

[[File:New_nginx.png ]]

10. '''unicorn_conf.rb''' : This recipe will install and configure Unicorn web server used in production environment to handle requests for dynamic content passed on by the Nginx server.

[[File:New_unicorn_corn.png]]

11. '''start_server.rb''' : This will restart all the installed services, after which Expertiza can start taking requests.

[[File:New start server1.png]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==Future Scope==

The cookbook has been created with the assumption of root user as the administer.For security purposes deployment should be done with another user with sudo privileges, and then root login disabled. Also a new user for MySQL with full database privileges needs to be created. But that hasn't been achieved automatically in the resent cookbook. Further, Unicorn configuration is done with a single Unicorn server in mind. It has to be configured for multiple servers for load balancing in events of heavy traffic.

==References==
<references></references>

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T18:12:04Z

Psinaik: /* Expertiza Deployment */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the Ubuntu to the specified version.

3. Clone Expertiza from Github.

4. Install packages for Java, Ruby and all the ruby dependencies.

5. Bundle install for installing all the gems in Gemfile.

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref>, configure it and migrate databases.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Make changes in the nginx configuration.

9. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

10. Configure Unicorn and integrate it to work with nginx.

11. Start both Unicorn and Nginx server.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than one unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, RMV, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first created a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We recorded the IP address of the newly created droplet and created the associated <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:New_ip.png]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. We then run the bash command in following format<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

This command will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be run from the directory where '''setup_vps.sh''' is present.

[[File:New setup vps.png]]

4. '''default.rb''' : This recipe will update the Ubuntu machine packages, install the list of prerequisite packages and set the time zone.

[[File:New default.png]]

5. '''expertiza_clone''' : This recipe will create a directory and clone the Expertiza git source code into that directory.

[[File:New expertiza clone.png ]]

6. '''set_java_home''': This recipe will set the Java configuration. It will then bundle instal all the gems used by the Expertiza.

[[File:New_set_java.png]]

7. '''mysql.rb''' : This recipe will install the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:New sql.png]]

8. '''database.rb''' : This recipe will execute scrubbed.sql on MySQL, which in turn will create all the Schema for production, development and test environments. It will also populate the database tables with seed (configuration) data.

[[File:New database.png]]

9. '''nginx.rb''' : This recipe will install nginx which is a web proxy server that will listen on user defined port and redirect the requests for static content(images, css, javascript) to the public folder of Expertiza rails app.

[[File:New_nginx.png ]]

10. '''unicorn_conf.rb''' : This recipe will install and configure Unicorn web server used in production environment to handle high traffic and achieve load balancing . All the requests for dynamic content will go through it.

[[File:New_unicorn_corn.png]]

11. '''start_server.rb''' : This will restart all the installed services, after which Expertiza can start taking requests.

[[File:New start server1.png]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==Future Scope==

The cookbook has been created with the assumption of root user as the administer.For security purposes deployment should be done with another user with sudo privileges, and then root login disabled. Also a new user for MySQL with full database privileges needs to be created. But that hasn't been achieved automatically in the resent cookbook. Further, Unicorn configuration is done with a single Unicorn server in mind. It has to be configured for multiple servers for load balancing in events of heavy traffic.

==References==
<references></references>

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T18:10:47Z

Psinaik: /* Expertiza Stack */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the Ubuntu to the specified version.

3. Clone Expertiza from Github.

4. Install packages for Java, Ruby and all the ruby dependencies.

5. Bundle install for installing all the gems in Gemfile.

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref>, configure it and migrate databases.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Make changes in the nginx configuration.

9. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

10. Configure Unicorn and integrate it to work with nginx.

11. Start both Unicorn and Nginx server.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than one unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, RMV, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first created a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We recorded the IP address of the newly created droplet and created the associated <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:New_ip.png]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. We then run the bash command in following format<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

This command will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be run from the directory where '''setup_vps.sh''' is present.

[[File:New setup vps.png]]

4. '''default.rb''' : This recipe will update the Ubuntu machine packages, install the list of prerequisite packages and set the time zone.

[[File:New default.png]]

5. '''expertiza_clone''' : This recipe will create a directory and clone the Expertiza git source code into that directory.

[[File:New expertiza clone.png ]]

6. '''set_java_home''': This recipe will set the Java configuration. It will then bundle instal all the gems used by the Expertiza.

[[File:New_set_java.png]]

7. '''mysql.rb''' : This recipe will install the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:New sql.png]]

8. '''database.rb''' : This recipe will execute scrubbed.sql on MySQL, which in turn will create all the Schema for production, development and test environments. It will also populate the database tables with seed (configuration) data.

[[File:New database.png]]

9. '''nginx.rb''' : This recipe will install nginx which is a web proxy server that will listen on user defined port and redirect the requests for static content(images, css, javascript) to the public folder of Expertiza rails app.

[[File:New_nginx.png ]]

10. '''unicorn_conf.rb''' : This recipe will install and configure Unicorn web server used in production environment to handle high traffic and achieve load balancing . All the requests for dynamic content will go through it.

[[File:New_unicorn_corn.png]]

11. '''start_server.rb''' : This will restart all the installed services, after which Expertiza can start taking requests.

[[File:New start server1.png]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==Future Scope==

The cookbook has been created with the assumption of root user as the administer.For security purposes deployment should be done with another user with sudo privileges, and then root login disabled. Also a new user for MySQL with full database privileges needs to be created. But that hasn't been achieved automatically in the resent cookbook. Further, Unicorn configuration is done with a single Unicorn server in mind. It has to be configured for multiple servers for load balancing in events of heavy traffic.

==References==
<references></references>

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T18:05:55Z

Psinaik: /* Expertiza Deployment */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the Ubuntu to the specified version.

3. Clone Expertiza from Github.

4. Install packages for Java, Ruby and all the ruby dependencies.

5. Bundle install for installing all the gems in Gemfile.

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref>, configure it and migrate databases.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Make changes in the nginx configuration.

9. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

10. Configure Unicorn and integrate it to work with nginx.

11. Start both Unicorn and Nginx server.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than 1 unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, RMV, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first created a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We recorded the IP address of the newly created droplet and created the associated <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:New_ip.png]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. We then run the bash command in following format<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

This command will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be run from the directory where '''setup_vps.sh''' is present.

[[File:New setup vps.png]]

4. '''default.rb''' : This recipe will update the Ubuntu machine packages, install the list of prerequisite packages and set the time zone.

[[File:New default.png]]

5. '''expertiza_clone''' : This recipe will create a directory and clone the Expertiza git source code into that directory.

[[File:New expertiza clone.png ]]

6. '''set_java_home''': This recipe will set the Java configuration. It will then bundle instal all the gems used by the Expertiza.

[[File:New_set_java.png]]

7. '''mysql.rb''' : This recipe will install the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:New sql.png]]

8. '''database.rb''' : This recipe will execute scrubbed.sql on MySQL, which in turn will create all the Schema for production, development and test environments. It will also populate the database tables with seed (configuration) data.

[[File:New database.png]]

9. '''nginx.rb''' : This recipe will install nginx which is a web proxy server that will listen on user defined port and redirect the requests for static content(images, css, javascript) to the public folder of Expertiza rails app.

[[File:New_nginx.png ]]

10. '''unicorn_conf.rb''' : This recipe will install and configure Unicorn web server used in production environment to handle high traffic and achieve load balancing . All the requests for dynamic content will go through it.

[[File:New_unicorn_corn.png]]

11. '''start_server.rb''' : This will restart all the installed services, after which Expertiza can start taking requests.

[[File:New start server1.png]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==Future Scope==

The cookbook has been created with the assumption of root user as the administer.For security purposes deployment should be done with another user with sudo privileges, and then root login disabled. Also a new user for MySQL with full database privileges needs to be created. But that hasn't been achieved automatically in the resent cookbook. Further, Unicorn configuration is done with a single Unicorn server in mind. It has to be configured for multiple servers for load balancing in events of heavy traffic.

==References==
<references></references>

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T17:54:11Z

Psinaik: /* Expertiza Deployment */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the Ubuntu to the specified version.

3. Clone Expertiza from Github.

4. Install packages for Java, Ruby and all the ruby dependencies.

5. Bundle install for installing all the gems in Gemfile.

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref>, configure it and migrate databases.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Make changes in the nginx configuration.

9. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

10. Configure Unicorn and integrate it to work with nginx.

11. Start both Unicorn and Nginx server.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than 1 unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, RMV, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first created a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We recorded the IP address of the newly created droplet and created the associated <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:New_ip.png]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. We then run the bash command in following format<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

This will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be run from the directory where '''setup_vps.sh''' is present.

[[File:New setup vps.png]]

4. '''default.rb''' : This updates the Ubuntu machine packages, installs the list of prerequisite packages and sets the time zone.

[[File:New default.png]]

5. '''expertiza_clone''' : This recipes creates a directory and clones the Expertiza git source code in that directory.

[[File:New expertiza clone.png ]]

'''set_java_home''': This recipe sets the Java configuration. It then bundle installs all the gems used by the Expertiza.

[[File:New_set_java.png]]

'''mysql.rb''' : It installs the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:New sql.png]]

'''database.rb''' : This recipe will execute scrubbed.sql on MySQL, which in turn will create all the Schema's for production, development and test environment. It will also populate database tables with seed (configuration) data.

[[File:New database.png]]

'''nginx.rb''' : This recipe installs nginx which is web proxy server that will listen on user defined port and redirect the requests for static content (images, css, javascript) to the public folder of Experiza rails app.

[[File:New_nginx.png ]]

'''unicorn.rb''' : It will install and configure Unicorn web server used in production environment to handle high traffic and achieve load balancing . All the requests for dynamic content will go through it.

[[File:New_unicorn_corn.png]]

'''start_server.rb''' : This will restart all the installed services , after which Expertiza can start taking requests.

[[File:New start server1.png]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==Future Scope==

The cookbook has been created with the assumption of root user as the administer.For security purposes deployment should be done with another user with sudo privileges, and then root login disabled. Also a new user for MySQL with full database privileges needs to be created. But that hasn't been achieved automatically in the resent cookbook. Further, Unicorn configuration is done with a single Unicorn server in mind. It has to be configured for multiple servers for load balancing in events of heavy traffic.

==References==
<references></references>

File:New unicorn corn.png

2015-12-16T10:37:42Z

Psinaik: uploaded a new version of "File:New unicorn corn.png"

File:New database.png

2015-12-16T10:37:24Z

Psinaik: uploaded a new version of "File:New database.png"

File:New database.png

2015-12-16T10:31:36Z

Psinaik: uploaded a new version of "File:New database.png"

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T10:30:33Z

Psinaik: /* Expertiza Deployment */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Some Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the Ubuntu to the specified version.

3. Clone Expertiza from Github.

4. Install packages for Java, Ruby and all the ruby dependencies.

5. Bundle install, install all gems

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref>, configure it and migrate databases.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Make changes in the nginx configuration.

9. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

10. Configure Unicorn and integrate it to work with nginx.

11. Start both Unicorn and Nginx server.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than 1 unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, RMV, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first created a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We recorded the IP address of the newly created droplet and created the associated <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:New_ip.png]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. Next, '''setup_vps.sh''' : This will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be from the directory where it present. The bash command in following format has to be used.

<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

[[File:New setup vps.png]]

'''default.rb''' : This updates the Ubuntu machine packages, install the list of prerequisite packages and sets the time zone.

[[File:New default.png]]

'''expertiza_clone''' : This recipes creates a directory and clones the Expertiza git source code in that directory.

[[File:New expertiza clone.png ]]

'''set_java_home''': This recipe sets the Java configuration. It then bundle installs all the gems used by the Expertiza.

[[File:New_set_java.png]]

'''mysql.rb''' : It installs the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:New sql.png]]

'''nginx.rb''' : This recipe installs nginx which is web proxy server that will listen on user defined port and redirect the requests for static content (images, css, javascript) to the public folder of Experiza rails app.

[[File:New_nginx.png ]]

'''unicorn.rb''' : It will install and configure Unicorn web server used in production environment to handle high traffic and achieve load balancing . All the requests for dynamic content will go through it.

[[File:New start server1.png]]

[[File:New database.png]]

[[File:New_unicorn_corn.png]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==References==
<references></references>

File:New start server1.png

2015-12-16T10:29:48Z

Psinaik:

File:New ip.png

2015-12-16T10:27:21Z

Psinaik: uploaded a new version of "File:New ip.png"

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T10:26:33Z

Psinaik: /* Expertiza Deployment */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Some Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the Ubuntu to the specified version.

3. Clone Expertiza from Github.

4. Install packages for Java, Ruby and all the ruby dependencies.

5. Bundle install, install all gems

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref>, configure it and migrate databases.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Make changes in the nginx configuration.

9. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

10. Configure Unicorn and integrate it to work with nginx.

11. Start both Unicorn and Nginx server.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than 1 unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, RMV, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first created a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We recorded the IP address of the newly created droplet and created the associated <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:New_ip.png]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. Next, '''setup_vps.sh''' : This will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be from the directory where it present. The bash command in following format has to be used.

<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

[[File:New setup vps.png]]

'''default.rb''' : This updates the Ubuntu machine packages, install the list of prerequisite packages and sets the time zone.

[[File:New default.png]]

'''expertiza_clone''' : This recipes creates a directory and clones the Expertiza git source code in that directory.

[[File:New expertiza clone.png ]]

'''set_java_home''': This recipe sets the Java configuration. It then bundle installs all the gems used by the Expertiza.

[[File:New_set_java.png]]

'''mysql.rb''' : It installs the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:New sql.png]]

'''nginx.rb''' : This recipe installs nginx which is web proxy server that will listen on user defined port and redirect the requests for static content (images, css, javascript) to the public folder of Experiza rails app.

[[File:New_nginx.png ]]

'''unicorn.rb''' : It will install and configure Unicorn web server used in production environment to handle high traffic and achieve load balancing . All the requests for dynamic content will go through it.

[[File:New start server.png.JPG]]

[[File:New database.png]]

[[File:New_unicorn_corn.png]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==References==
<references></references>

File:New unicorn corn.png

2015-12-16T10:24:15Z

Psinaik: uploaded a new version of "File:New unicorn corn.png"

File:New start server.png

2015-12-16T10:24:04Z

Psinaik: uploaded a new version of "File:New start server.png"

File:New sql.png

2015-12-16T10:23:53Z

Psinaik: uploaded a new version of "File:New sql.png"

File:New setup vps.png

2015-12-16T10:23:40Z

Psinaik: uploaded a new version of "File:New setup vps.png"

File:New set java.png

2015-12-16T10:23:26Z

Psinaik: uploaded a new version of "File:New set java.png"

File:New nginx.png

2015-12-16T10:23:15Z

Psinaik: uploaded a new version of "File:New nginx.png"

File:New expertiza clone.png

2015-12-16T10:23:04Z

Psinaik: uploaded a new version of "File:New expertiza clone.png"

File:New ip.png

2015-12-16T10:22:33Z

Psinaik: uploaded a new version of "File:New ip.png"

File:New expertiza clone.png

2015-12-16T10:22:14Z

Psinaik: uploaded a new version of "File:New expertiza clone.png"

File:New default.png

2015-12-16T10:22:01Z

Psinaik: uploaded a new version of "File:New default.png"

File:New database.png

2015-12-16T10:21:45Z

Psinaik: uploaded a new version of "File:New database.png"

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T10:15:18Z

Psinaik: /* Expertiza Deployment */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Some Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the Ubuntu to the specified version.

3. Clone Expertiza from Github.

4. Install packages for Java, Ruby and all the ruby dependencies.

5. Bundle install, install all gems

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref>, configure it and migrate databases.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Make changes in the nginx configuration.

9. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

10. Configure Unicorn and integrate it to work with nginx.

11. Start both Unicorn and Nginx server.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than 1 unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, RMV, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first created a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We recorded the IP address of the newly created droplet and created the associated <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.
[[File:New_ip.png]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. Next,

'''setup_vps.sh''' : This will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be from the directory where it present. The bash command in following format has to be used.

<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>
[[File:New setup vps.png]]

'''default.rb''' : This updates the Ubuntu machine packages, install the list of prerequisite packages and sets the time zone.
[[File:New default.png]]

'''expertiza_clone''' : This recipes creates a directory and clones the Expertiza git source code in that directory.
[[File:New expertiza clone.png ]]

'''set_java_home''': This recipe sets the Java configuration. It then bundle installs all the gems used by the Expertiza.
[[File:New_set_java.png]]

'''mysql.rb''' : It installs the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.
[[File:New sql.png]]
'''nginx.rb''' : This recipe installs nginx which is web proxy server that will listen on user defined port and redirect the requests for static content (images, css, javascript) to the public folder of Experiza rails app.
[[File:New_nginx.png ]]
'''unicorn.rb''' : It will install and configure Unicorn web server used in production environment to handle high traffic and achieve load balancing . All the requests for dynamic content will go through it.

[[File:New start server.png.JPG]]

[[File:New database.png]]

[[File:New_unicorn_corn.png]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==References==
<references></references>

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T10:13:48Z

Psinaik: /* Expertiza Deployment */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Some Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the Ubuntu to the specified version.

3. Clone Expertiza from Github.

4. Install packages for Java, Ruby and all the ruby dependencies.

5. Bundle install, install all gems

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref>, configure it and migrate databases.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Make changes in the nginx configuration.

9. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

10. Configure Unicorn and integrate it to work with nginx.

11. Start both Unicorn and Nginx server.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than 1 unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, RMV, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first created a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We recorded the IP address of the newly created droplet and created the associated <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:New_ip.png]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. Next,

'''setup_vps.sh''' : This will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be from the directory where it present. The bash command in following format has to be used.

<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

[[File:New setup vps.png]]

'''default.rb''' : This updates the Ubuntu machine packages, install the list of prerequisite packages and sets the time zone.
[[File:New default.png]]

'''expertiza_clone''' : This recipes creates a directory and clones the Expertiza git source code in that directory.
[[File:New expertiza clone.png ]]

'''set_java_home''': This recipe sets the Java configuration. It then bundle installs all the gems used by the Expertiza.
[[File:New_set_java.png]]

'''mysql.rb''' : It installs the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:New sql.png]]

'''nginx.rb''' : This recipe installs nginx which is web proxy server that will listen on user defined port and redirect the requests for static content (images, css, javascript) to the public folder of Experiza rails app.

[[File:New_nginx.png ]]

'''unicorn.rb''' : It will install and configure Unicorn web server used in production environment to handle high traffic and achieve load balancing . All the requests for dynamic content will go through it.
[[File:New start server.png.JPG]]

[[File:New database.png]]

[[File:New_unicorn_corn.png]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==References==
<references></references>

File:New sql.png

2015-12-16T10:13:22Z

Psinaik:

File:New unicorn corn.png

2015-12-16T10:12:10Z

Psinaik:

File:New start server.png

2015-12-16T10:08:54Z

Psinaik:

File:New setup vps.png

2015-12-16T10:08:21Z

Psinaik:

File:New set java.png

2015-12-16T10:07:31Z

Psinaik:

File:New nginx.png

2015-12-16T10:06:55Z

Psinaik:

File:New ip.png

2015-12-16T10:06:27Z

Psinaik:

File:New expertiza clone.png

2015-12-16T10:05:42Z

Psinaik:

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T10:04:15Z

Psinaik: /* Expertiza Deployment */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Some Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the Ubuntu to the specified version.

3. Clone Expertiza from Github.

4. Install packages for Java, Ruby and all the ruby dependencies.

5. Bundle install, install all gems

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref>, configure it and migrate databases.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Make changes in the nginx configuration.

9. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

10. Configure Unicorn and integrate it to work with nginx.

11. Start both Unicorn and Nginx server.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than 1 unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, RMV, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first created a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We recorded the IP address of the newly created droplet and created the associated <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:Ipjson.JPG]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. Next,

'''setup_vps.sh''' : This will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be from the directory where it present. The bash command in following format has to be used.

<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

[[File:Setup vps sh.JPG]]

'''default.rb''' : This updates the Ubuntu machine packages, install the list of prerequisite packages and sets the time zone.
[[File:New default.png]]

'''expertiza_clone''' : This recipes creates a directory and clones the Expertiza git source code in that directory.
[[File:Expertiza clone rb.JPG ]]

'''set_java_home''': This recipe sets the Java configuration. It then bundle installs all the gems used by the Expertiza.
[[File:Set java home rb.JPG]]

'''mysql.rb''' : It installs the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:Mysql rb.JPG]]

'''nginx.rb''' : This recipe installs nginx which is web proxy server that will listen on user defined port and redirect the requests for static content (images, css, javascript) to the public folder of Experiza rails app.

[[File:NGINX rb.JPG ]]

'''unicorn.rb''' : It will install and configure Unicorn web server used in production environment to handle high traffic and achieve load balancing . All the requests for dynamic content will go through it.
[[File:Start server rb.JPG]]

[[File:New database.png]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==References==
<references></references>

File:New database.png

2015-12-16T10:03:20Z

Psinaik:

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T09:47:23Z

Psinaik: /* Expertiza Deployment */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Some Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the ubuntu to the specified version.

3. Install packages for Ruby and all the ruby dependencies.

4. Install MYSQL<ref>[https://mysql.com Mysql server]</ref> and configure it.

5. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

6. Bundle install, install gems and migrate databases.

7. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

8. Make changes in the nginx configuration.

9. Configure Unicorn and integrate it to work with nginx.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than 1 unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, RMV, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first created a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We recorded the IP address of the newly created droplet and created the associated <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:Ipjson.JPG]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. Next,

'''setup_vps.sh''' : This will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be from the directory where it present. The bash command in following format has to be used.

<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

[[File:Setup vps sh.JPG]]

'''default.rb''' : This updates the Ubuntu machine packages, install the list of prerequisite packages and sets the time zone.
[[File:New default.png]]

'''expertiza_clone''' : This recipes creates a directory and clones the Expertiza git source code in that directory.
[[File:Expertiza clone rb.JPG ]]

'''set_java_home''': This recipe sets the Java configuration. It then bundle installs all the gems used by the Expertiza.
[[File:Set java home rb.JPG]]

'''mysql.rb''' : It installs the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:Mysql rb.JPG]]

'''nginx.rb''' : This recipe installs nginx which is web proxy server that will listen on user defined port and redirect the requests for static content (images, css, javascript) to the public folder of Experiza rails app.

[[File:NGINX rb.JPG ]]

'''unicorn.rb''' : It will install and configure Unicorn web server used in production environment to handle high traffic and achieve load balancing . All the requests for dynamic content will go through it.
[[File:Start server rb.JPG]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==References==
<references></references>

File:New default.png

2015-12-16T09:46:33Z

Psinaik:

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T09:03:05Z

Psinaik: /* Expertiza Deployment */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Some Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the ubuntu to the specified version.

3. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

4. Make changes in the nginx configuration.

5. Install Ruby, RVM<ref>[https://rvm.io/ Ruby Virtual Machine]</ref> and all the ruby dependencies.

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref> and configure it.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Configure Unicorn and integrate it to work with nginx.

9. Bundle install, install gems and migrate databases.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than 1 unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, RMV, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first created a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We recorded the IP address of the newly created droplet and created the associated <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:Ipjson.JPG]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. Next,

'''setup_vps.sh''' : This will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be from the directory where it present. The bash command in following format has to be used.

<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

[[File:Setup vps sh.JPG]]

'''default.rb''' : This updates the Ubuntu machine packages, install the list of prerequisite packages and sets the time zone.
[[File:Default rb.JPG]]

'''expertiza_clone''' : This recipes creates a directory and clones the Expertiza git source code in that directory.
[[File:Expertiza clone rb.JPG ]]

'''set_java_home''': This recipe sets the Java configuration. It then bundle installs all the gems used by the Expertiza.
[[File:Set java home rb.JPG]]

'''mysql.rb''' : It installs the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:Mysql rb.JPG]]

'''nginx.rb''' : This recipe installs nginx which is web proxy server that will listen on user defined port and redirect the requests for static content (images, css, javascript) to the public folder of Experiza rails app.

[[File:NGINX rb.JPG ]]

'''unicorn.rb''' : It will install and configure Unicorn web server used in production environment to handle high traffic and achieve load balancing . All the requests for dynamic content will go through it.
[[File:Start server rb.JPG]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==References==
<references></references>

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T08:38:15Z

Psinaik: /* Expertiza Deployment */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Some Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the ubuntu to the specified version.

3. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

4. Make changes in the nginx configuration.

5. Install Ruby, RVM<ref>[https://rvm.io/ Ruby Virtual Machine]</ref> and all the ruby dependencies.

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref> and configure it.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Configure Unicorn and integrate it to work with nginx.

9. Bundle install, install gems and migrate databases.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than 1 unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, RMV, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first create a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.png]]

2. We record the IP address of the newly created droplet and create the <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:Ipjson.JPG]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. Next

'''setup_vps.sh''' : This will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be from the directory where it present. The bash command in following format has to be used.

<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

[[File:Setup vps sh.JPG]]

'''default.rb''' : This updates the Ubuntu machine packages, install the list of prerequisite packages and sets the time zone.
[[File:Default rb.JPG]]

'''expertiza_clone''' : This recipes creates a directory and clones the Expertiza git source code in that directory.
[[File:Expertiza clone rb.JPG ]]

'''set_java_home''': This recipe sets the Java configuration. It then bundle installs all the gems used by the Expertiza.
[[File:Set java home rb.JPG]]

'''mysql.rb''' : It installs the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:Mysql rb.JPG]]

'''nginx.rb''' : This recipe installs nginx which is web proxy server that will listen on user defined port and redirect the requests for static content (images, css, javascript) to the public folder of Experiza rails app.

[[File:NGINX rb.JPG ]]

'''unicorn.rb''' : It will install and configure Unicorn web server used in production environment to handle high traffic and achieve load balancing . All the requests for dynamic content will go through it.
[[File:Start server rb.JPG]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==References==
<references></references>

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T08:37:37Z

Psinaik: /* Expertiza Deployment */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Some Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the ubuntu to the specified version.

3. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

4. Make changes in the nginx configuration.

5. Install Ruby, RVM<ref>[https://rvm.io/ Ruby Virtual Machine]</ref> and all the ruby dependencies.

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref> and configure it.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Configure Unicorn and integrate it to work with nginx.

9. Bundle install, install gems and migrate databases.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than 1 unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, RMV, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first create a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.
[[File:Drop.PNG]]

2. We record the IP address of the newly created droplet and create the <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:Ipjson.JPG]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. Next

'''setup_vps.sh''' : This will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be from the directory where it present. The bash command in following format has to be used.

<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

[[File:Setup vps sh.JPG]]

'''default.rb''' : This updates the Ubuntu machine packages, install the list of prerequisite packages and sets the time zone.
[[File:Default rb.JPG]]

'''expertiza_clone''' : This recipes creates a directory and clones the Expertiza git source code in that directory.
[[File:Expertiza clone rb.JPG ]]

'''set_java_home''': This recipe sets the Java configuration. It then bundle installs all the gems used by the Expertiza.
[[File:Set java home rb.JPG]]

'''mysql.rb''' : It installs the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:Mysql rb.JPG]]

'''nginx.rb''' : This recipe installs nginx which is web proxy server that will listen on user defined port and redirect the requests for static content (images, css, javascript) to the public folder of Experiza rails app.

[[File:NGINX rb.JPG ]]

'''unicorn.rb''' : It will install and configure Unicorn web server used in production environment to handle high traffic and achieve load balancing . All the requests for dynamic content will go through it.
[[File:Start server rb.JPG]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==References==
<references></references>

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T06:54:42Z

Psinaik: /* Expertiza Deployment */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Some Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the ubuntu to the specified version.

3. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

4. Make changes in the nginx configuration.

5. Install Ruby, RVM<ref>[https://rvm.io/ Ruby Virtual Machine]</ref> and all the ruby dependencies.

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref> and configure it.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Configure Unicorn and integrate it to work with nginx.

9. Bundle install, install gems and migrate databases.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than 1 unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, RMV, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment==

1. We first create a droplet( virtual private server) using digital ocean<ref>https://www.digitalocean.com/</ref>.

2. We record the IP address of the newly created droplet and create the <ipaddress>.json file.

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:Ipjson.JPG]]

The following recipes(.rb files), scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found in the git repository mentioned above.

3. Next

'''setup_vps.sh''' : This will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be from the directory where it present. The bash command in following format has to be used.

<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

[[File:Setup vps sh.JPG]]

'''default.rb''' : This updates the Ubuntu machine packages, install the list of prerequisite packages and sets the time zone.
[[File:Default rb.JPG]]

'''expertiza_clone''' : This recipes creates a directory and clones the Expertiza git source code in that directory.
[[File:Expertiza clone rb.JPG ]]

'''set_java_home''': This recipe sets the Java configuration. It then bundle installs all the gems used by the Expertiza.
[[File:Set java home rb.JPG]]

'''mysql.rb''' : It installs the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:Mysql rb.JPG]]

'''nginx.rb''' : This recipe installs nginx which is web proxy server that will listen on user defined port and redirect the requests for static content (images, css, javascript) to the public folder of Experiza rails app.

[[File:NGINX rb.JPG ]]

'''unicorn.rb''' : It will install and configure Unicorn web server used in production environment to handle high traffic and achieve load balancing . All the requests for dynamic content will go through it.
[[File:Start server rb.JPG]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==References==
<references></references>

CSC/ECE 517 Fall 2015 E1589 Automating production setup and deployment

2015-12-16T06:45:14Z

Psinaik: /* Nginx */

==Introduction to Expertiza==

The Expertiza project is a web application to create reusable learning objects through peer review. It supports various features such as team projects and the submission of various documents including URLs and wiki pages. It is being used extensively across various universities for select courses.

==Project Description==

===Problem Statement===

Currently, setting up the infrastructure for expertiza is done manually. The task is to write a Chef-solo<ref>[https://docs.chef.io/chef_solo.html Chef Solo]</ref> recipe which will create a production ready environment for expertiza. Chef-solo recipes are Ruby<ref>[https://www.ruby-lang.org/en/ Ruby]</ref> code.

===What needs to be done===

We need to provide a single step setup of expertiza for production.

*It should include setting up the basic environment, application dependency, configuration setup and database setup.
*It should also include recipe for regular deployment.

==Some Terminology==
===Chef Solo<ref>https://docs.chef.io/chef_solo.html</ref>===
Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure. Each organization is comprised of one(or more) workstations, a single server, and every node that will be configured and maintained by the chef-client. Cookbooks (and recipes) are used to tell the chef-client how each node in your organization should be configured. The chef-client(which is installed on every node) does the actual configuration.

*'''Node:'''
:A node is any machine—physical, virtual, cloud, network device, etc.—that is under management by Chef.

*'''Recipe: '''
:A recipe specifies the resources to use and the order in which they are to be applied. It is mostly a collection of resources, defined using patterns(resource names, attribute-value pairs, and actions). A recipe must define everything that is required to configure part of a system.

*'''Cookbook:'''
:A cookbook is the fundamental unit of configuration and policy distribution. A cookbook defines a scenario and contains everything that is required to support that scenario.

*'''WorkStation:'''
:A workstation is a computer that is configured to run various Chef command-line tools that synchronize with a chef-repo, author cookbooks, interact with the Chef server, interact with nodes, or applications like Chef Delivery.
:The workstation is the location from which most users do most of their work.
:One(or more) workstations are configured to allow users to author, test, and maintain cookbooks. Cookbooks are uploaded to the Chef server from the workstation.

*'''Chef Server:'''
:The Chef server acts as a hub of information. Cookbooks and policy settings are uploaded to the Chef server by users from workstations.

*'''Chef-client:'''
:The chef-client uses Ruby as its reference language for creating cookbooks and defining recipes, with an extended DSL for specific resources

===Nginx===

Nginx is a free, open-source, high-performance [HTTP] server and reverse proxy<ref>[https://www.nginx.com/resources/glossary/reverse-proxy-server/]</ref>, as well as an IMAP<ref>https://en.wikipedia.org/wiki/Internet_Message_Access_Protocol</ref>/POP3<ref>https://en.wikipedia.org/wiki/Post_Office_Protocol</ref> proxy server. Nginx is known for its high performance, stability, rich feature set, simple configuration, and low resource consumption.<ref>[https://www.nginx.com/resources/wiki/ Nginx Sever]</ref>

===Unicorn===

Unicorn is an HTTP server for Rack applications designed to only serve fast clients on low-latency, high-bandwidth connections and take advantage of features in Unix/Unix-like kernels. Slow clients should only be served by placing a reverse proxy capable of fully buffering both the the request and response in between unicorn and slow clients.
<ref>[https://github.com/defunkt/unicorn Unicorn Web Server]</ref>

==Plan of Action==
===Steps to Implement the Automated Deployment Process===

[[File:Img01ExpInfra.png | frame|none|Expertiza Virtual Infrastructure]]

1. Setup a virtual Vanilla<ref>[https://en.wikipedia.org/wiki/Vanilla_software Vanilla]</ref> Ubuntu<ref>[http://www.ubuntu.com Ubuntu]</ref> Machine.

2. Update the ubuntu to the specified version.

3. Install nginx. Nginx is a web server. It is being used in the Expertiza architecture as a reverse proxy server. Through nginx, we will also attempt to serve static pages directly.

4. Make changes in the nginx configuration.

5. Install Ruby, RVM<ref>[https://rvm.io/ Ruby Virtual Machine]</ref> and all the ruby dependencies.

6. Install MYSQL<ref>[https://mysql.com Mysql server]</ref> and configure it.

7. Install Unicorn gem. Unicorn is a Rack<ref>[https://en.wikipedia.org/wiki/Rack_%28web_server_interface%29 Rack Server]</ref> HTTP server that uses forked processes to handle multiple incoming requests concurrently. For expertiza, unicorn is being used as the web server, which will interact with the database servers to fetch the data.

8. Configure Unicorn and integrate it to work with nginx.

9. Bundle install, install gems and migrate databases.

==Expertiza Stack==

[[File:Exp1.png]]

The above visually describes the expertiza stack on the virtual machine. The stack includes nginx as the front end, web server which will redirect the requests to the unicorn server. The scope of the project includes just 1 unicorn server but the recipe will be written in a way that later modifications can be made to add more than 1 unicorn servers under a load balancer. The unicorn server will interact with the database server and write/fetch data into it.

==Chef-Solo Recipe Example==
Chef solo has cookbooks and recipes. An example of recipes is as follows:
package "git-core" #apt-get install git-core

user node[:user][:name] do
password node[:user][:password]
gid "admin"
home "/home/#{node[:user][:name]}"
supports :manage_home => true
end

This recipe orchestrates the installation of git-core and creates a new user and sets its privileges and password along with the home directory. Similarly, the plan of action is to write recipes for downloading, installing and configuring various components(nginx, unicorn, RMV, Ruby, MYSQL etc.) which will contribute towards building the infrastructure of expertiza.

==Expertiza Deployment ==

We first create a droplet using [digital ocean].

The following recipes (.rb files) , scripts and node specific files were created to achieve automatic deployment. Other pre-installed files and folder for Chef cookbook can be found on above git repository.

'''setup_vps.sh''' : This will run the knife tool that will setup Chef-solo on the node and will execute the recipes.
This needs to be from the directory where it present. The bash command in following format has to be used.

<code>sh setup_vps.sh <node_username> <node_ip_address> <node_port> </code>

[[File:Setup vps sh.JPG]]

'''<ipaddress>.json''' : This file holds all the node specific values required to install services and config node.
We will set node_user , user_hash_password , ruby version , mysql root & password . The main function apart from holding node variables is to run recipes in a specific code.

[[File:Ipjson.JPG]]

'''default.rb''' : This updates the Ubuntu machine packages, install the list of prerequisite packages and sets the time zone.
[[File:Default rb.JPG]]

'''expertiza_clone''' : This recipes creates a directory and clones the Expertiza git source code in that directory.
[[File:Expertiza clone rb.JPG ]]

'''set_java_home''': This recipe sets the Java configuration. It then bundle installs all the gems used by the Expertiza.
[[File:Set java home rb.JPG]]

'''mysql.rb''' : It installs the MySQL server , MySQL client and its associated dependencies. The root password is preloaded and then fetched on installation by setting DEBIAN_FRONTEND environment variable.

[[File:Mysql rb.JPG]]

'''nginx.rb''' : This recipe installs nginx which is web proxy server that will listen on user defined port and redirect the requests for static content (images, css, javascript) to the public folder of Experiza rails app.

[[File:NGINX rb.JPG ]]

'''unicorn.rb''' : It will install and configure Unicorn web server used in production environment to handle high traffic and achieve load balancing . All the requests for dynamic content will go through it.
[[File:Start server rb.JPG]]

==Github link==
https://github.com/amurark/expertiza

==Points for the reviewer==

While reviewing this project, please consider the following points:

*1. There is no scope for testing in our project. This has been discussed and approved by the mentor.
*2. There is no scope for UML diagrams for this project, as there are no classes/interface involved.

==References==
<references></references>