Expertiza_Wiki - User contributions [en]

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-31T02:52:53Z

Kspatel6: /* Technical Overview */

==Background==
The Sahana Software Foundation is dedicated to the mission of saving lives by providing information management solutions that enable organizations and communities to better prepare for and respond to disasters. It is an open source software platform which provides a range of solutions for Disaster Management practitioners to help them reduce the impact disasters have on our communities through tracking the needs of the affected populations & coordinating the responding agencies & their resources.It can be accessed from the web or locally from a flash
drive, allowing it to be used in environments with poor internet. Local & Web versions can be configured to synchronize to allow data to be
shared between them. These features are designed to help Disaster Management practitioners to better mitigate, prepare for, respond to and recover from disasters more effectively and efficiently.

Sahana Eden is designed to be rapidly configured and customized to support the diverse business processes used within Disaster Management. Sahana Eden's modular design allows different pieces of functionality to be enabled and disabled as required providing flexible solutions for changing contexts. The application can be configured to secure sensitive information, while also making data which needs to be shared available in a variety of different formats including Microsoft Excel and PDF. To ensure that Sahana Eden is accessible to every country, it can be translated into multiple languages.

==Core modules and outlines==

'''Organization Registry'''

Many diverse organizations are involved in Disaster Management, from responding to disasters to strengthening communities to providing support to people in need. Sahana Eden’s Organization Registry can track what organizations are active in different contexts, providing opportunities for collaboration and coordination.

'''Project Tracking'''

By telling you Who’s Doing What, Where, and When, Sahana Eden provides a valuable tool to help organizations responding to disasters know where the greatest needs are and coordinate with others who are engaged in similar work.

'''Human Resources'''

The most important part of Disaster Management is the people.Whether they are community volunteers or staff working for different organizations, the Human Resources module can help manage the people involved. It will track where they are, what skills they have and help ensure that everyone is effectively engaged with the work that needs to be done. Sahana Eden can also be used to provide a contact list to ensure that the right people can be contacted at the right time.

'''Inventory'''

Whether organizations are supplying basic essentials of life to people
affected by natural disasters or giving communities the tools they
need to restore their livelihoods, Sahana Eden can be used to manage
inventories of items and match requests for items with warehouses
and other facilities which have them available. Operationally, Sahana
Eden can be used to record and automate transactions for sending
and receiving shipments. Sahana Eden can support multiple Catalogs of
Items as well as providing alternative items to ensure more effective
use of supplies. Sahana Eden can be configured to load multiple
catalogs including a generic list of items and/or the IFRC Emergency
Item Catalog.

'''Assets'''

A wide range of assets are needed to respond to disasters, including
vehicles to transport people and relief items, radio equipment to
provide communication where telecommunication infrastructure has
been destroyed, and generators to provide backup power. Sahana
Eden is able to manage assets, track where they are, who they have
been assigned to, and what condition they are in. This ensures that
assets are used effectively and efficiently.

'''Assessments'''

Sahana Eden can be used to collect and analyze information from
assessments to help organizations more effectively plan their disaster
management activities. Different assessment templates can easily be
designed and imported into Sahana Eden to support assessments for
different organizations in different contexts. Data can either be
entered into an interactive web form or imported via an Excel
template.

'''Scenarios and Events'''

To help organizations better plan for disasters, Sahana Eden can be
used to plan for different scenarios, including recording what human
resources, assets, facilities and tasks will be needed to effectively
respond.
When an incident occurs events can be created from a scenario
template to allocate the resources and alert people of the need to
respond.

'''Map'''

Sahana Eden has fully integrated mapping functionality which allows
any location-based data to be visualized on a map. This information
can also be searched using a map-based boundary selection. Maps
provide situational awareness which is essential when either planning to
prepare for or respond to a disaster. Sahana Eden supports many
standard formats for overlaying data on maps from other sources
and Geographical Information Systems (GIS), for example natural
hazard risks, population or weather.

'''Shelter Management'''

When disasters are widespread and result in population displacement,
understanding and tracking the landscape of shelters - and the people
in them - is a critical activity. The Shelter Registry provides
functionality to list and track information on shelters and on the
people arriving and departing. Shelter details include location, services
provided, responsible organization and contacts, demographics, and
needs. In addition, individual person data includes name, age, relatives,
status, health, and many other details to provide a clear understanding
of population demographics within the site.

'''Messaging'''

In the complex domain of Disaster Management, communication is
critical. Sahana Eden provides support for messages to be sent
by Email, SMS, Twitter and Google Talk. Distribution Groups can be set
up to allow messages to be easily sent to many people at once. Users
are able to search for specific information and subscribe to receive
update messages when new information is added.

==Technical Overview==

Because Sahana Eden needs to be accessible to users at remote
locations, including the public, a browser-based solution was essential.
The system also needs to be able to be used on offline laptops, so it
needs to run on a lightweight stack.

Python was selected as a suitable high level language allowing the rapid
customization of code required for each individual circumstance yet
has a large number of powerful libraries available including for
Geospatial Information Systems (GIS).

'''Shana Eden Framework'''

The Sahana Eden Software Platform has been built around a Rapid
Application Development (RAD) Framework. This provides a high level
of automation to ensure that new solutions can be quickly and
effectively developed. Once a database table is defined, the Sahana
Eden Framework automatically generates HTML pages to handle CRUD
(Create, Read, Update, Delete) as well as Search, Map and Pivot
Reports. Web Services are available to import and export in XML, CSV,
JSON and EXtensible Stylesheet Language (XSL) transforms are
supported to produce other data standards.

'''Sahana Eden Architecture'''

Web Server: Apache. Other web servers can also be used,such as Cherokee.

Application: Sahana Eden

Web Application Framework: Web2Py

Programming Language: Python & JavaScript

Database: MySQL,PostgreSQL, or MySQL, PostgreSQL, and SQLite are supported. Other databases should be usable without major additional work
since Web2Py supplies many connectors.

Operating System: Linux (Debian recommended),Windows and Mac OS X are possible, but only recommended for single-user environments.

'''Installation'''

Sahana Eden can be installed on any environment which can run
Python, including Linux, Windows and OSX. The system supports a
number of different databases and has been widely tested on MySQL,
PostgreSQL and SQLite. A webserver is optional, but for production
installations we have experience of both Apache/mod_wsgi and
Cherokee/uwsgi.

Installation scripts and detailed instructions are available on the Wiki:
http://eden.sahanafoundation.org/wiki/InstallationGuidelines

'''Web2py'''

This is an MVC environment (like Rails & Django.).
Web2Py can work at several different levels of abstraction.
The Sahana Eden framework (S3) is built on Web2Py's Auth/Crud classes in tools.py (with some remnants of the older T2), however sometimes we need more control therefore need to drop down a level or two.
Can execute a controller to be able to access its functions using:
execfile("applications/eden/controllers/mycontroller.py", globals())

'''S3'''

The Sahana Eden framework (S3) is built on Web2Py and It is used for RAD in all the sahana applications. The Sahana api docs can be found at http://eden.sahanafoundation.org/wiki/DeveloperGuidelines

'''Directory Structure'''

After the installation, the typical directory structure of the instance
looks like:
:[[File:Application_structure.png]]

==Social Media==
Social Media is playing a important role in Disaster and Emergency Management, for such things as:

- Sending warnings and emergency instructions to the public.

- Receiving help requests and incident reports from the public.

- Engaging with the public, encouraging preparedness, providing information.

- Detecting incidents not directly reported. f

==Map Feeds==
This project allows the user to add layers of Geo-tagged data from Twitter onto the Map. It searches for tweets with specific keywords (that can be configured by user on Sahana web page). It then plots the location of these tweets on the Map. This is the work that we have done as a part of our project implementation. The following steps are involved in this:

After setting up Eden in the system twitterSearch library(https://pypi.python.org/pypi/TwitterSearch/) is to be installed which helps to fetch the tweets with specific keywords

'''Searching Tweets'''

- Configuring twitter account:

Sign into https://dev.twitter.com and create an app. (Select an application Type: Client). Put the Callback URL as blank and create your own Twitter application. After creating an app on twitter account, you will be able to see a tab called OAuth tool. Open eden/models/000_config.py file. Under Twitter Settings, add consumer_key and consumer_secret obtained from the twitter app's OAuth tool. Edit the following lines in 000_config.py
settings.msg.twitter_oauth_consumer_key = "<consumer key from twitter app>"
settings.msg.twiiter_oauth_consumer_secret = "<consumer_secret from twitter app>"

- Add keywords to be searched:

Go to a page eden/msg/twitter_search. You can add keywords / search queries records under this page. It will ask you for a PIN to enter before saving the keywords/queries. The pin is obtained from Twitter app that was created.

- Populating database with search results:

After saving the keywords/ queries, click on Results which triggers the search and msg_twitter_search_results table in the database gets populated.

'''Processing Tweets'''

After fetching the twitter feeds, the Geo-tagged tweets are processed. They are parsed to fetch user information, tweet data and location information in terms of latitude and longitude. All this information then goes into the msg_twitter_search_results table.

'''Plotting tweets on Map'''

To display tweets on map, a new layer named "Twitter" is added under the overlays section on the map page. When a user selects this option, the location ids from the msg_twitter_search_results are fetched and a marker is displayed on those locations. Clicking on the marker image displays additional tweet information such as content, time and user info.

'''Our Tasks'''

1) After fetching the twitter feeds, process the geo-tagged data in tweets and store in a different table with a foreign key reference in twitter search result table.

2) To display the tweets on a map, for which a new layer “Twitter” is added under the overlays section on map page.

3) To display the twitter search result in “Summary View”. The Summary view provides a consolidate view of the data and provides tabs for Map, Table and Charts.

4) When the tweets are displayed on Map, the data associated with the tweets needs to be displayed.

'''Summary View'''

In order to view the twitter search results in Summary View, we need to make configuration level changes. The application running on Heroku has the 'default' theme and the Summary View can be obtained only when the 'CRMT' theme is selected. A screen shot of 'Summary View' has been added below for testing.

'''Summary View Table'''

[[File:ScreenShot_Summary_Table.png]]

'''Summary View Map'''

[[File:ScreenShot_Summary_Map.png]]

==Future Scope==

1. Major limitation is that the twitter search keyword is hard coded.We need to make the code access the msg_twitter_search table and use the keywords stored by the user through the GUI to search and display twitter feeds on the GIS map.

2. Display twitter icon on map instead of the normal location bubble.

3. Work on the pop-up contents. Ideally this would include any photo or video linked in the message (or a URL if it's to a page of text). Actually doing the part within the tweet parsing of following embedded URLs to identify if they're Media would be really useful addition to the parser (there is a commented-out stub).

4. Create a cron job, to search tweets periodically and not only at user's request.

==References==

http://sahanafoundation.org/

http://eden.sahanafoundation.org/

http://eden.sahanafoundation.org/wiki/InstallationGuidelines

http://eden.sahanafoundation.org/wiki/S3

http://eden.sahanafoundation.org/wiki/Book

http://en.flossmanuals.net/sahana-eden/why-sahana-eden/

https://pypi.python.org/pypi/TwitterSearch/

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-31T02:51:51Z

Kspatel6: /* Technical Overview */

==Background==
The Sahana Software Foundation is dedicated to the mission of saving lives by providing information management solutions that enable organizations and communities to better prepare for and respond to disasters. It is an open source software platform which provides a range of solutions for Disaster Management practitioners to help them reduce the impact disasters have on our communities through tracking the needs of the affected populations & coordinating the responding agencies & their resources.It can be accessed from the web or locally from a flash
drive, allowing it to be used in environments with poor internet. Local & Web versions can be configured to synchronize to allow data to be
shared between them. These features are designed to help Disaster Management practitioners to better mitigate, prepare for, respond to and recover from disasters more effectively and efficiently.

Sahana Eden is designed to be rapidly configured and customized to support the diverse business processes used within Disaster Management. Sahana Eden's modular design allows different pieces of functionality to be enabled and disabled as required providing flexible solutions for changing contexts. The application can be configured to secure sensitive information, while also making data which needs to be shared available in a variety of different formats including Microsoft Excel and PDF. To ensure that Sahana Eden is accessible to every country, it can be translated into multiple languages.

==Core modules and outlines==

'''Organization Registry'''

Many diverse organizations are involved in Disaster Management, from responding to disasters to strengthening communities to providing support to people in need. Sahana Eden’s Organization Registry can track what organizations are active in different contexts, providing opportunities for collaboration and coordination.

'''Project Tracking'''

By telling you Who’s Doing What, Where, and When, Sahana Eden provides a valuable tool to help organizations responding to disasters know where the greatest needs are and coordinate with others who are engaged in similar work.

'''Human Resources'''

The most important part of Disaster Management is the people.Whether they are community volunteers or staff working for different organizations, the Human Resources module can help manage the people involved. It will track where they are, what skills they have and help ensure that everyone is effectively engaged with the work that needs to be done. Sahana Eden can also be used to provide a contact list to ensure that the right people can be contacted at the right time.

'''Inventory'''

Whether organizations are supplying basic essentials of life to people
affected by natural disasters or giving communities the tools they
need to restore their livelihoods, Sahana Eden can be used to manage
inventories of items and match requests for items with warehouses
and other facilities which have them available. Operationally, Sahana
Eden can be used to record and automate transactions for sending
and receiving shipments. Sahana Eden can support multiple Catalogs of
Items as well as providing alternative items to ensure more effective
use of supplies. Sahana Eden can be configured to load multiple
catalogs including a generic list of items and/or the IFRC Emergency
Item Catalog.

'''Assets'''

A wide range of assets are needed to respond to disasters, including
vehicles to transport people and relief items, radio equipment to
provide communication where telecommunication infrastructure has
been destroyed, and generators to provide backup power. Sahana
Eden is able to manage assets, track where they are, who they have
been assigned to, and what condition they are in. This ensures that
assets are used effectively and efficiently.

'''Assessments'''

Sahana Eden can be used to collect and analyze information from
assessments to help organizations more effectively plan their disaster
management activities. Different assessment templates can easily be
designed and imported into Sahana Eden to support assessments for
different organizations in different contexts. Data can either be
entered into an interactive web form or imported via an Excel
template.

'''Scenarios and Events'''

To help organizations better plan for disasters, Sahana Eden can be
used to plan for different scenarios, including recording what human
resources, assets, facilities and tasks will be needed to effectively
respond.
When an incident occurs events can be created from a scenario
template to allocate the resources and alert people of the need to
respond.

'''Map'''

Sahana Eden has fully integrated mapping functionality which allows
any location-based data to be visualized on a map. This information
can also be searched using a map-based boundary selection. Maps
provide situational awareness which is essential when either planning to
prepare for or respond to a disaster. Sahana Eden supports many
standard formats for overlaying data on maps from other sources
and Geographical Information Systems (GIS), for example natural
hazard risks, population or weather.

'''Shelter Management'''

When disasters are widespread and result in population displacement,
understanding and tracking the landscape of shelters - and the people
in them - is a critical activity. The Shelter Registry provides
functionality to list and track information on shelters and on the
people arriving and departing. Shelter details include location, services
provided, responsible organization and contacts, demographics, and
needs. In addition, individual person data includes name, age, relatives,
status, health, and many other details to provide a clear understanding
of population demographics within the site.

'''Messaging'''

In the complex domain of Disaster Management, communication is
critical. Sahana Eden provides support for messages to be sent
by Email, SMS, Twitter and Google Talk. Distribution Groups can be set
up to allow messages to be easily sent to many people at once. Users
are able to search for specific information and subscribe to receive
update messages when new information is added.

==Technical Overview==

Because Sahana Eden needs to be accessible to users at remote
locations, including the public, a browser-based solution was essential.
The system also needs to be able to be used on offline laptops, so it
needs to run on a lightweight stack.

Python was selected as a suitable high level language allowing the rapid
customization of code required for each individual circumstance yet
has a large number of powerful libraries available including for
Geospatial Information Systems (GIS).

'''Shana Eden Framework'''

The Sahana Eden Software Platform has been built around a Rapid
Application Development (RAD) Framework. This provides a high level
of automation to ensure that new solutions can be quickly and
effectively developed. Once a database table is defined, the Sahana
Eden Framework automatically generates HTML pages to handle CRUD
(Create, Read, Update, Delete) as well as Search, Map and Pivot
Reports. Web Services are available to import and export in XML, CSV,
JSON and EXtensible Stylesheet Language (XSL) transforms are
supported to produce other data standards.

'''Sahana Eden Architecture'''

Web Server: Apache. Other web servers can also be used,such as Cherokee.

Application: Sahana Eden

Web Application Framework: Web2Py

Programming Language: Python & JavaScript

Database: MySQL,PostgreSQL, or MySQL, PostgreSQL, and SQLite are supported. Other databases should be usable without major additional work
since Web2Py supplies many connectors.

Operating System: Linux (Debian recommended),Windows and Mac OS X are possible, but only recommended for single-user environments.

'''Installation'''

Sahana Eden can be installed on any environment which can run
Python, including Linux, Windows and OSX. The system supports a
number of different databases and has been widely tested on MySQL,
PostgreSQL and SQLite. A webserver is optional, but for production
installations we have experience of both Apache/mod_wsgi and
Cherokee/uwsgi.

Installation scripts and detailed instructions are available on the Wiki:
http://eden.sahanafoundation.org/wiki/InstallationGuidelines

'''Web2py'''

This is an MVC environment (like Rails & Django.).
Web2Py can work at several different levels of abstraction.
The Sahana Eden framework (S3) is built on Web2Py's Auth/Crud classes in tools.py (with some remnants of the older T2), however sometimes we need more control therefore need to drop down a level or two.
Can execute a controller to be able to access its functions using:
execfile("applications/eden/controllers/mycontroller.py", globals())

'''S3'''

The Sahana Eden framework (S3) is built on Web2Py and It is used for RAD in all the sahana applications. The Sahana api docs can be found at http://eden.sahanafoundation.org/wiki/DeveloperGuidelines

'''Directory Structure'''

After the installation, the typical directory structure of the instance
looks like:
:[[File:Application_structure.png]]
[[Application_structure.png]]

==Social Media==
Social Media is playing a important role in Disaster and Emergency Management, for such things as:

- Sending warnings and emergency instructions to the public.

- Receiving help requests and incident reports from the public.

- Engaging with the public, encouraging preparedness, providing information.

- Detecting incidents not directly reported. f

==Map Feeds==
This project allows the user to add layers of Geo-tagged data from Twitter onto the Map. It searches for tweets with specific keywords (that can be configured by user on Sahana web page). It then plots the location of these tweets on the Map. This is the work that we have done as a part of our project implementation. The following steps are involved in this:

After setting up Eden in the system twitterSearch library(https://pypi.python.org/pypi/TwitterSearch/) is to be installed which helps to fetch the tweets with specific keywords

'''Searching Tweets'''

- Configuring twitter account:

Sign into https://dev.twitter.com and create an app. (Select an application Type: Client). Put the Callback URL as blank and create your own Twitter application. After creating an app on twitter account, you will be able to see a tab called OAuth tool. Open eden/models/000_config.py file. Under Twitter Settings, add consumer_key and consumer_secret obtained from the twitter app's OAuth tool. Edit the following lines in 000_config.py
settings.msg.twitter_oauth_consumer_key = "<consumer key from twitter app>"
settings.msg.twiiter_oauth_consumer_secret = "<consumer_secret from twitter app>"

- Add keywords to be searched:

Go to a page eden/msg/twitter_search. You can add keywords / search queries records under this page. It will ask you for a PIN to enter before saving the keywords/queries. The pin is obtained from Twitter app that was created.

- Populating database with search results:

After saving the keywords/ queries, click on Results which triggers the search and msg_twitter_search_results table in the database gets populated.

'''Processing Tweets'''

After fetching the twitter feeds, the Geo-tagged tweets are processed. They are parsed to fetch user information, tweet data and location information in terms of latitude and longitude. All this information then goes into the msg_twitter_search_results table.

'''Plotting tweets on Map'''

To display tweets on map, a new layer named "Twitter" is added under the overlays section on the map page. When a user selects this option, the location ids from the msg_twitter_search_results are fetched and a marker is displayed on those locations. Clicking on the marker image displays additional tweet information such as content, time and user info.

'''Our Tasks'''

1) After fetching the twitter feeds, process the geo-tagged data in tweets and store in a different table with a foreign key reference in twitter search result table.

2) To display the tweets on a map, for which a new layer “Twitter” is added under the overlays section on map page.

3) To display the twitter search result in “Summary View”. The Summary view provides a consolidate view of the data and provides tabs for Map, Table and Charts.

4) When the tweets are displayed on Map, the data associated with the tweets needs to be displayed.

'''Summary View'''

In order to view the twitter search results in Summary View, we need to make configuration level changes. The application running on Heroku has the 'default' theme and the Summary View can be obtained only when the 'CRMT' theme is selected. A screen shot of 'Summary View' has been added below for testing.

'''Summary View Table'''

[[File:ScreenShot_Summary_Table.png]]

'''Summary View Map'''

[[File:ScreenShot_Summary_Map.png]]

==Future Scope==

1. Major limitation is that the twitter search keyword is hard coded.We need to make the code access the msg_twitter_search table and use the keywords stored by the user through the GUI to search and display twitter feeds on the GIS map.

2. Display twitter icon on map instead of the normal location bubble.

3. Work on the pop-up contents. Ideally this would include any photo or video linked in the message (or a URL if it's to a page of text). Actually doing the part within the tweet parsing of following embedded URLs to identify if they're Media would be really useful addition to the parser (there is a commented-out stub).

4. Create a cron job, to search tweets periodically and not only at user's request.

==References==

http://sahanafoundation.org/

http://eden.sahanafoundation.org/

http://eden.sahanafoundation.org/wiki/InstallationGuidelines

http://eden.sahanafoundation.org/wiki/S3

http://eden.sahanafoundation.org/wiki/Book

http://en.flossmanuals.net/sahana-eden/why-sahana-eden/

https://pypi.python.org/pypi/TwitterSearch/

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-30T18:39:50Z

Kspatel6: /* Map Feeds */

==Background==
The Sahana Software Foundation is dedicated to the mission of saving lives by providing information management solutions that enable organizations and communities to better prepare for and respond to disasters. It is an open source software platform which provides a range of solutions for Disaster Management practitioners to help them reduce the impact disasters have on our communities through tracking the needs of the affected populations & coordinating the responding agencies & their resources.It can be accessed from the web or locally from a flash
drive, allowing it to be used in environments with poor internet. Local & Web versions can be configured to synchronize to allow data to be
shared between them. These features are designed to help Disaster Management practitioners to better mitigate, prepare for, respond to and recover from disasters more effectively and efficiently.

Sahana Eden is designed to be rapidly configured and customized to support the diverse business processes used within Disaster Management. Sahana Eden's modular design allows different pieces of functionality to be enabled and disabled as required providing flexible solutions for changing contexts. The application can be configured to secure sensitive information, while also making data which needs to be shared available in a variety of different formats including Microsoft Excel and PDF. To ensure that Sahana Eden is accessible to every country, it can be translated into multiple languages.

==Core modules and outlines==

'''Organization Registry'''

Many diverse organizations are involved in Disaster Management, from responding to disasters to strengthening communities to providing support to people in need. Sahana Eden’s Organization Registry can track what organizations are active in different contexts, providing opportunities for collaboration and coordination.

'''Project Tracking'''

By telling you Who’s Doing What, Where, and When, Sahana Eden provides a valuable tool to help organizations responding to disasters know where the greatest needs are and coordinate with others who are engaged in similar work.

'''Human Resources'''

The most important part of Disaster Management is the people.Whether they are community volunteers or staff working for different organizations, the Human Resources module can help manage the people involved. It will track where they are, what skills they have and help ensure that everyone is effectively engaged with the work that needs to be done. Sahana Eden can also be used to provide a contact list to ensure that the right people can be contacted at the right time.

'''Inventory'''

Whether organizations are supplying basic essentials of life to people
affected by natural disasters or giving communities the tools they
need to restore their livelihoods, Sahana Eden can be used to manage
inventories of items and match requests for items with warehouses
and other facilities which have them available. Operationally, Sahana
Eden can be used to record and automate transactions for sending
and receiving shipments. Sahana Eden can support multiple Catalogs of
Items as well as providing alternative items to ensure more effective
use of supplies. Sahana Eden can be configured to load multiple
catalogs including a generic list of items and/or the IFRC Emergency
Item Catalog.

'''Assets'''

A wide range of assets are needed to respond to disasters, including
vehicles to transport people and relief items, radio equipment to
provide communication where telecommunication infrastructure has
been destroyed, and generators to provide backup power. Sahana
Eden is able to manage assets, track where they are, who they have
been assigned to, and what condition they are in. This ensures that
assets are used effectively and efficiently.

'''Assessments'''

Sahana Eden can be used to collect and analyze information from
assessments to help organizations more effectively plan their disaster
management activities. Different assessment templates can easily be
designed and imported into Sahana Eden to support assessments for
different organizations in different contexts. Data can either be
entered into an interactive web form or imported via an Excel
template.

'''Scenarios and Events'''

To help organizations better plan for disasters, Sahana Eden can be
used to plan for different scenarios, including recording what human
resources, assets, facilities and tasks will be needed to effectively
respond.
When an incident occurs events can be created from a scenario
template to allocate the resources and alert people of the need to
respond.

'''Map'''

Sahana Eden has fully integrated mapping functionality which allows
any location-based data to be visualized on a map. This information
can also be searched using a map-based boundary selection. Maps
provide situational awareness which is essential when either planning to
prepare for or respond to a disaster. Sahana Eden supports many
standard formats for overlaying data on maps from other sources
and Geographical Information Systems (GIS), for example natural
hazard risks, population or weather.

'''Shelter Management'''

When disasters are widespread and result in population displacement,
understanding and tracking the landscape of shelters - and the people
in them - is a critical activity. The Shelter Registry provides
functionality to list and track information on shelters and on the
people arriving and departing. Shelter details include location, services
provided, responsible organization and contacts, demographics, and
needs. In addition, individual person data includes name, age, relatives,
status, health, and many other details to provide a clear understanding
of population demographics within the site.

'''Messaging'''

In the complex domain of Disaster Management, communication is
critical. Sahana Eden provides support for messages to be sent
by Email, SMS, Twitter and Google Talk. Distribution Groups can be set
up to allow messages to be easily sent to many people at once. Users
are able to search for specific information and subscribe to receive
update messages when new information is added.

==Technical Overview==

Because Sahana Eden needs to be accessible to users at remote
locations, including the public, a browser-based solution was essential.
The system also needs to be able to be used on offline laptops, so it
needs to run on a lightweight stack.

Python was selected as a suitable high level language allowing the rapid
customization of code required for each individual circumstance yet
has a large number of powerful libraries available including for
Geospatial Information Systems (GIS).

'''Shana Eden Framework'''

The Sahana Eden Software Platform has been built around a Rapid
Application Development (RAD) Framework. This provides a high level
of automation to ensure that new solutions can be quickly and
effectively developed. Once a database table is defined, the Sahana
Eden Framework automatically generates HTML pages to handle CRUD
(Create, Read, Update, Delete) as well as Search, Map and Pivot
Reports. Web Services are available to import and export in XML, CSV,
JSON and EXtensible Stylesheet Language (XSL) transforms are
supported to produce other data standards.

'''Sahana Eden Architecture'''

Web Server: Apache. Other web servers can also be used,such as Cherokee.

Application: Sahana Eden

Web Application Framework: Web2Py

Programming Language: Python & JavaScript

Database: MySQL,PostgreSQL, or MySQL, PostgreSQL, and SQLite are supported. Other databases should be usable without major additional work
since Web2Py supplies many connectors.

Operating System: Linux (Debian recommended),Windows and Mac OS X are possible, but only recommended for single-user environments.

'''Installation'''

Sahana Eden can be installed on any environment which can run
Python, including Linux, Windows and OSX. The system supports a
number of different databases and has been widely tested on MySQL,
PostgreSQL and SQLite. A webserver is optional, but for production
installations we have experience of both Apache/mod_wsgi and
Cherokee/uwsgi.

Installation scripts and detailed instructions are available on the Wiki:
http://eden.sahanafoundation.org/wiki/InstallationGuidelines

'''Web2py'''

This is an MVC environment (like Rails & Django.).
Web2Py can work at several different levels of abstraction.
The Sahana Eden framework (S3) is built on Web2Py's Auth/Crud classes in tools.py (with some remnants of the older T2), however sometimes we need more control therefore need to drop down a level or two.
Can execute a controller to be able to access its functions using:
execfile("applications/eden/controllers/mycontroller.py", globals())

'''S3'''

The Sahana Eden framework (S3) is built on Web2Py and It is used for RAD in all the sahana applications. The Sahana api docs can be found at http://eden.sahanafoundation.org/wiki/DeveloperGuidelines

'''Directory Structure'''

After the installation, the typical directory structure of the instance
looks like:
[[Application_structure.png]]

==Social Media==
Social Media is playing a important role in Disaster and Emergency Management, for such things as:

- Sending warnings and emergency instructions to the public.

- Receiving help requests and incident reports from the public.

- Engaging with the public, encouraging preparedness, providing information.

- Detecting incidents not directly reported. f

==Map Feeds==
This project allows the user to add layers of Geo-tagged data from Twitter onto the Map. It searches for tweets with specific keywords (that can be configured by user on Sahana web page). It then plots the location of these tweets on the Map. This is the work that we have done as a part of our project implementation. The following steps are involved in this:

After setting up Eden in the system twitterSearch library(https://pypi.python.org/pypi/TwitterSearch/) is to be installed which helps to fetch the tweets with specific keywords

'''Searching Tweets'''

- Configuring twitter account:

Sign into https://dev.twitter.com and create an app. (Select an application Type: Client). Put the Callback URL as blank and create your own Twitter application. After creating an app on twitter account, you will be able to see a tab called OAuth tool. Open eden/models/000_config.py file. Under Twitter Settings, add consumer_key and consumer_secret obtained from the twitter app's OAuth tool. Edit the following lines in 000_config.py
settings.msg.twitter_oauth_consumer_key = "<consumer key from twitter app>"
settings.msg.twiiter_oauth_consumer_secret = "<consumer_secret from twitter app>"

- Add keywords to be searched:

Go to a page eden/msg/twitter_search. You can add keywords / search queries records under this page. It will ask you for a PIN to enter before saving the keywords/queries. The pin is obtained from Twitter app that was created.

- Populating database with search results:

After saving the keywords/ queries, click on Results which triggers the search and msg_twitter_search_results table in the database gets populated.

'''Processing Tweets'''

After fetching the twitter feeds, the Geo-tagged tweets are processed. They are parsed to fetch user information, tweet data and location information in terms of latitude and longitude. All this information then goes into the msg_twitter_search_results table.

1) After fetching the twitter feeds, to process the geo-tagged data in tweets and store in a different table with a foreign key reference in twitter search result table.

2) To display the tweets on a map, for which we a new layer “Twitter” is added under the overlays section on map page.

3) To display the twitter search result in “Summary View”. The Summary view provides a consolidate view about the data and provides tabs for Map, Table and Charts.

4) When the tweets are displayed on Map, the data associated with the tweets needs to be displayed.

'''Plotting tweets on Map'''

To display tweets on map, a new layer named "Twitter" is added under the overlays section on the map page. When a user selects this option, the location ids from the msg_twitter_search_results are fetched and a marker is displayed on those locations. Clicking on the marker image displays additional tweet information such as content, time and user info.

==Future Scope==

1. Major limitation is that the twitter search keyword is hard coded.We need to make the code access the msg_twitter_search table and use the keywords stored by the user through the GUI to search and display twitter feeds on the GIS map.

2. Display twitter icon on map instead of the normal location bubble.

3. Work on the pop-up contents. Ideally this would include any photo or video linked in the message (or a URL if it's to a page of text). Actually doing the part within the tweet parsing of following embedded URLs to identify if they're Media would be really useful addition to the parser (there is a commented-out stub).

4. Create a cron job, to search tweets periodically and not only at user's request.

==References==

http://sahanafoundation.org/

http://eden.sahanafoundation.org/

http://eden.sahanafoundation.org/wiki/InstallationGuidelines

http://eden.sahanafoundation.org/wiki/S3

http://eden.sahanafoundation.org/wiki/Book

http://en.flossmanuals.net/sahana-eden/why-sahana-eden/

https://pypi.python.org/pypi/TwitterSearch/

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-30T18:39:22Z

Kspatel6:

==Background==
The Sahana Software Foundation is dedicated to the mission of saving lives by providing information management solutions that enable organizations and communities to better prepare for and respond to disasters. It is an open source software platform which provides a range of solutions for Disaster Management practitioners to help them reduce the impact disasters have on our communities through tracking the needs of the affected populations & coordinating the responding agencies & their resources.It can be accessed from the web or locally from a flash
drive, allowing it to be used in environments with poor internet. Local & Web versions can be configured to synchronize to allow data to be
shared between them. These features are designed to help Disaster Management practitioners to better mitigate, prepare for, respond to and recover from disasters more effectively and efficiently.

Sahana Eden is designed to be rapidly configured and customized to support the diverse business processes used within Disaster Management. Sahana Eden's modular design allows different pieces of functionality to be enabled and disabled as required providing flexible solutions for changing contexts. The application can be configured to secure sensitive information, while also making data which needs to be shared available in a variety of different formats including Microsoft Excel and PDF. To ensure that Sahana Eden is accessible to every country, it can be translated into multiple languages.

==Core modules and outlines==

'''Organization Registry'''

Many diverse organizations are involved in Disaster Management, from responding to disasters to strengthening communities to providing support to people in need. Sahana Eden’s Organization Registry can track what organizations are active in different contexts, providing opportunities for collaboration and coordination.

'''Project Tracking'''

By telling you Who’s Doing What, Where, and When, Sahana Eden provides a valuable tool to help organizations responding to disasters know where the greatest needs are and coordinate with others who are engaged in similar work.

'''Human Resources'''

The most important part of Disaster Management is the people.Whether they are community volunteers or staff working for different organizations, the Human Resources module can help manage the people involved. It will track where they are, what skills they have and help ensure that everyone is effectively engaged with the work that needs to be done. Sahana Eden can also be used to provide a contact list to ensure that the right people can be contacted at the right time.

'''Inventory'''

Whether organizations are supplying basic essentials of life to people
affected by natural disasters or giving communities the tools they
need to restore their livelihoods, Sahana Eden can be used to manage
inventories of items and match requests for items with warehouses
and other facilities which have them available. Operationally, Sahana
Eden can be used to record and automate transactions for sending
and receiving shipments. Sahana Eden can support multiple Catalogs of
Items as well as providing alternative items to ensure more effective
use of supplies. Sahana Eden can be configured to load multiple
catalogs including a generic list of items and/or the IFRC Emergency
Item Catalog.

'''Assets'''

A wide range of assets are needed to respond to disasters, including
vehicles to transport people and relief items, radio equipment to
provide communication where telecommunication infrastructure has
been destroyed, and generators to provide backup power. Sahana
Eden is able to manage assets, track where they are, who they have
been assigned to, and what condition they are in. This ensures that
assets are used effectively and efficiently.

'''Assessments'''

Sahana Eden can be used to collect and analyze information from
assessments to help organizations more effectively plan their disaster
management activities. Different assessment templates can easily be
designed and imported into Sahana Eden to support assessments for
different organizations in different contexts. Data can either be
entered into an interactive web form or imported via an Excel
template.

'''Scenarios and Events'''

To help organizations better plan for disasters, Sahana Eden can be
used to plan for different scenarios, including recording what human
resources, assets, facilities and tasks will be needed to effectively
respond.
When an incident occurs events can be created from a scenario
template to allocate the resources and alert people of the need to
respond.

'''Map'''

Sahana Eden has fully integrated mapping functionality which allows
any location-based data to be visualized on a map. This information
can also be searched using a map-based boundary selection. Maps
provide situational awareness which is essential when either planning to
prepare for or respond to a disaster. Sahana Eden supports many
standard formats for overlaying data on maps from other sources
and Geographical Information Systems (GIS), for example natural
hazard risks, population or weather.

'''Shelter Management'''

When disasters are widespread and result in population displacement,
understanding and tracking the landscape of shelters - and the people
in them - is a critical activity. The Shelter Registry provides
functionality to list and track information on shelters and on the
people arriving and departing. Shelter details include location, services
provided, responsible organization and contacts, demographics, and
needs. In addition, individual person data includes name, age, relatives,
status, health, and many other details to provide a clear understanding
of population demographics within the site.

'''Messaging'''

In the complex domain of Disaster Management, communication is
critical. Sahana Eden provides support for messages to be sent
by Email, SMS, Twitter and Google Talk. Distribution Groups can be set
up to allow messages to be easily sent to many people at once. Users
are able to search for specific information and subscribe to receive
update messages when new information is added.

==Technical Overview==

Because Sahana Eden needs to be accessible to users at remote
locations, including the public, a browser-based solution was essential.
The system also needs to be able to be used on offline laptops, so it
needs to run on a lightweight stack.

Python was selected as a suitable high level language allowing the rapid
customization of code required for each individual circumstance yet
has a large number of powerful libraries available including for
Geospatial Information Systems (GIS).

'''Shana Eden Framework'''

The Sahana Eden Software Platform has been built around a Rapid
Application Development (RAD) Framework. This provides a high level
of automation to ensure that new solutions can be quickly and
effectively developed. Once a database table is defined, the Sahana
Eden Framework automatically generates HTML pages to handle CRUD
(Create, Read, Update, Delete) as well as Search, Map and Pivot
Reports. Web Services are available to import and export in XML, CSV,
JSON and EXtensible Stylesheet Language (XSL) transforms are
supported to produce other data standards.

'''Sahana Eden Architecture'''

Web Server: Apache. Other web servers can also be used,such as Cherokee.

Application: Sahana Eden

Web Application Framework: Web2Py

Programming Language: Python & JavaScript

Database: MySQL,PostgreSQL, or MySQL, PostgreSQL, and SQLite are supported. Other databases should be usable without major additional work
since Web2Py supplies many connectors.

Operating System: Linux (Debian recommended),Windows and Mac OS X are possible, but only recommended for single-user environments.

'''Installation'''

Sahana Eden can be installed on any environment which can run
Python, including Linux, Windows and OSX. The system supports a
number of different databases and has been widely tested on MySQL,
PostgreSQL and SQLite. A webserver is optional, but for production
installations we have experience of both Apache/mod_wsgi and
Cherokee/uwsgi.

Installation scripts and detailed instructions are available on the Wiki:
http://eden.sahanafoundation.org/wiki/InstallationGuidelines

'''Web2py'''

This is an MVC environment (like Rails & Django.).
Web2Py can work at several different levels of abstraction.
The Sahana Eden framework (S3) is built on Web2Py's Auth/Crud classes in tools.py (with some remnants of the older T2), however sometimes we need more control therefore need to drop down a level or two.
Can execute a controller to be able to access its functions using:
execfile("applications/eden/controllers/mycontroller.py", globals())

'''S3'''

The Sahana Eden framework (S3) is built on Web2Py and It is used for RAD in all the sahana applications. The Sahana api docs can be found at http://eden.sahanafoundation.org/wiki/DeveloperGuidelines

'''Directory Structure'''

After the installation, the typical directory structure of the instance
looks like:
[[Application_structure.png]]

==Social Media==
Social Media is playing a important role in Disaster and Emergency Management, for such things as:

- Sending warnings and emergency instructions to the public.

- Receiving help requests and incident reports from the public.

- Engaging with the public, encouraging preparedness, providing information.

- Detecting incidents not directly reported. f

==Map Feeds==
This project allows the user to add layers of Geo-tagged data from Twitter onto the Map. It searches for tweets with specific keywords (that can be configured by user on Sahana web page). It then plots the location of these tweets on the Map. This is the work that we have done as a part of our project implementation. The following steps are involved in this:

After setting up Eden in the system twitterSearch library(https://pypi.python.org/pypi/TwitterSearch/) is to be installed which helps to fetch the tweets with specific keywords

'''Searching Tweets'''

- Configuring twitter account:

Sign into https://dev.twitter.com and create an app. (Select an application Type: Client). Put the Callback URL as blank and create your own Twitter application. After creating an app on twitter account, you will be able to see a tab called OAuth tool. Open eden/models/000_config.py file. Under Twitter Settings, add consumer_key and consumer_secret obtained from the twitter app's OAuth tool. Edit the following lines in 000_config.py
settings.msg.twitter_oauth_consumer_key = "<consumer key from twitter app>"
settings.msg.twiiter_oauth_consumer_secret = "<consumer_secret from twitter app>"

- Add keywords to be searched:

Go to a page eden/msg/twitter_search. You can add keywords / search queries records under this page. It will ask you for a PIN to enter before saving the keywords/queries. The pin is obtained from Twitter app that was created.

- Populating database with search results:

After saving the keywords/ queries, click on Results which triggers the search and msg_twitter_search_results table in the database gets populated.

'''Processing Tweets'''

After fetching the twitter feeds, the Geo-tagged tweets are processed. They are parsed to fetch user information, tweet data and location information in terms of latitude and longitude. All this information then goes into the msg_twitter_search_results table.

1) After fetching the twitter feeds, to process the geo-tagged data in tweets and store in a different table with a foreign key reference in twitter search result table.
2) To display the tweets on a map, for which we a new layer “Twitter” is added under the overlays section on map page.
3) To display the twitter search result in “Summary View”. The Summary view provides a consolidate view about the data and provides tabs for Map, Table and Charts.
4) When the tweets are displayed on Map, the data associated with the tweets needs to be displayed.

'''Plotting tweets on Map'''

To display tweets on map, a new layer named "Twitter" is added under the overlays section on the map page. When a user selects this option, the location ids from the msg_twitter_search_results are fetched and a marker is displayed on those locations. Clicking on the marker image displays additional tweet information such as content, time and user info.

==Future Scope==

1. Major limitation is that the twitter search keyword is hard coded.We need to make the code access the msg_twitter_search table and use the keywords stored by the user through the GUI to search and display twitter feeds on the GIS map.

2. Display twitter icon on map instead of the normal location bubble.

3. Work on the pop-up contents. Ideally this would include any photo or video linked in the message (or a URL if it's to a page of text). Actually doing the part within the tweet parsing of following embedded URLs to identify if they're Media would be really useful addition to the parser (there is a commented-out stub).

4. Create a cron job, to search tweets periodically and not only at user's request.

==References==

http://sahanafoundation.org/

http://eden.sahanafoundation.org/

http://eden.sahanafoundation.org/wiki/InstallationGuidelines

http://eden.sahanafoundation.org/wiki/S3

http://eden.sahanafoundation.org/wiki/Book

http://en.flossmanuals.net/sahana-eden/why-sahana-eden/

https://pypi.python.org/pypi/TwitterSearch/

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T20:32:43Z

Kspatel6: /* References */

==Background==
The Sahana Software Foundation is dedicated to the mission of saving lives by providing information management solutions that enable organizations and communities to better prepare for and respond to disasters. It is an open source software platform which provides a range of solutions for Disaster Management practitioners to help them reduce the impact disasters have on our communities through tracking the needs of the affected populations & coordinating the responding agencies & their resources.It can be accessed from the web or locally from a flash
drive, allowing it to be used in environments with poor internet. Local & Web versions can be configured to synchronize to allow data to be
shared between them. These features are designed to help Disaster Management practitioners to better mitigate, prepare for, respond to and recover from disasters more effectively and efficiently.

Sahana Eden is designed to be rapidly configured and customized to support the diverse business processes used within Disaster Management. Sahana Eden's modular design allows different pieces of functionality to be enabled and disabled as required providing flexible solutions for changing contexts. The application can be configured to secure sensitive information, while also making data which needs to be shared available in a variety of different formats including Microsoft Excel and PDF. To ensure that Sahana Eden is accessible to every country, it can be translated into multiple languages.

==Core modules and outlines==

'''Organization Registry'''

Many diverse organizations are involved in Disaster Management, from responding to disasters to strengthening communities to providing support to people in need. Sahana Eden’s Organization Registry can track what organizations are active in different contexts, providing opportunities for collaboration and coordination.

'''Project Tracking'''

By telling you Who’s Doing What, Where, and When, Sahana Eden provides a valuable tool to help organizations responding to disasters know where the greatest needs are and coordinate with others who are engaged in similar work.

'''Human Resources'''

The most important part of Disaster Management is the people.Whether they are community volunteers or staff working for different organizations, the Human Resources module can help manage the people involved. It will track where they are, what skills they have and help ensure that everyone is effectively engaged with the work that needs to be done. Sahana Eden can also be used to provide a contact list to ensure that the right people can be contacted at the right time.

'''Inventory'''

Whether organizations are supplying basic essentials of life to people
affected by natural disasters or giving communities the tools they
need to restore their livelihoods, Sahana Eden can be used to manage
inventories of items and match requests for items with warehouses
and other facilities which have them available. Operationally, Sahana
Eden can be used to record and automate transactions for sending
and receiving shipments. Sahana Eden can support multiple Catalogs of
Items as well as providing alternative items to ensure more effective
use of supplies. Sahana Eden can be configured to load multiple
catalogs including a generic list of items and/or the IFRC Emergency
Item Catalog.

'''Assets'''

A wide range of assets are needed to respond to disasters, including
vehicles to transport people and relief items, radio equipment to
provide communication where telecommunication infrastructure has
been destroyed, and generators to provide backup power. Sahana
Eden is able to manage assets, track where they are, who they have
been assigned to, and what condition they are in. This ensures that
assets are used effectively and efficiently.

'''Assessments'''

Sahana Eden can be used to collect and analyze information from
assessments to help organizations more effectively plan their disaster
management activities. Different assessment templates can easily be
designed and imported into Sahana Eden to support assessments for
different organizations in different contexts. Data can either be
entered into an interactive web form or imported via an Excel
template.

'''Scenarios and Events'''

To help organizations better plan for disasters, Sahana Eden can be
used to plan for different scenarios, including recording what human
resources, assets, facilities and tasks will be needed to effectively
respond.
When an incident occurs events can be created from a scenario
template to allocate the resources and alert people of the need to
respond.

'''Map'''

Sahana Eden has fully integrated mapping functionality which allows
any location-based data to be visualized on a map. This information
can also be searched using a map-based boundary selection. Maps
provide situational awareness which is essential when either planning to
prepare for or respond to a disaster. Sahana Eden supports many
standard formats for overlaying data on maps from other sources
and Geographical Information Systems (GIS), for example natural
hazard risks, population or weather.

'''Shelter Management'''

When disasters are widespread and result in population displacement,
understanding and tracking the landscape of shelters - and the people
in them - is a critical activity. The Shelter Registry provides
functionality to list and track information on shelters and on the
people arriving and departing. Shelter details include location, services
provided, responsible organization and contacts, demographics, and
needs. In addition, individual person data includes name, age, relatives,
status, health, and many other details to provide a clear understanding
of population demographics within the site.

'''Messaging'''

In the complex domain of Disaster Management, communication is
critical. Sahana Eden provides support for messages to be sent
by Email, SMS, Twitter and Google Talk. Distribution Groups can be set
up to allow messages to be easily sent to many people at once. Users
are able to search for specific information and subscribe to receive
update messages when new information is added.

==Technical Overview==

Because Sahana Eden needs to be accessible to users at remote
locations, including the public, a browser-based solution was essential.
The system also needs to be able to be used on offline laptops, so it
needs to run on a lightweight stack.

Python was selected as a suitable high level language allowing the rapid
customization of code required for each individual circumstance yet
has a large number of powerful libraries available including for
Geospatial Information Systems (GIS).

'''Shana Eden Framework'''

The Sahana Eden Software Platform has been built around a Rapid
Application Development (RAD) Framework. This provides a high level
of automation to ensure that new solutions can be quickly and
effectively developed. Once a database table is defined, the Sahana
Eden Framework automatically generates HTML pages to handle CRUD
(Create, Read, Update, Delete) as well as Search, Map and Pivot
Reports. Web Services are available to import and export in XML, CSV,
JSON and EXtensible Stylesheet Language (XSL) transforms are
supported to produce other data standards.

'''Sahana Eden Architecture'''

Web Server: Apache. Other web servers can also be used,such as Cherokee.

Application: Sahana Eden

Web Application Framework: Web2Py

Programming Language: Python & JavaScript

Database: MySQL,PostgreSQL, or MySQL, PostgreSQL, and SQLite are supported. Other databases should be usable without major additional work
since Web2Py supplies many connectors.

Operating System: Linux (Debian recommended),Windows and Mac OS X are possible, but only recommended for single-user environments.

'''Installation'''

Sahana Eden can be installed on any environment which can run
Python, including Linux, Windows and OSX. The system supports a
number of different databases and has been widely tested on MySQL,
PostgreSQL and SQLite. A webserver is optional, but for production
installations we have experience of both Apache/mod_wsgi and
Cherokee/uwsgi.

Installation scripts and detailed instructions are available on the Wiki:
http://eden.sahanafoundation.org/wiki/InstallationGuidelines

'''Web2py'''

This is an MVC environment (like Rails & Django.).
Web2Py can work at several different levels of abstraction.
The Sahana Eden framework (S3) is built on Web2Py's Auth/Crud classes in tools.py (with some remnants of the older T2), however sometimes we need more control therefore need to drop down a level or two.
Can execute a controller to be able to access its functions using:
execfile("applications/eden/controllers/mycontroller.py", globals())

'''S3'''

The Sahana Eden framework (S3) is built on Web2Py and It is used for RAD in all the sahana applications. The Sahana api docs can be found at http://eden.sahanafoundation.org/wiki/DeveloperGuidelines

'''Directory Structure'''

After the installation, the typical directory structure of the instance
looks like:
[[Application_structure.png]]

==Social Media==
Social Media is playing a important role in Disaster and Emergency Management, for such things as:

- Sending warnings and emergency instructions to the public.

- Receiving help requests and incident reports from the public.

- Engaging with the public, encouraging preparedness, providing information.

- Detecting incidents not directly reported. f

==Map Feeds==
This project allows the user to add layers of Geo-tagged data from Twitter onto the Map. It searches for tweets with specific keywords (that can be configured by user on Sahana web page). It then plots the location of these tweets on the Map. This is the work that we have done as a part of our project implementation. The following steps are involved in this:

After setting up Eden in the system twitterSearch library(https://pypi.python.org/pypi/TwitterSearch/) is to be installed which helps to fetch the tweets with specific keywords

'''Searching Tweets'''

- Configuring twitter account:

Sign into https://dev.twitter.com and create an app. (Select an application Type: Client). Put the Callback URL as blank and create your own Twitter application. After creating an app on twitter account, you will be able to see a tab called OAuth tool. Open eden/models/000_config.py file. Under Twitter Settings, add consumer_key and consumer_secret obtained from the twitter app's OAuth tool. Edit the following lines in 000_config.py
settings.msg.twitter_oauth_consumer_key = "<consumer key from twitter app>"
settings.msg.twiiter_oauth_consumer_secret = "<consumer_secret from twitter app>"

- Add keywords to be searched:

Go to a page eden/msg/twitter_search. You can add keywords / search queries records under this page. It will ask you for a PIN to enter before saving the keywords/queries. The pin is obtained from Twitter app that was created.

- Populating database with search results:

After saving the keywords/ queries, click on Results which triggers the search and msg_twitter_search_results table in the database gets populated.

'''Processing Tweets'''

After fetching the twitter feeds, the Geo-tagged tweets are processed. They are parsed to fetch user information, tweet data and location information in terms of latitude and longitude. All this information then goes into the msg_twitter_search_results table.

'''Plotting tweets on Map'''

To display tweets on map, a new layer named "Twitter" is added under the overlays section on the map page. When a user selects this option, the location ids from the msg_twitter_search_results are fetched and a marker is displayed on those locations. Clicking on the marker image displays additional tweet information such as content, time and user info.

==Future Scope==

1. Major limitation is that the twitter search keyword is hard coded.We need to make the code access the msg_twitter_search table and use the keywords stored by the user through the GUI to search and display twitter feeds on the GIS map.

2. Display twitter icon on map instead of the normal location bubble.

3. Work on the pop-up contents. Ideally this would include any photo or video linked in the message (or a URL if it's to a page of text). Actually doing the part within the tweet parsing of following embedded URLs to identify if they're Media would be really useful addition to the parser (there is a commented-out stub).

4. Create a cron job, to search tweets periodically and not only at user's request.

==References==

http://sahanafoundation.org/

http://eden.sahanafoundation.org/

http://eden.sahanafoundation.org/wiki/InstallationGuidelines

http://eden.sahanafoundation.org/wiki/S3

http://eden.sahanafoundation.org/wiki/Book

http://en.flossmanuals.net/sahana-eden/why-sahana-eden/

https://pypi.python.org/pypi/TwitterSearch/

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T20:32:19Z

Kspatel6: /* References */

==Background==
The Sahana Software Foundation is dedicated to the mission of saving lives by providing information management solutions that enable organizations and communities to better prepare for and respond to disasters. It is an open source software platform which provides a range of solutions for Disaster Management practitioners to help them reduce the impact disasters have on our communities through tracking the needs of the affected populations & coordinating the responding agencies & their resources.It can be accessed from the web or locally from a flash
drive, allowing it to be used in environments with poor internet. Local & Web versions can be configured to synchronize to allow data to be
shared between them. These features are designed to help Disaster Management practitioners to better mitigate, prepare for, respond to and recover from disasters more effectively and efficiently.

Sahana Eden is designed to be rapidly configured and customized to support the diverse business processes used within Disaster Management. Sahana Eden's modular design allows different pieces of functionality to be enabled and disabled as required providing flexible solutions for changing contexts. The application can be configured to secure sensitive information, while also making data which needs to be shared available in a variety of different formats including Microsoft Excel and PDF. To ensure that Sahana Eden is accessible to every country, it can be translated into multiple languages.

==Core modules and outlines==

'''Organization Registry'''

Many diverse organizations are involved in Disaster Management, from responding to disasters to strengthening communities to providing support to people in need. Sahana Eden’s Organization Registry can track what organizations are active in different contexts, providing opportunities for collaboration and coordination.

'''Project Tracking'''

By telling you Who’s Doing What, Where, and When, Sahana Eden provides a valuable tool to help organizations responding to disasters know where the greatest needs are and coordinate with others who are engaged in similar work.

'''Human Resources'''

The most important part of Disaster Management is the people.Whether they are community volunteers or staff working for different organizations, the Human Resources module can help manage the people involved. It will track where they are, what skills they have and help ensure that everyone is effectively engaged with the work that needs to be done. Sahana Eden can also be used to provide a contact list to ensure that the right people can be contacted at the right time.

'''Inventory'''

Whether organizations are supplying basic essentials of life to people
affected by natural disasters or giving communities the tools they
need to restore their livelihoods, Sahana Eden can be used to manage
inventories of items and match requests for items with warehouses
and other facilities which have them available. Operationally, Sahana
Eden can be used to record and automate transactions for sending
and receiving shipments. Sahana Eden can support multiple Catalogs of
Items as well as providing alternative items to ensure more effective
use of supplies. Sahana Eden can be configured to load multiple
catalogs including a generic list of items and/or the IFRC Emergency
Item Catalog.

'''Assets'''

A wide range of assets are needed to respond to disasters, including
vehicles to transport people and relief items, radio equipment to
provide communication where telecommunication infrastructure has
been destroyed, and generators to provide backup power. Sahana
Eden is able to manage assets, track where they are, who they have
been assigned to, and what condition they are in. This ensures that
assets are used effectively and efficiently.

'''Assessments'''

Sahana Eden can be used to collect and analyze information from
assessments to help organizations more effectively plan their disaster
management activities. Different assessment templates can easily be
designed and imported into Sahana Eden to support assessments for
different organizations in different contexts. Data can either be
entered into an interactive web form or imported via an Excel
template.

'''Scenarios and Events'''

To help organizations better plan for disasters, Sahana Eden can be
used to plan for different scenarios, including recording what human
resources, assets, facilities and tasks will be needed to effectively
respond.
When an incident occurs events can be created from a scenario
template to allocate the resources and alert people of the need to
respond.

'''Map'''

Sahana Eden has fully integrated mapping functionality which allows
any location-based data to be visualized on a map. This information
can also be searched using a map-based boundary selection. Maps
provide situational awareness which is essential when either planning to
prepare for or respond to a disaster. Sahana Eden supports many
standard formats for overlaying data on maps from other sources
and Geographical Information Systems (GIS), for example natural
hazard risks, population or weather.

'''Shelter Management'''

When disasters are widespread and result in population displacement,
understanding and tracking the landscape of shelters - and the people
in them - is a critical activity. The Shelter Registry provides
functionality to list and track information on shelters and on the
people arriving and departing. Shelter details include location, services
provided, responsible organization and contacts, demographics, and
needs. In addition, individual person data includes name, age, relatives,
status, health, and many other details to provide a clear understanding
of population demographics within the site.

'''Messaging'''

In the complex domain of Disaster Management, communication is
critical. Sahana Eden provides support for messages to be sent
by Email, SMS, Twitter and Google Talk. Distribution Groups can be set
up to allow messages to be easily sent to many people at once. Users
are able to search for specific information and subscribe to receive
update messages when new information is added.

==Technical Overview==

Because Sahana Eden needs to be accessible to users at remote
locations, including the public, a browser-based solution was essential.
The system also needs to be able to be used on offline laptops, so it
needs to run on a lightweight stack.

Python was selected as a suitable high level language allowing the rapid
customization of code required for each individual circumstance yet
has a large number of powerful libraries available including for
Geospatial Information Systems (GIS).

'''Shana Eden Framework'''

The Sahana Eden Software Platform has been built around a Rapid
Application Development (RAD) Framework. This provides a high level
of automation to ensure that new solutions can be quickly and
effectively developed. Once a database table is defined, the Sahana
Eden Framework automatically generates HTML pages to handle CRUD
(Create, Read, Update, Delete) as well as Search, Map and Pivot
Reports. Web Services are available to import and export in XML, CSV,
JSON and EXtensible Stylesheet Language (XSL) transforms are
supported to produce other data standards.

'''Sahana Eden Architecture'''

Web Server: Apache. Other web servers can also be used,such as Cherokee.

Application: Sahana Eden

Web Application Framework: Web2Py

Programming Language: Python & JavaScript

Database: MySQL,PostgreSQL, or MySQL, PostgreSQL, and SQLite are supported. Other databases should be usable without major additional work
since Web2Py supplies many connectors.

Operating System: Linux (Debian recommended),Windows and Mac OS X are possible, but only recommended for single-user environments.

'''Installation'''

Sahana Eden can be installed on any environment which can run
Python, including Linux, Windows and OSX. The system supports a
number of different databases and has been widely tested on MySQL,
PostgreSQL and SQLite. A webserver is optional, but for production
installations we have experience of both Apache/mod_wsgi and
Cherokee/uwsgi.

Installation scripts and detailed instructions are available on the Wiki:
http://eden.sahanafoundation.org/wiki/InstallationGuidelines

'''Web2py'''

This is an MVC environment (like Rails & Django.).
Web2Py can work at several different levels of abstraction.
The Sahana Eden framework (S3) is built on Web2Py's Auth/Crud classes in tools.py (with some remnants of the older T2), however sometimes we need more control therefore need to drop down a level or two.
Can execute a controller to be able to access its functions using:
execfile("applications/eden/controllers/mycontroller.py", globals())

'''S3'''

The Sahana Eden framework (S3) is built on Web2Py and It is used for RAD in all the sahana applications. The Sahana api docs can be found at http://eden.sahanafoundation.org/wiki/DeveloperGuidelines

'''Directory Structure'''

After the installation, the typical directory structure of the instance
looks like:
[[Application_structure.png]]

==Social Media==
Social Media is playing a important role in Disaster and Emergency Management, for such things as:

- Sending warnings and emergency instructions to the public.

- Receiving help requests and incident reports from the public.

- Engaging with the public, encouraging preparedness, providing information.

- Detecting incidents not directly reported. f

==Map Feeds==
This project allows the user to add layers of Geo-tagged data from Twitter onto the Map. It searches for tweets with specific keywords (that can be configured by user on Sahana web page). It then plots the location of these tweets on the Map. This is the work that we have done as a part of our project implementation. The following steps are involved in this:

After setting up Eden in the system twitterSearch library(https://pypi.python.org/pypi/TwitterSearch/) is to be installed which helps to fetch the tweets with specific keywords

'''Searching Tweets'''

- Configuring twitter account:

Sign into https://dev.twitter.com and create an app. (Select an application Type: Client). Put the Callback URL as blank and create your own Twitter application. After creating an app on twitter account, you will be able to see a tab called OAuth tool. Open eden/models/000_config.py file. Under Twitter Settings, add consumer_key and consumer_secret obtained from the twitter app's OAuth tool. Edit the following lines in 000_config.py
settings.msg.twitter_oauth_consumer_key = "<consumer key from twitter app>"
settings.msg.twiiter_oauth_consumer_secret = "<consumer_secret from twitter app>"

- Add keywords to be searched:

Go to a page eden/msg/twitter_search. You can add keywords / search queries records under this page. It will ask you for a PIN to enter before saving the keywords/queries. The pin is obtained from Twitter app that was created.

- Populating database with search results:

After saving the keywords/ queries, click on Results which triggers the search and msg_twitter_search_results table in the database gets populated.

'''Processing Tweets'''

After fetching the twitter feeds, the Geo-tagged tweets are processed. They are parsed to fetch user information, tweet data and location information in terms of latitude and longitude. All this information then goes into the msg_twitter_search_results table.

'''Plotting tweets on Map'''

To display tweets on map, a new layer named "Twitter" is added under the overlays section on the map page. When a user selects this option, the location ids from the msg_twitter_search_results are fetched and a marker is displayed on those locations. Clicking on the marker image displays additional tweet information such as content, time and user info.

==Future Scope==

1. Major limitation is that the twitter search keyword is hard coded.We need to make the code access the msg_twitter_search table and use the keywords stored by the user through the GUI to search and display twitter feeds on the GIS map.

2. Display twitter icon on map instead of the normal location bubble.

3. Work on the pop-up contents. Ideally this would include any photo or video linked in the message (or a URL if it's to a page of text). Actually doing the part within the tweet parsing of following embedded URLs to identify if they're Media would be really useful addition to the parser (there is a commented-out stub).

4. Create a cron job, to search tweets periodically and not only at user's request.

==References==

http://sahanafoundation.org/
http://eden.sahanafoundation.org/
http://eden.sahanafoundation.org/wiki/InstallationGuidelines
http://eden.sahanafoundation.org/wiki/S3
http://eden.sahanafoundation.org/wiki/Book
http://en.flossmanuals.net/sahana-eden/why-sahana-eden/
https://pypi.python.org/pypi/TwitterSearch/

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T20:25:49Z

Kspatel6: /* Map Feeds */

==Background==
The Sahana Software Foundation is dedicated to the mission of saving lives by providing information management solutions that enable organizations and communities to better prepare for and respond to disasters. It is an open source software platform which provides a range of solutions for Disaster Management practitioners to help them reduce the impact disasters have on our communities through tracking the needs of the affected populations & coordinating the responding agencies & their resources.It can be accessed from the web or locally from a flash
drive, allowing it to be used in environments with poor internet. Local & Web versions can be configured to synchronize to allow data to be
shared between them. These features are designed to help Disaster Management practitioners to better mitigate, prepare for, respond to and recover from disasters more effectively and efficiently.

Sahana Eden is designed to be rapidly configured and customized to support the diverse business processes used within Disaster Management. Sahana Eden's modular design allows different pieces of functionality to be enabled and disabled as required providing flexible solutions for changing contexts. The application can be configured to secure sensitive information, while also making data which needs to be shared available in a variety of different formats including Microsoft Excel and PDF. To ensure that Sahana Eden is accessible to every country, it can be translated into multiple languages.

==Core modules and outlines==

'''Organization Registry'''

Many diverse organizations are involved in Disaster Management, from responding to disasters to strengthening communities to providing support to people in need. Sahana Eden’s Organization Registry can track what organizations are active in different contexts, providing opportunities for collaboration and coordination.

'''Project Tracking'''

By telling you Who’s Doing What, Where, and When, Sahana Eden provides a valuable tool to help organizations responding to disasters know where the greatest needs are and coordinate with others who are engaged in similar work.

'''Human Resources'''

The most important part of Disaster Management is the people.Whether they are community volunteers or staff working for different organizations, the Human Resources module can help manage the people involved. It will track where they are, what skills they have and help ensure that everyone is effectively engaged with the work that needs to be done. Sahana Eden can also be used to provide a contact list to ensure that the right people can be contacted at the right time.

'''Inventory'''

Whether organizations are supplying basic essentials of life to people
affected by natural disasters or giving communities the tools they
need to restore their livelihoods, Sahana Eden can be used to manage
inventories of items and match requests for items with warehouses
and other facilities which have them available. Operationally, Sahana
Eden can be used to record and automate transactions for sending
and receiving shipments. Sahana Eden can support multiple Catalogs of
Items as well as providing alternative items to ensure more effective
use of supplies. Sahana Eden can be configured to load multiple
catalogs including a generic list of items and/or the IFRC Emergency
Item Catalog.

'''Assets'''

A wide range of assets are needed to respond to disasters, including
vehicles to transport people and relief items, radio equipment to
provide communication where telecommunication infrastructure has
been destroyed, and generators to provide backup power. Sahana
Eden is able to manage assets, track where they are, who they have
been assigned to, and what condition they are in. This ensures that
assets are used effectively and efficiently.

'''Assessments'''

Sahana Eden can be used to collect and analyze information from
assessments to help organizations more effectively plan their disaster
management activities. Different assessment templates can easily be
designed and imported into Sahana Eden to support assessments for
different organizations in different contexts. Data can either be
entered into an interactive web form or imported via an Excel
template.

'''Scenarios and Events'''

To help organizations better plan for disasters, Sahana Eden can be
used to plan for different scenarios, including recording what human
resources, assets, facilities and tasks will be needed to effectively
respond.
When an incident occurs events can be created from a scenario
template to allocate the resources and alert people of the need to
respond.

'''Map'''

Sahana Eden has fully integrated mapping functionality which allows
any location-based data to be visualized on a map. This information
can also be searched using a map-based boundary selection. Maps
provide situational awareness which is essential when either planning to
prepare for or respond to a disaster. Sahana Eden supports many
standard formats for overlaying data on maps from other sources
and Geographical Information Systems (GIS), for example natural
hazard risks, population or weather.

'''Shelter Management'''

When disasters are widespread and result in population displacement,
understanding and tracking the landscape of shelters - and the people
in them - is a critical activity. The Shelter Registry provides
functionality to list and track information on shelters and on the
people arriving and departing. Shelter details include location, services
provided, responsible organization and contacts, demographics, and
needs. In addition, individual person data includes name, age, relatives,
status, health, and many other details to provide a clear understanding
of population demographics within the site.

'''Messaging'''

In the complex domain of Disaster Management, communication is
critical. Sahana Eden provides support for messages to be sent
by Email, SMS, Twitter and Google Talk. Distribution Groups can be set
up to allow messages to be easily sent to many people at once. Users
are able to search for specific information and subscribe to receive
update messages when new information is added.

==Technical Overview==

Because Sahana Eden needs to be accessible to users at remote
locations, including the public, a browser-based solution was essential.
The system also needs to be able to be used on offline laptops, so it
needs to run on a lightweight stack.

Python was selected as a suitable high level language allowing the rapid
customization of code required for each individual circumstance yet
has a large number of powerful libraries available including for
Geospatial Information Systems (GIS).

'''Shana Eden Framework'''

The Sahana Eden Software Platform has been built around a Rapid
Application Development (RAD) Framework. This provides a high level
of automation to ensure that new solutions can be quickly and
effectively developed. Once a database table is defined, the Sahana
Eden Framework automatically generates HTML pages to handle CRUD
(Create, Read, Update, Delete) as well as Search, Map and Pivot
Reports. Web Services are available to import and export in XML, CSV,
JSON and EXtensible Stylesheet Language (XSL) transforms are
supported to produce other data standards.

'''Sahana Eden Architecture'''

Web Server: Apache. Other web servers can also be used,such as Cherokee.

Application: Sahana Eden

Web Application Framework: Web2Py

Programming Language: Python & JavaScript

Database: MySQL,PostgreSQL, or MySQL, PostgreSQL, and SQLite are supported. Other databases should be usable without major additional work
since Web2Py supplies many connectors.

Operating System: Linux (Debian recommended),Windows and Mac OS X are possible, but only recommended for single-user environments.

'''Installation'''

Sahana Eden can be installed on any environment which can run
Python, including Linux, Windows and OSX. The system supports a
number of different databases and has been widely tested on MySQL,
PostgreSQL and SQLite. A webserver is optional, but for production
installations we have experience of both Apache/mod_wsgi and
Cherokee/uwsgi.

Installation scripts and detailed instructions are available on the Wiki:
http://eden.sahanafoundation.org/wiki/InstallationGuidelines

'''Web2py'''

This is an MVC environment (like Rails & Django.).
Web2Py can work at several different levels of abstraction.
The Sahana Eden framework (S3) is built on Web2Py's Auth/Crud classes in tools.py (with some remnants of the older T2), however sometimes we need more control therefore need to drop down a level or two.
Can execute a controller to be able to access its functions using:
execfile("applications/eden/controllers/mycontroller.py", globals())

'''S3'''

The Sahana Eden framework (S3) is built on Web2Py and It is used for RAD in all the sahana applications. The Sahana api docs can be found at http://eden.sahanafoundation.org/wiki/DeveloperGuidelines

'''Directory Structure'''

After the installation, the typical directory structure of the instance
looks like:
[[Application_structure.png]]

==Social Media==
Social Media is playing a important role in Disaster and Emergency Management, for such things as:

- Sending warnings and emergency instructions to the public.

- Receiving help requests and incident reports from the public.

- Engaging with the public, encouraging preparedness, providing information.

- Detecting incidents not directly reported. f

==Map Feeds==
This project allows the user to add layers of Geo-tagged data from Twitter onto the Map. It searches for tweets with specific keywords (that can be configured by user on Sahana web page). It then plots the location of these tweets on the Map. This is the work that we have done as a part of our project implementation. The following steps are involved in this:

After setting up Eden in the system twitterSearch library(https://pypi.python.org/pypi/TwitterSearch/) is to be installed which helps to fetch the tweets with specific keywords

'''Searching Tweets'''

- Configuring twitter account:

Sign into https://dev.twitter.com and create an app. (Select an application Type: Client). Put the Callback URL as blank and create your own Twitter application. After creating an app on twitter account, you will be able to see a tab called OAuth tool. Open eden/models/000_config.py file. Under Twitter Settings, add consumer_key and consumer_secret obtained from the twitter app's OAuth tool. Edit the following lines in 000_config.py
settings.msg.twitter_oauth_consumer_key = "<consumer key from twitter app>"
settings.msg.twiiter_oauth_consumer_secret = "<consumer_secret from twitter app>"

- Add keywords to be searched:

Go to a page eden/msg/twitter_search. You can add keywords / search queries records under this page. It will ask you for a PIN to enter before saving the keywords/queries. The pin is obtained from Twitter app that was created.

- Populating database with search results:

After saving the keywords/ queries, click on Results which triggers the search and msg_twitter_search_results table in the database gets populated.

'''Processing Tweets'''

After fetching the twitter feeds, the Geo-tagged tweets are processed. They are parsed to fetch user information, tweet data and location information in terms of latitude and longitude. All this information then goes into the msg_twitter_search_results table.

'''Plotting tweets on Map'''

To display tweets on map, a new layer named "Twitter" is added under the overlays section on the map page. When a user selects this option, the location ids from the msg_twitter_search_results are fetched and a marker is displayed on those locations. Clicking on the marker image displays additional tweet information such as content, time and user info.

==Future Scope==

1. Major limitation is that the twitter search keyword is hard coded.We need to make the code access the msg_twitter_search table and use the keywords stored by the user through the GUI to search and display twitter feeds on the GIS map.

2. Display twitter icon on map instead of the normal location bubble.

3. Work on the pop-up contents. Ideally this would include any photo or video linked in the message (or a URL if it's to a page of text). Actually doing the part within the tweet parsing of following embedded URLs to identify if they're Media would be really useful addition to the parser (there is a commented-out stub).

4. Create a cron job, to search tweets periodically and not only at user's request.

==References==
<references/>

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T20:25:02Z

Kspatel6: /* Map Feeds */

==Background==
The Sahana Software Foundation is dedicated to the mission of saving lives by providing information management solutions that enable organizations and communities to better prepare for and respond to disasters. It is an open source software platform which provides a range of solutions for Disaster Management practitioners to help them reduce the impact disasters have on our communities through tracking the needs of the affected populations & coordinating the responding agencies & their resources.It can be accessed from the web or locally from a flash
drive, allowing it to be used in environments with poor internet. Local & Web versions can be configured to synchronize to allow data to be
shared between them. These features are designed to help Disaster Management practitioners to better mitigate, prepare for, respond to and recover from disasters more effectively and efficiently.

Sahana Eden is designed to be rapidly configured and customized to support the diverse business processes used within Disaster Management. Sahana Eden's modular design allows different pieces of functionality to be enabled and disabled as required providing flexible solutions for changing contexts. The application can be configured to secure sensitive information, while also making data which needs to be shared available in a variety of different formats including Microsoft Excel and PDF. To ensure that Sahana Eden is accessible to every country, it can be translated into multiple languages.

==Core modules and outlines==

'''Organization Registry'''

Many diverse organizations are involved in Disaster Management, from responding to disasters to strengthening communities to providing support to people in need. Sahana Eden’s Organization Registry can track what organizations are active in different contexts, providing opportunities for collaboration and coordination.

'''Project Tracking'''

By telling you Who’s Doing What, Where, and When, Sahana Eden provides a valuable tool to help organizations responding to disasters know where the greatest needs are and coordinate with others who are engaged in similar work.

'''Human Resources'''

The most important part of Disaster Management is the people.Whether they are community volunteers or staff working for different organizations, the Human Resources module can help manage the people involved. It will track where they are, what skills they have and help ensure that everyone is effectively engaged with the work that needs to be done. Sahana Eden can also be used to provide a contact list to ensure that the right people can be contacted at the right time.

'''Inventory'''

Whether organizations are supplying basic essentials of life to people
affected by natural disasters or giving communities the tools they
need to restore their livelihoods, Sahana Eden can be used to manage
inventories of items and match requests for items with warehouses
and other facilities which have them available. Operationally, Sahana
Eden can be used to record and automate transactions for sending
and receiving shipments. Sahana Eden can support multiple Catalogs of
Items as well as providing alternative items to ensure more effective
use of supplies. Sahana Eden can be configured to load multiple
catalogs including a generic list of items and/or the IFRC Emergency
Item Catalog.

'''Assets'''

A wide range of assets are needed to respond to disasters, including
vehicles to transport people and relief items, radio equipment to
provide communication where telecommunication infrastructure has
been destroyed, and generators to provide backup power. Sahana
Eden is able to manage assets, track where they are, who they have
been assigned to, and what condition they are in. This ensures that
assets are used effectively and efficiently.

'''Assessments'''

Sahana Eden can be used to collect and analyze information from
assessments to help organizations more effectively plan their disaster
management activities. Different assessment templates can easily be
designed and imported into Sahana Eden to support assessments for
different organizations in different contexts. Data can either be
entered into an interactive web form or imported via an Excel
template.

'''Scenarios and Events'''

To help organizations better plan for disasters, Sahana Eden can be
used to plan for different scenarios, including recording what human
resources, assets, facilities and tasks will be needed to effectively
respond.
When an incident occurs events can be created from a scenario
template to allocate the resources and alert people of the need to
respond.

'''Map'''

Sahana Eden has fully integrated mapping functionality which allows
any location-based data to be visualized on a map. This information
can also be searched using a map-based boundary selection. Maps
provide situational awareness which is essential when either planning to
prepare for or respond to a disaster. Sahana Eden supports many
standard formats for overlaying data on maps from other sources
and Geographical Information Systems (GIS), for example natural
hazard risks, population or weather.

'''Shelter Management'''

When disasters are widespread and result in population displacement,
understanding and tracking the landscape of shelters - and the people
in them - is a critical activity. The Shelter Registry provides
functionality to list and track information on shelters and on the
people arriving and departing. Shelter details include location, services
provided, responsible organization and contacts, demographics, and
needs. In addition, individual person data includes name, age, relatives,
status, health, and many other details to provide a clear understanding
of population demographics within the site.

'''Messaging'''

In the complex domain of Disaster Management, communication is
critical. Sahana Eden provides support for messages to be sent
by Email, SMS, Twitter and Google Talk. Distribution Groups can be set
up to allow messages to be easily sent to many people at once. Users
are able to search for specific information and subscribe to receive
update messages when new information is added.

==Technical Overview==

Because Sahana Eden needs to be accessible to users at remote
locations, including the public, a browser-based solution was essential.
The system also needs to be able to be used on offline laptops, so it
needs to run on a lightweight stack.

Python was selected as a suitable high level language allowing the rapid
customization of code required for each individual circumstance yet
has a large number of powerful libraries available including for
Geospatial Information Systems (GIS).

'''Shana Eden Framework'''

The Sahana Eden Software Platform has been built around a Rapid
Application Development (RAD) Framework. This provides a high level
of automation to ensure that new solutions can be quickly and
effectively developed. Once a database table is defined, the Sahana
Eden Framework automatically generates HTML pages to handle CRUD
(Create, Read, Update, Delete) as well as Search, Map and Pivot
Reports. Web Services are available to import and export in XML, CSV,
JSON and EXtensible Stylesheet Language (XSL) transforms are
supported to produce other data standards.

'''Sahana Eden Architecture'''

Web Server: Apache. Other web servers can also be used,such as Cherokee.

Application: Sahana Eden

Web Application Framework: Web2Py

Programming Language: Python & JavaScript

Database: MySQL,PostgreSQL, or MySQL, PostgreSQL, and SQLite are supported. Other databases should be usable without major additional work
since Web2Py supplies many connectors.

Operating System: Linux (Debian recommended),Windows and Mac OS X are possible, but only recommended for single-user environments.

'''Installation'''

Sahana Eden can be installed on any environment which can run
Python, including Linux, Windows and OSX. The system supports a
number of different databases and has been widely tested on MySQL,
PostgreSQL and SQLite. A webserver is optional, but for production
installations we have experience of both Apache/mod_wsgi and
Cherokee/uwsgi.

Installation scripts and detailed instructions are available on the Wiki:
http://eden.sahanafoundation.org/wiki/InstallationGuidelines

'''Web2py'''

This is an MVC environment (like Rails & Django.).
Web2Py can work at several different levels of abstraction.
The Sahana Eden framework (S3) is built on Web2Py's Auth/Crud classes in tools.py (with some remnants of the older T2), however sometimes we need more control therefore need to drop down a level or two.
Can execute a controller to be able to access its functions using:
execfile("applications/eden/controllers/mycontroller.py", globals())

'''S3'''

The Sahana Eden framework (S3) is built on Web2Py and It is used for RAD in all the sahana applications. The Sahana api docs can be found at http://eden.sahanafoundation.org/wiki/DeveloperGuidelines

'''Directory Structure'''

After the installation, the typical directory structure of the instance
looks like:
[[Application_structure.png]]

==Social Media==
Social Media is playing a important role in Disaster and Emergency Management, for such things as:

- Sending warnings and emergency instructions to the public.

- Receiving help requests and incident reports from the public.

- Engaging with the public, encouraging preparedness, providing information.

- Detecting incidents not directly reported. f

==Map Feeds==
This project allows the user to add layers of Geo-tagged data from Twitter onto the Map. It searches for tweets with specific keywords (that can be configured by user on Sahana web page). It then plots the location of these tweets on the Map. This is the work that we have done as a part of our project implementation. The following steps are involved in this:

After setting up Eden in the system twitterSearch library(https://pypi.python.org/pypi/TwitterSearch/) is to be installed which helps to fetch the tweets with specific keywords

'''Searching Tweets'''

- Configuring twitter account:

Sign into https://dev.twitter.com and create an app. (Select an application Type: Client). Put the Callback URL as blank and create your own Twitter application. After creating an app on twitter account, you will be able to see a tab called OAuth tool. Open eden/models/000_config.py file. Under Twitter Settings, add consumer_key and consumer_secret obtained from the twitter app's OAuth tool. Edit the following lines in 000_config.py
settings.msg.twitter_oauth_consumer_key = "<consumer key from twitter app>"
settings.msg.twiiter_oauth_consumer_secret = "<consumer_secret from twitter app>"

- Add keywords to be searched:

Go to a page eden/msg/twitter_search. You can add keywords / search queries records under this page. It will ask you for a PIN to enter before saving the keywords/queries. The pin is obtained from Twitter app that was created.

- Populating database with search results:

After saving the keywords/ queries, click on Results which triggers the search and msg_twitter_search_results table in the database gets populated.

'''Processing Tweets'''

After fetching the twitter feeds, the Geo-tagged tweets are processed. They are parsed to fetch user information, tweet data and location information in terms of latitude and longitude. All this information then goes into the msg_twitter_search_results table.

'''Plotting tweets on Map'''

To display tweets on map, a new layer named "Twitter" is added under the overlays section on the map page. When a user selects this option, the location ids from the msg_twitter_search_results are fetched and a marker is displayed on those locations. Clicking on the marker image displays additional tweet information such as content, time and user info.

==Future Scope==

1. Major limitation is that the twitter search keyword is hard coded.We need to make the code access the msg_twitter_search table and use the keywords stored by the user through the GUI to search and display twitter feeds on the GIS map.

2. Display twitter icon on map instead of the normal location bubble.

3. Work on the pop-up contents. Ideally this would include any photo or video linked in the message (or a URL if it's to a page of text). Actually doing the part within the tweet parsing of following embedded URLs to identify if they're Media would be really useful addition to the parser (there is a commented-out stub).

4. Create a cron job, to search tweets periodically and not only at user's request.

==References==
<references/>

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T20:24:37Z

Kspatel6: /* Social Media */

==Background==
The Sahana Software Foundation is dedicated to the mission of saving lives by providing information management solutions that enable organizations and communities to better prepare for and respond to disasters. It is an open source software platform which provides a range of solutions for Disaster Management practitioners to help them reduce the impact disasters have on our communities through tracking the needs of the affected populations & coordinating the responding agencies & their resources.It can be accessed from the web or locally from a flash
drive, allowing it to be used in environments with poor internet. Local & Web versions can be configured to synchronize to allow data to be
shared between them. These features are designed to help Disaster Management practitioners to better mitigate, prepare for, respond to and recover from disasters more effectively and efficiently.

Sahana Eden is designed to be rapidly configured and customized to support the diverse business processes used within Disaster Management. Sahana Eden's modular design allows different pieces of functionality to be enabled and disabled as required providing flexible solutions for changing contexts. The application can be configured to secure sensitive information, while also making data which needs to be shared available in a variety of different formats including Microsoft Excel and PDF. To ensure that Sahana Eden is accessible to every country, it can be translated into multiple languages.

==Core modules and outlines==

'''Organization Registry'''

Many diverse organizations are involved in Disaster Management, from responding to disasters to strengthening communities to providing support to people in need. Sahana Eden’s Organization Registry can track what organizations are active in different contexts, providing opportunities for collaboration and coordination.

'''Project Tracking'''

By telling you Who’s Doing What, Where, and When, Sahana Eden provides a valuable tool to help organizations responding to disasters know where the greatest needs are and coordinate with others who are engaged in similar work.

'''Human Resources'''

The most important part of Disaster Management is the people.Whether they are community volunteers or staff working for different organizations, the Human Resources module can help manage the people involved. It will track where they are, what skills they have and help ensure that everyone is effectively engaged with the work that needs to be done. Sahana Eden can also be used to provide a contact list to ensure that the right people can be contacted at the right time.

'''Inventory'''

Whether organizations are supplying basic essentials of life to people
affected by natural disasters or giving communities the tools they
need to restore their livelihoods, Sahana Eden can be used to manage
inventories of items and match requests for items with warehouses
and other facilities which have them available. Operationally, Sahana
Eden can be used to record and automate transactions for sending
and receiving shipments. Sahana Eden can support multiple Catalogs of
Items as well as providing alternative items to ensure more effective
use of supplies. Sahana Eden can be configured to load multiple
catalogs including a generic list of items and/or the IFRC Emergency
Item Catalog.

'''Assets'''

A wide range of assets are needed to respond to disasters, including
vehicles to transport people and relief items, radio equipment to
provide communication where telecommunication infrastructure has
been destroyed, and generators to provide backup power. Sahana
Eden is able to manage assets, track where they are, who they have
been assigned to, and what condition they are in. This ensures that
assets are used effectively and efficiently.

'''Assessments'''

Sahana Eden can be used to collect and analyze information from
assessments to help organizations more effectively plan their disaster
management activities. Different assessment templates can easily be
designed and imported into Sahana Eden to support assessments for
different organizations in different contexts. Data can either be
entered into an interactive web form or imported via an Excel
template.

'''Scenarios and Events'''

To help organizations better plan for disasters, Sahana Eden can be
used to plan for different scenarios, including recording what human
resources, assets, facilities and tasks will be needed to effectively
respond.
When an incident occurs events can be created from a scenario
template to allocate the resources and alert people of the need to
respond.

'''Map'''

Sahana Eden has fully integrated mapping functionality which allows
any location-based data to be visualized on a map. This information
can also be searched using a map-based boundary selection. Maps
provide situational awareness which is essential when either planning to
prepare for or respond to a disaster. Sahana Eden supports many
standard formats for overlaying data on maps from other sources
and Geographical Information Systems (GIS), for example natural
hazard risks, population or weather.

'''Shelter Management'''

When disasters are widespread and result in population displacement,
understanding and tracking the landscape of shelters - and the people
in them - is a critical activity. The Shelter Registry provides
functionality to list and track information on shelters and on the
people arriving and departing. Shelter details include location, services
provided, responsible organization and contacts, demographics, and
needs. In addition, individual person data includes name, age, relatives,
status, health, and many other details to provide a clear understanding
of population demographics within the site.

'''Messaging'''

In the complex domain of Disaster Management, communication is
critical. Sahana Eden provides support for messages to be sent
by Email, SMS, Twitter and Google Talk. Distribution Groups can be set
up to allow messages to be easily sent to many people at once. Users
are able to search for specific information and subscribe to receive
update messages when new information is added.

==Technical Overview==

Because Sahana Eden needs to be accessible to users at remote
locations, including the public, a browser-based solution was essential.
The system also needs to be able to be used on offline laptops, so it
needs to run on a lightweight stack.

Python was selected as a suitable high level language allowing the rapid
customization of code required for each individual circumstance yet
has a large number of powerful libraries available including for
Geospatial Information Systems (GIS).

'''Shana Eden Framework'''

The Sahana Eden Software Platform has been built around a Rapid
Application Development (RAD) Framework. This provides a high level
of automation to ensure that new solutions can be quickly and
effectively developed. Once a database table is defined, the Sahana
Eden Framework automatically generates HTML pages to handle CRUD
(Create, Read, Update, Delete) as well as Search, Map and Pivot
Reports. Web Services are available to import and export in XML, CSV,
JSON and EXtensible Stylesheet Language (XSL) transforms are
supported to produce other data standards.

'''Sahana Eden Architecture'''

Web Server: Apache. Other web servers can also be used,such as Cherokee.

Application: Sahana Eden

Web Application Framework: Web2Py

Programming Language: Python & JavaScript

Database: MySQL,PostgreSQL, or MySQL, PostgreSQL, and SQLite are supported. Other databases should be usable without major additional work
since Web2Py supplies many connectors.

Operating System: Linux (Debian recommended),Windows and Mac OS X are possible, but only recommended for single-user environments.

'''Installation'''

Sahana Eden can be installed on any environment which can run
Python, including Linux, Windows and OSX. The system supports a
number of different databases and has been widely tested on MySQL,
PostgreSQL and SQLite. A webserver is optional, but for production
installations we have experience of both Apache/mod_wsgi and
Cherokee/uwsgi.

Installation scripts and detailed instructions are available on the Wiki:
http://eden.sahanafoundation.org/wiki/InstallationGuidelines

'''Web2py'''

This is an MVC environment (like Rails & Django.).
Web2Py can work at several different levels of abstraction.
The Sahana Eden framework (S3) is built on Web2Py's Auth/Crud classes in tools.py (with some remnants of the older T2), however sometimes we need more control therefore need to drop down a level or two.
Can execute a controller to be able to access its functions using:
execfile("applications/eden/controllers/mycontroller.py", globals())

'''S3'''

The Sahana Eden framework (S3) is built on Web2Py and It is used for RAD in all the sahana applications. The Sahana api docs can be found at http://eden.sahanafoundation.org/wiki/DeveloperGuidelines

'''Directory Structure'''

After the installation, the typical directory structure of the instance
looks like:
[[Application_structure.png]]

==Social Media==
Social Media is playing a important role in Disaster and Emergency Management, for such things as:

- Sending warnings and emergency instructions to the public.

- Receiving help requests and incident reports from the public.

- Engaging with the public, encouraging preparedness, providing information.

- Detecting incidents not directly reported. f

==Map Feeds==
This project allows the user to add layers of Geo-tagged data from Twitter onto the Map. It searches for tweets with specific keywords (that can be configured by user on Sahana web page). It then plots the location of these tweets on the Map. This is the work that we have done as a part of our project implementation. The following stepa are involved in this:

After setting up Eden in the system twitterSearch library(https://pypi.python.org/pypi/TwitterSearch/) is to be installed which helps to fetch the tweets with specific keywords

'''Searching Tweets'''

- Configuring twitter account:

Sign into https://dev.twitter.com and create an app. (Select an application Type: Client). Put the Callback URL as blank and create your own Twitter application. After creating an app on twitter account, you will be able to see a tab called OAuth tool. Open eden/models/000_config.py file. Under Twitter Settings, add consumer_key and consumer_secret obtained from the twitter app's OAuth tool. Edit the following lines in 000_config.py
settings.msg.twitter_oauth_consumer_key = "<consumer key from twitter app>"
settings.msg.twiiter_oauth_consumer_secret = "<consumer_secret from twitter app>"

- Add keywords to be searched:

Go to a page eden/msg/twitter_search. You can add keywords / search queries records under this page. It will ask you for a PIN to enter before saving the keywords/queries. The pin is obtained from Twitter app that was created.

- Populating database with search results:

After saving the keywords/ queries, click on Results which triggers the search and msg_twitter_search_results table in the database gets populated.

'''Processing Tweets'''

After fetching the twitter feeds, the Geo-tagged tweets are processed. They are parsed to fetch user information, tweet data and location information in terms of latitude and longitude. All this information then goes into the msg_twitter_search_results table.

'''Plotting tweets on Map'''

To display tweets on map, a new layer named "Twitter" is added under the overlays section on the map page. When a user selects this option, the location ids from the msg_twitter_search_results are fetched and a marker is displayed on those locations. Clicking on the marker image displays additional tweet information such as content, time and user info.

==Future Scope==

1. Major limitation is that the twitter search keyword is hard coded.We need to make the code access the msg_twitter_search table and use the keywords stored by the user through the GUI to search and display twitter feeds on the GIS map.

2. Display twitter icon on map instead of the normal location bubble.

3. Work on the pop-up contents. Ideally this would include any photo or video linked in the message (or a URL if it's to a page of text). Actually doing the part within the tweet parsing of following embedded URLs to identify if they're Media would be really useful addition to the parser (there is a commented-out stub).

4. Create a cron job, to search tweets periodically and not only at user's request.

==References==
<references/>

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T20:24:07Z

Kspatel6:

==Background==
The Sahana Software Foundation is dedicated to the mission of saving lives by providing information management solutions that enable organizations and communities to better prepare for and respond to disasters. It is an open source software platform which provides a range of solutions for Disaster Management practitioners to help them reduce the impact disasters have on our communities through tracking the needs of the affected populations & coordinating the responding agencies & their resources.It can be accessed from the web or locally from a flash
drive, allowing it to be used in environments with poor internet. Local & Web versions can be configured to synchronize to allow data to be
shared between them. These features are designed to help Disaster Management practitioners to better mitigate, prepare for, respond to and recover from disasters more effectively and efficiently.

Sahana Eden is designed to be rapidly configured and customized to support the diverse business processes used within Disaster Management. Sahana Eden's modular design allows different pieces of functionality to be enabled and disabled as required providing flexible solutions for changing contexts. The application can be configured to secure sensitive information, while also making data which needs to be shared available in a variety of different formats including Microsoft Excel and PDF. To ensure that Sahana Eden is accessible to every country, it can be translated into multiple languages.

==Core modules and outlines==

'''Organization Registry'''

Many diverse organizations are involved in Disaster Management, from responding to disasters to strengthening communities to providing support to people in need. Sahana Eden’s Organization Registry can track what organizations are active in different contexts, providing opportunities for collaboration and coordination.

'''Project Tracking'''

By telling you Who’s Doing What, Where, and When, Sahana Eden provides a valuable tool to help organizations responding to disasters know where the greatest needs are and coordinate with others who are engaged in similar work.

'''Human Resources'''

The most important part of Disaster Management is the people.Whether they are community volunteers or staff working for different organizations, the Human Resources module can help manage the people involved. It will track where they are, what skills they have and help ensure that everyone is effectively engaged with the work that needs to be done. Sahana Eden can also be used to provide a contact list to ensure that the right people can be contacted at the right time.

'''Inventory'''

Whether organizations are supplying basic essentials of life to people
affected by natural disasters or giving communities the tools they
need to restore their livelihoods, Sahana Eden can be used to manage
inventories of items and match requests for items with warehouses
and other facilities which have them available. Operationally, Sahana
Eden can be used to record and automate transactions for sending
and receiving shipments. Sahana Eden can support multiple Catalogs of
Items as well as providing alternative items to ensure more effective
use of supplies. Sahana Eden can be configured to load multiple
catalogs including a generic list of items and/or the IFRC Emergency
Item Catalog.

'''Assets'''

A wide range of assets are needed to respond to disasters, including
vehicles to transport people and relief items, radio equipment to
provide communication where telecommunication infrastructure has
been destroyed, and generators to provide backup power. Sahana
Eden is able to manage assets, track where they are, who they have
been assigned to, and what condition they are in. This ensures that
assets are used effectively and efficiently.

'''Assessments'''

Sahana Eden can be used to collect and analyze information from
assessments to help organizations more effectively plan their disaster
management activities. Different assessment templates can easily be
designed and imported into Sahana Eden to support assessments for
different organizations in different contexts. Data can either be
entered into an interactive web form or imported via an Excel
template.

'''Scenarios and Events'''

To help organizations better plan for disasters, Sahana Eden can be
used to plan for different scenarios, including recording what human
resources, assets, facilities and tasks will be needed to effectively
respond.
When an incident occurs events can be created from a scenario
template to allocate the resources and alert people of the need to
respond.

'''Map'''

Sahana Eden has fully integrated mapping functionality which allows
any location-based data to be visualized on a map. This information
can also be searched using a map-based boundary selection. Maps
provide situational awareness which is essential when either planning to
prepare for or respond to a disaster. Sahana Eden supports many
standard formats for overlaying data on maps from other sources
and Geographical Information Systems (GIS), for example natural
hazard risks, population or weather.

'''Shelter Management'''

When disasters are widespread and result in population displacement,
understanding and tracking the landscape of shelters - and the people
in them - is a critical activity. The Shelter Registry provides
functionality to list and track information on shelters and on the
people arriving and departing. Shelter details include location, services
provided, responsible organization and contacts, demographics, and
needs. In addition, individual person data includes name, age, relatives,
status, health, and many other details to provide a clear understanding
of population demographics within the site.

'''Messaging'''

In the complex domain of Disaster Management, communication is
critical. Sahana Eden provides support for messages to be sent
by Email, SMS, Twitter and Google Talk. Distribution Groups can be set
up to allow messages to be easily sent to many people at once. Users
are able to search for specific information and subscribe to receive
update messages when new information is added.

==Technical Overview==

Because Sahana Eden needs to be accessible to users at remote
locations, including the public, a browser-based solution was essential.
The system also needs to be able to be used on offline laptops, so it
needs to run on a lightweight stack.

Python was selected as a suitable high level language allowing the rapid
customization of code required for each individual circumstance yet
has a large number of powerful libraries available including for
Geospatial Information Systems (GIS).

'''Shana Eden Framework'''

The Sahana Eden Software Platform has been built around a Rapid
Application Development (RAD) Framework. This provides a high level
of automation to ensure that new solutions can be quickly and
effectively developed. Once a database table is defined, the Sahana
Eden Framework automatically generates HTML pages to handle CRUD
(Create, Read, Update, Delete) as well as Search, Map and Pivot
Reports. Web Services are available to import and export in XML, CSV,
JSON and EXtensible Stylesheet Language (XSL) transforms are
supported to produce other data standards.

'''Sahana Eden Architecture'''

Web Server: Apache. Other web servers can also be used,such as Cherokee.

Application: Sahana Eden

Web Application Framework: Web2Py

Programming Language: Python & JavaScript

Database: MySQL,PostgreSQL, or MySQL, PostgreSQL, and SQLite are supported. Other databases should be usable without major additional work
since Web2Py supplies many connectors.

Operating System: Linux (Debian recommended),Windows and Mac OS X are possible, but only recommended for single-user environments.

'''Installation'''

Sahana Eden can be installed on any environment which can run
Python, including Linux, Windows and OSX. The system supports a
number of different databases and has been widely tested on MySQL,
PostgreSQL and SQLite. A webserver is optional, but for production
installations we have experience of both Apache/mod_wsgi and
Cherokee/uwsgi.

Installation scripts and detailed instructions are available on the Wiki:
http://eden.sahanafoundation.org/wiki/InstallationGuidelines

'''Web2py'''

This is an MVC environment (like Rails & Django.).
Web2Py can work at several different levels of abstraction.
The Sahana Eden framework (S3) is built on Web2Py's Auth/Crud classes in tools.py (with some remnants of the older T2), however sometimes we need more control therefore need to drop down a level or two.
Can execute a controller to be able to access its functions using:
execfile("applications/eden/controllers/mycontroller.py", globals())

'''S3'''

The Sahana Eden framework (S3) is built on Web2Py and It is used for RAD in all the sahana applications. The Sahana api docs can be found at http://eden.sahanafoundation.org/wiki/DeveloperGuidelines

'''Directory Structure'''

After the installation, the typical directory structure of the instance
looks like:
[[Application_structure.png]]

==Social Media==
Social Media is playing a important role in Disaster and Emergency Management, for such things as:
- Sending warnings and emergency instructions to the public.
- Receiving help requests and incident reports from the public.
- Engaging with the public, encouraging preparedness, providing information.
- Detecting incidents not directly reported. f

==Map Feeds==
This project allows the user to add layers of Geo-tagged data from Twitter onto the Map. It searches for tweets with specific keywords (that can be configured by user on Sahana web page). It then plots the location of these tweets on the Map. This is the work that we have done as a part of our project implementation. The following stepa are involved in this:

After setting up Eden in the system twitterSearch library(https://pypi.python.org/pypi/TwitterSearch/) is to be installed which helps to fetch the tweets with specific keywords

'''Searching Tweets'''

- Configuring twitter account:

Sign into https://dev.twitter.com and create an app. (Select an application Type: Client). Put the Callback URL as blank and create your own Twitter application. After creating an app on twitter account, you will be able to see a tab called OAuth tool. Open eden/models/000_config.py file. Under Twitter Settings, add consumer_key and consumer_secret obtained from the twitter app's OAuth tool. Edit the following lines in 000_config.py
settings.msg.twitter_oauth_consumer_key = "<consumer key from twitter app>"
settings.msg.twiiter_oauth_consumer_secret = "<consumer_secret from twitter app>"

- Add keywords to be searched:

Go to a page eden/msg/twitter_search. You can add keywords / search queries records under this page. It will ask you for a PIN to enter before saving the keywords/queries. The pin is obtained from Twitter app that was created.

- Populating database with search results:

After saving the keywords/ queries, click on Results which triggers the search and msg_twitter_search_results table in the database gets populated.

'''Processing Tweets'''

After fetching the twitter feeds, the Geo-tagged tweets are processed. They are parsed to fetch user information, tweet data and location information in terms of latitude and longitude. All this information then goes into the msg_twitter_search_results table.

'''Plotting tweets on Map'''

To display tweets on map, a new layer named "Twitter" is added under the overlays section on the map page. When a user selects this option, the location ids from the msg_twitter_search_results are fetched and a marker is displayed on those locations. Clicking on the marker image displays additional tweet information such as content, time and user info.

==Future Scope==

1. Major limitation is that the twitter search keyword is hard coded.We need to make the code access the msg_twitter_search table and use the keywords stored by the user through the GUI to search and display twitter feeds on the GIS map.

2. Display twitter icon on map instead of the normal location bubble.

3. Work on the pop-up contents. Ideally this would include any photo or video linked in the message (or a URL if it's to a page of text). Actually doing the part within the tweet parsing of following embedded URLs to identify if they're Media would be really useful addition to the parser (there is a commented-out stub).

4. Create a cron job, to search tweets periodically and not only at user's request.

==References==
<references/>

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T20:21:55Z

Kspatel6:

==Background==
The Sahana Software Foundation is dedicated to the mission of saving lives by providing information management solutions that enable organizations and communities to better prepare for and respond to disasters. It is an open source software platform which provides a range of solutions for Disaster Management practitioners to help them reduce the impact disasters have on our communities through tracking the needs of the affected populations & coordinating the responding agencies & their resources.It can be accessed from the web or locally from a flash
drive, allowing it to be used in environments with poor internet. Local & Web versions can be configured to synchronize to allow data to be
shared between them. These features are designed to help Disaster Management practitioners to better mitigate, prepare for, respond to and recover from disasters more effectively and efficiently.

Sahana Eden is designed to be rapidly configured and customized to support the diverse business processes used within Disaster Management. Sahana Eden's modular design allows different pieces of functionality to be enabled and disabled as required providing flexible solutions for changing contexts. The application can be configured to secure sensitive information, while also making data which needs to be shared available in a variety of different formats including Microsoft Excel and PDF. To ensure that Sahana Eden is accessible to every country, it can be translated into multiple languages.

==Core modules and outlines==

'''Organization Registry'''

Many diverse organizations are involved in Disaster Management, from responding to disasters to strengthening communities to providing support to people in need. Sahana Eden’s Organization Registry can track what organizations are active in different contexts, providing opportunities for collaboration and coordination.

'''Project Tracking'''

By telling you Who’s Doing What, Where, and When, Sahana Eden provides a valuable tool to help organizations responding to disasters know where the greatest needs are and coordinate with others who are engaged in similar work.

'''Human Resources'''

The most important part of Disaster Management is the people.Whether they are community volunteers or staff working for different organizations, the Human Resources module can help manage the people involved. It will track where they are, what skills they have and help ensure that everyone is effectively engaged with the work that needs to be done. Sahana Eden can also be used to provide a contact list to ensure that the right people can be contacted at the right time.

'''Inventory'''

Whether organizations are supplying basic essentials of life to people
affected by natural disasters or giving communities the tools they
need to restore their livelihoods, Sahana Eden can be used to manage
inventories of items and match requests for items with warehouses
and other facilities which have them available. Operationally, Sahana
Eden can be used to record and automate transactions for sending
and receiving shipments. Sahana Eden can support multiple Catalogs of
Items as well as providing alternative items to ensure more effective
use of supplies. Sahana Eden can be configured to load multiple
catalogs including a generic list of items and/or the IFRC Emergency
Item Catalog.

'''Assets'''

A wide range of assets are needed to respond to disasters, including
vehicles to transport people and relief items, radio equipment to
provide communication where telecommunication infrastructure has
been destroyed, and generators to provide backup power. Sahana
Eden is able to manage assets, track where they are, who they have
been assigned to, and what condition they are in. This ensures that
assets are used effectively and efficiently.

'''Assessments'''

Sahana Eden can be used to collect and analyze information from
assessments to help organizations more effectively plan their disaster
management activities. Different assessment templates can easily be
designed and imported into Sahana Eden to support assessments for
different organizations in different contexts. Data can either be
entered into an interactive web form or imported via an Excel
template.

'''Scenarios and Events'''

To help organizations better plan for disasters, Sahana Eden can be
used to plan for different scenarios, including recording what human
resources, assets, facilities and tasks will be needed to effectively
respond.
When an incident occurs events can be created from a scenario
template to allocate the resources and alert people of the need to
respond.

'''Map'''

Sahana Eden has fully integrated mapping functionality which allows
any location-based data to be visualized on a map. This information
can also be searched using a map-based boundary selection. Maps
provide situational awareness which is essential when either planning to
prepare for or respond to a disaster. Sahana Eden supports many
standard formats for overlaying data on maps from other sources
and Geographical Information Systems (GIS), for example natural
hazard risks, population or weather.

'''Shelter Management'''

When disasters are widespread and result in population displacement,
understanding and tracking the landscape of shelters - and the people
in them - is a critical activity. The Shelter Registry provides
functionality to list and track information on shelters and on the
people arriving and departing. Shelter details include location, services
provided, responsible organization and contacts, demographics, and
needs. In addition, individual person data includes name, age, relatives,
status, health, and many other details to provide a clear understanding
of population demographics within the site.

'''Messaging'''

In the complex domain of Disaster Management, communication is
critical. Sahana Eden provides support for messages to be sent
by Email, SMS, Twitter and Google Talk. Distribution Groups can be set
up to allow messages to be easily sent to many people at once. Users
are able to search for specific information and subscribe to receive
update messages when new information is added.

==Technical Overview==

Because Sahana Eden needs to be accessible to users at remote
locations, including the public, a browser-based solution was essential.
The system also needs to be able to be used on offline laptops, so it
needs to run on a lightweight stack.

Python was selected as a suitable high level language allowing the rapid
customization of code required for each individual circumstance yet
has a large number of powerful libraries available including for
Geospatial Information Systems (GIS).

'''Shana Eden Framework'''

The Sahana Eden Software Platform has been built around a Rapid
Application Development (RAD) Framework. This provides a high level
of automation to ensure that new solutions can be quickly and
effectively developed. Once a database table is defined, the Sahana
Eden Framework automatically generates HTML pages to handle CRUD
(Create, Read, Update, Delete) as well as Search, Map and Pivot
Reports. Web Services are available to import and export in XML, CSV,
JSON and EXtensible Stylesheet Language (XSL) transforms are
supported to produce other data standards.

'''Sahana Eden Architecture'''

Web Server: Apache. Other web servers can also be used,such as Cherokee.

Application: Sahana Eden

Web Application Framework: Web2Py

Programming Language: Python & JavaScript

Database: MySQL,PostgreSQL, or MySQL, PostgreSQL, and SQLite are supported. Other databases should be usable without major additional work
since Web2Py supplies many connectors.

Operating System: Linux (Debian recommended),Windows and Mac OS X are possible, but only recommended for single-user environments.

'''Installation'''

Sahana Eden can be installed on any environment which can run
Python, including Linux, Windows and OSX. The system supports a
number of different databases and has been widely tested on MySQL,
PostgreSQL and SQLite. A webserver is optional, but for production
installations we have experience of both Apache/mod_wsgi and
Cherokee/uwsgi.

Installation scripts and detailed instructions are available on the Wiki:
http://eden.sahanafoundation.org/wiki/InstallationGuidelines

'''Web2py'''

This is an MVC environment (like Rails & Django.).
Web2Py can work at several different levels of abstraction.
The Sahana Eden framework (S3) is built on Web2Py's Auth/Crud classes in tools.py (with some remnants of the older T2), however sometimes we need more control therefore need to drop down a level or two.
Can execute a controller to be able to access its functions using:
execfile("applications/eden/controllers/mycontroller.py", globals())

'''S3'''

The Sahana Eden framework (S3) is built on Web2Py and It is used for RAD in all the sahana applications. The Sahana api docs can be found at http://eden.sahanafoundation.org/wiki/DeveloperGuidelines

'''Directory Structure'''

After the installation, the typical directory structure of the instance
looks like:
[[Application_structure.png]]

==Social Media==
Social Media is playing a important role in Disaster and Emergency Management, for such things as:
- Sending warnings and emergency instructions to the public.
- Receiving help requests and incident reports from the public.
- Engaging with the public, encouraging preparedness, providing information.
- Detecting incidents not directly reported. f

==Map Feeds==
This project allows the user to add layers of Geo-tagged data from Twitter onto the Map. It searches for tweets with specific keywords (that can be configured by user on Sahana web page). It then plots the location of these tweets on the Map. This is the work that we have done as a part of our project implementation. The following stepa are involved in this:

After setting up Eden in the system twitterSearch library(https://pypi.python.org/pypi/TwitterSearch/) is to be installed which helps to fetch the tweets with specific keywords

'''Searching Tweets'''

- Configuring twitter account:

Sign into https://dev.twitter.com and create an app. (Select an application Type: Client). Put the Callback URL as blank and create your own Twitter application. After creating an app on twitter account, you will be able to see a tab called OAuth tool. Open eden/models/000_config.py file. Under Twitter Settings, add consumer_key and consumer_secret obtained from the twitter app's OAuth tool. Edit the following lines in 000_config.py
settings.msg.twitter_oauth_consumer_key = "<consumer key from twitter app>"
settings.msg.twiiter_oauth_consumer_secret = "<consumer_secret from twitter app>"

- Add keywords to be searched:

Go to a page eden/msg/twitter_search. You can add keywords / search queries records under this page. It will ask you for a PIN to enter before saving the keywords/queries. The pin is obtained from Twitter app that was created.

- Populating database with search results:

After saving the keywords/ queries, click on Results which triggers the search and msg_twitter_search_results table in the database gets populated.

'''Processing Tweets'''

After fetching the twitter feeds, the Geo-tagged tweets are processed. They are parsed to fetch user information, tweet data and location information in terms of latitude and longitude. All this information then goes into the msg_twitter_search_results table.

'''Plotting tweets on Map'''

To display tweets on map, a new layer named "Twitter" is added under the overlays section on the map page. When a user selects this option, the location ids from the msg_twitter_search_results are fetched and a marker is displayed on those locations. Clicking on the marker image displays additional tweet information such as content, time and user info.

==Future Scope==

1. Major limitation is that the twitter search keyword is hard coded.We need to make the code access the msg_twitter_search table and use the keywords stored by the user through the GUI to search and display twitter feeds on the GIS map.

2. Display twitter icon on map instead of the normal location bubble.

3. Work on the pop-up contents. Ideally this would include any photo or video linked in the message (or a URL if it's to a page of text). Actually doing the part within the tweet parsing of following embedded URLs to identify if they're Media would be really useful addition to the parser (there is a commented-out stub).

4. Create a cron job, to search tweets periodically and not only at user's request.

==References==
<references/>

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T20:20:58Z

Kspatel6:

==Background==
The Sahana Software Foundation is dedicated to the mission of saving lives by providing information management solutions that enable organizations and communities to better prepare for and respond to disasters. It is an open source software platform which provides a range of solutions for Disaster Management practitioners to help them reduce the impact disasters have on our communities through tracking the needs of the affected populations & coordinating the responding agencies & their resources.It can be accessed from the web or locally from a flash
drive, allowing it to be used in environments with poor internet. Local & Web versions can be configured to synchronize to allow data to be
shared between them. These features are designed to help Disaster Management practitioners to better mitigate, prepare for, respond to and recover from disasters more effectively and efficiently.

Sahana Eden is designed to be rapidly configured and customized to support the diverse business processes used within Disaster Management. Sahana Eden's modular design allows different pieces of functionality to be enabled and disabled as required providing flexible solutions for changing contexts. The application can be configured to secure sensitive information, while also making data which needs to be shared available in a variety of different formats including Microsoft Excel and PDF. To ensure that Sahana Eden is accessible to every country, it can be translated into multiple languages.

==Core modules and outlines==

'''Organization Registry'''

Many diverse organizations are involved in Disaster Management, from responding to disasters to strengthening communities to providing support to people in need. Sahana Eden’s Organization Registry can track what organizations are active in different contexts, providing opportunities for collaboration and coordination.

'''Project Tracking'''

By telling you Who’s Doing What, Where, and When, Sahana Eden provides a valuable tool to help organizations responding to disasters know where the greatest needs are and coordinate with others who are engaged in similar work.

'''Human Resources'''

The most important part of Disaster Management is the people.Whether they are community volunteers or staff working for different organizations, the Human Resources module can help manage the people involved. It will track where they are, what skills they have and help ensure that everyone is effectively engaged with the work that needs to be done. Sahana Eden can also be used to provide a contact list to ensure that the right people can be contacted at the right time.

'''Inventory'''

Whether organizations are supplying basic essentials of life to people
affected by natural disasters or giving communities the tools they
need to restore their livelihoods, Sahana Eden can be used to manage
inventories of items and match requests for items with warehouses
and other facilities which have them available. Operationally, Sahana
Eden can be used to record and automate transactions for sending
and receiving shipments. Sahana Eden can support multiple Catalogs of
Items as well as providing alternative items to ensure more effective
use of supplies. Sahana Eden can be configured to load multiple
catalogs including a generic list of items and/or the IFRC Emergency
Item Catalog.

'''Assets'''

A wide range of assets are needed to respond to disasters, including
vehicles to transport people and relief items, radio equipment to
provide communication where telecommunication infrastructure has
been destroyed, and generators to provide backup power. Sahana
Eden is able to manage assets, track where they are, who they have
been assigned to, and what condition they are in. This ensures that
assets are used effectively and efficiently.

'''Assessments'''

Sahana Eden can be used to collect and analyze information from
assessments to help organizations more effectively plan their disaster
management activities. Different assessment templates can easily be
designed and imported into Sahana Eden to support assessments for
different organizations in different contexts. Data can either be
entered into an interactive web form or imported via an Excel
template.

'''Scenarios and Events'''

To help organizations better plan for disasters, Sahana Eden can be
used to plan for different scenarios, including recording what human
resources, assets, facilities and tasks will be needed to effectively
respond.
When an incident occurs events can be created from a scenario
template to allocate the resources and alert people of the need to
respond.

'''Map'''

Sahana Eden has fully integrated mapping functionality which allows
any location-based data to be visualized on a map. This information
can also be searched using a map-based boundary selection. Maps
provide situational awareness which is essential when either planning to
prepare for or respond to a disaster. Sahana Eden supports many
standard formats for overlaying data on maps from other sources
and Geographical Information Systems (GIS), for example natural
hazard risks, population or weather.

'''Shelter Management'''

When disasters are widespread and result in population displacement,
understanding and tracking the landscape of shelters - and the people
in them - is a critical activity. The Shelter Registry provides
functionality to list and track information on shelters and on the
people arriving and departing. Shelter details include location, services
provided, responsible organization and contacts, demographics, and
needs. In addition, individual person data includes name, age, relatives,
status, health, and many other details to provide a clear understanding
of population demographics within the site.

'''Messaging'''

In the complex domain of Disaster Management, communication is
critical. Sahana Eden provides support for messages to be sent
by Email, SMS, Twitter and Google Talk. Distribution Groups can be set
up to allow messages to be easily sent to many people at once. Users
are able to search for specific information and subscribe to receive
update messages when new information is added.

==Technical Overview==

Because Sahana Eden needs to be accessible to users at remote
locations, including the public, a browser-based solution was essential.
The system also needs to be able to be used on offline laptops, so it
needs to run on a lightweight stack.

Python was selected as a suitable high level language allowing the rapid
customization of code required for each individual circumstance yet
has a large number of powerful libraries available including for
Geospatial Information Systems (GIS).

'''Shana Eden Framework'''

The Sahana Eden Software Platform has been built around a Rapid
Application Development (RAD) Framework. This provides a high level
of automation to ensure that new solutions can be quickly and
effectively developed. Once a database table is defined, the Sahana
Eden Framework automatically generates HTML pages to handle CRUD
(Create, Read, Update, Delete) as well as Search, Map and Pivot
Reports. Web Services are available to import and export in XML, CSV,
JSON and EXtensible Stylesheet Language (XSL) transforms are
supported to produce other data standards.

'''Sahana Eden Architecture'''

Web Server: Apache. Other web servers can also be used,such as Cherokee.

Application: Sahana Eden

Web Application Framework: Web2Py

Programming Language: Python & JavaScript

Database: MySQL,PostgreSQL, or MySQL, PostgreSQL, and SQLite are supported. Other databases should be usable without major additional work
since Web2Py supplies many connectors.

Operating System: Linux (Debian recommended),Windows and Mac OS X are possible, but only recommended for single-user environments.

'''Installation'''

Sahana Eden can be installed on any environment which can run
Python, including Linux, Windows and OSX. The system supports a
number of different databases and has been widely tested on MySQL,
PostgreSQL and SQLite. A webserver is optional, but for production
installations we have experience of both Apache/mod_wsgi and
Cherokee/uwsgi.

Installation scripts and detailed instructions are available on the Wiki:
http://eden.sahanafoundation.org/wiki/InstallationGuidelines

'''Web2py'''

This is an MVC environment (like Rails & Django.).
Web2Py can work at several different levels of abstraction.
The Sahana Eden framework (S3) is built on Web2Py's Auth/Crud classes in tools.py (with some remnants of the older T2), however sometimes we need more control therefore need to drop down a level or two.
Can execute a controller to be able to access its functions using:
execfile("applications/eden/controllers/mycontroller.py", globals())

'''S3'''

The Sahana Eden framework (S3) is built on Web2Py and It is used for RAD in all the sahana applications. The Sahana api docs can be found at http://eden.sahanafoundation.org/wiki/DeveloperGuidelines

'''Directory Structure'''

After the installation, the typical directory structure of the instance
looks like:
[[Application_structure.png]]

==Social Media==
Social Media is playing a important role in Disaster and Emergency Management, for such things as:
- Sending warnings and emergency instructions to the public.
- Receiving help requests and incident reports from the public.
- Engaging with the public, encouraging preparedness, providing information.
- Detecting incidents not directly reported. f

==Map Feeds==
This project allows the user to add layers of Geo-tagged data from Twitter onto the Map. It searches for tweets with specific keywords (that can be configured by user on Sahana web page). It then plots the location of these tweets on the Map. This is the work that we have done as a part of our project implementation. The following stepa are involved in this:

After setting up Eden in the system twitterSearch library(https://pypi.python.org/pypi/TwitterSearch/) is to be installed which helps to fetch the tweets with specific keywords

'''Searching Tweets'''

- Configuring twitter account:

Sign into https://dev.twitter.com and create an app. (Select an application Type: Client). Put the Callback URL as blank and create your own Twitter application. After creating an app on twitter account, you will be able to see a tab called OAuth tool. Open eden/models/000_config.py file. Under Twitter Settings, add consumer_key and consumer_secret obtained from the twitter app's OAuth tool. Edit the following lines in 000_config.py
settings.msg.twitter_oauth_consumer_key = "<consumer key from twitter app>"
settings.msg.twiiter_oauth_consumer_secret = "<consumer_secret from twitter app>"

- Add keywords to be searched:

Go to a page eden/msg/twitter_search. You can add keywords / search queries records under this page. It will ask you for a PIN to enter before saving the keywords/queries. The pin is obtained from Twitter app that was created.

- Populating database with search results:

After saving the keywords/ queries, click on Results which triggers the search and msg_twitter_search_results table in the database gets populated.

'''Processing Tweets'''

After fetching the twitter feeds, the Geo-tagged tweets are processed. They are parsed to fetch user information, tweet data and location information in terms of latitude and longitude. All this information then goes into the msg_twitter_search_results table.

'''Plotting tweets on Map'''

To display tweets on map, a new layer named "Twitter" is added under the overlays section on the map page. When a user selects this option, the location ids from the msg_twitter_search_results are fetched and a marker is displayed on those locations. Clicking on the marker image displays additional tweet information such as content, time and user info.

==Future Scope==

1. Major limitation is that the twitter search keyword is hard coded.We need to make the code access the msg_twitter_search table and use the keywords stored by the user through the GUI to search and display twitter feeds on the GIS map.

2. Display twitter icon on map instead of the normal location bubble.

3. Work on the pop-up contents. Ideally this would include any photo or video linked in the message (or a URL if it's to a page of text). Actually doing the part within the tweet parsing of following embedded URLs to identify if they're Media would be really useful addition to the parser (there is a commented-out stub).

4. Create a cron job, to search tweets periodically and not only at user's request.

==Design==

==Problem with Aspect Oriented Programming==

==Setup (Installation)==

==Summary==

===Moving toward a better way to build software===

==Future==

==References==
<references/>

==Further Reading==

==External Links==

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T20:18:19Z

Kspatel6: /* Map Feeds */

==Background==
The Sahana Software Foundation is dedicated to the mission of saving lives by providing information management solutions that enable organizations and communities to better prepare for and respond to disasters. It is an open source software platform which provides a range of solutions for Disaster Management practitioners to help them reduce the impact disasters have on our communities through tracking the needs of the affected populations & coordinating the responding agencies & their resources.It can be accessed from the web or locally from a flash
drive, allowing it to be used in environments with poor internet. Local & Web versions can be configured to synchronize to allow data to be
shared between them. These features are designed to help Disaster Management practitioners to better mitigate, prepare for, respond to and recover from disasters more effectively and efficiently.

Sahana Eden is designed to be rapidly configured and customized to support the diverse business processes used within Disaster Management. Sahana Eden's modular design allows different pieces of functionality to be enabled and disabled as required providing flexible solutions for changing contexts. The application can be configured to secure sensitive information, while also making data which needs to be shared available in a variety of different formats including Microsoft Excel and PDF. To ensure that Sahana Eden is accessible to every country, it can be translated into multiple languages.

==Core modules and outlines==

'''Organization Registry'''

Many diverse organizations are involved in Disaster Management, from responding to disasters to strengthening communities to providing support to people in need. Sahana Eden’s Organization Registry can track what organizations are active in different contexts, providing opportunities for collaboration and coordination.

'''Project Tracking'''

By telling you Who’s Doing What, Where, and When, Sahana Eden provides a valuable tool to help organizations responding to disasters know where the greatest needs are and coordinate with others who are engaged in similar work.

'''Human Resources'''

The most important part of Disaster Management is the people.Whether they are community volunteers or staff working for different organizations, the Human Resources module can help manage the people involved. It will track where they are, what skills they have and help ensure that everyone is effectively engaged with the work that needs to be done. Sahana Eden can also be used to provide a contact list to ensure that the right people can be contacted at the right time.

'''Inventory'''

Whether organizations are supplying basic essentials of life to people
affected by natural disasters or giving communities the tools they
need to restore their livelihoods, Sahana Eden can be used to manage
inventories of items and match requests for items with warehouses
and other facilities which have them available. Operationally, Sahana
Eden can be used to record and automate transactions for sending
and receiving shipments. Sahana Eden can support multiple Catalogs of
Items as well as providing alternative items to ensure more effective
use of supplies. Sahana Eden can be configured to load multiple
catalogs including a generic list of items and/or the IFRC Emergency
Item Catalog.

'''Assets'''

A wide range of assets are needed to respond to disasters, including
vehicles to transport people and relief items, radio equipment to
provide communication where telecommunication infrastructure has
been destroyed, and generators to provide backup power. Sahana
Eden is able to manage assets, track where they are, who they have
been assigned to, and what condition they are in. This ensures that
assets are used effectively and efficiently.

'''Assessments'''

Sahana Eden can be used to collect and analyze information from
assessments to help organizations more effectively plan their disaster
management activities. Different assessment templates can easily be
designed and imported into Sahana Eden to support assessments for
different organizations in different contexts. Data can either be
entered into an interactive web form or imported via an Excel
template.

'''Scenarios and Events'''

To help organizations better plan for disasters, Sahana Eden can be
used to plan for different scenarios, including recording what human
resources, assets, facilities and tasks will be needed to effectively
respond.
When an incident occurs events can be created from a scenario
template to allocate the resources and alert people of the need to
respond.

'''Map'''

Sahana Eden has fully integrated mapping functionality which allows
any location-based data to be visualized on a map. This information
can also be searched using a map-based boundary selection. Maps
provide situational awareness which is essential when either planning to
prepare for or respond to a disaster. Sahana Eden supports many
standard formats for overlaying data on maps from other sources
and Geographical Information Systems (GIS), for example natural
hazard risks, population or weather.

'''Shelter Management'''

When disasters are widespread and result in population displacement,
understanding and tracking the landscape of shelters - and the people
in them - is a critical activity. The Shelter Registry provides
functionality to list and track information on shelters and on the
people arriving and departing. Shelter details include location, services
provided, responsible organization and contacts, demographics, and
needs. In addition, individual person data includes name, age, relatives,
status, health, and many other details to provide a clear understanding
of population demographics within the site.

'''Messaging'''

In the complex domain of Disaster Management, communication is
critical. Sahana Eden provides support for messages to be sent
by Email, SMS, Twitter and Google Talk. Distribution Groups can be set
up to allow messages to be easily sent to many people at once. Users
are able to search for specific information and subscribe to receive
update messages when new information is added.

==Technical Overview==

Because Sahana Eden needs to be accessible to users at remote
locations, including the public, a browser-based solution was essential.
The system also needs to be able to be used on offline laptops, so it
needs to run on a lightweight stack.

Python was selected as a suitable high level language allowing the rapid
customization of code required for each individual circumstance yet
has a large number of powerful libraries available including for
Geospatial Information Systems (GIS).

'''Shana Eden Framework'''

The Sahana Eden Software Platform has been built around a Rapid
Application Development (RAD) Framework. This provides a high level
of automation to ensure that new solutions can be quickly and
effectively developed. Once a database table is defined, the Sahana
Eden Framework automatically generates HTML pages to handle CRUD
(Create, Read, Update, Delete) as well as Search, Map and Pivot
Reports. Web Services are available to import and export in XML, CSV,
JSON and EXtensible Stylesheet Language (XSL) transforms are
supported to produce other data standards.

'''Sahana Eden Architecture'''

Web Server: Apache. Other web servers can also be used,such as Cherokee.

Application: Sahana Eden

Web Application Framework: Web2Py

Programming Language: Python & JavaScript

Database: MySQL,PostgreSQL, or MySQL, PostgreSQL, and SQLite are supported. Other databases should be usable without major additional work
since Web2Py supplies many connectors.

Operating System: Linux (Debian recommended),Windows and Mac OS X are possible, but only recommended for single-user environments.

'''Installation'''

Sahana Eden can be installed on any environment which can run
Python, including Linux, Windows and OSX. The system supports a
number of different databases and has been widely tested on MySQL,
PostgreSQL and SQLite. A webserver is optional, but for production
installations we have experience of both Apache/mod_wsgi and
Cherokee/uwsgi.

Installation scripts and detailed instructions are available on the Wiki:
http://eden.sahanafoundation.org/wiki/InstallationGuidelines

'''Web2py'''

This is an MVC environment (like Rails & Django.).
Web2Py can work at several different levels of abstraction.
The Sahana Eden framework (S3) is built on Web2Py's Auth/Crud classes in tools.py (with some remnants of the older T2), however sometimes we need more control therefore need to drop down a level or two.
Can execute a controller to be able to access its functions using:
execfile("applications/eden/controllers/mycontroller.py", globals())

'''S3'''

The Sahana Eden framework (S3) is built on Web2Py and It is used for RAD in all the sahana applications. The Sahana api docs can be found at http://eden.sahanafoundation.org/wiki/DeveloperGuidelines

'''Directory Structure'''

After the installation, the typical directory structure of the instance
looks like:
[[Application_structure.png]]

==Social Media==
Social Media is playing a important role in Disaster and Emergency Management, for such things as:
- Sending warnings and emergency instructions to the public.
- Receiving help requests and incident reports from the public.
- Engaging with the public, encouraging preparedness, providing information.
- Detecting incidents not directly reported. f

==Map Feeds==
This project allows the user to add layers of Geo-tagged data from Twitter onto the Map. It searches for tweets with specific keywords (that can be configured by user on Sahana web page). It then plots the location of these tweets on the Map. This is the work that we have done as a part of our project implementation. The following stepa are involved in this:

After setting up Eden in the system twitterSearch library(https://pypi.python.org/pypi/TwitterSearch/) is to be installed which helps to fetch the tweets with specific keywords

'''Searching Tweets'''

- Configuring twitter account:

Sign into https://dev.twitter.com and create an app. (Select an application Type: Client). Put the Callback URL as blank and create your own Twitter application. After creating an app on twitter account, you will be able to see a tab called OAuth tool. Open eden/models/000_config.py file. Under Twitter Settings, add consumer_key and consumer_secret obtained from the twitter app's OAuth tool. Edit the following lines in 000_config.py
settings.msg.twitter_oauth_consumer_key = "<consumer key from twitter app>"
settings.msg.twiiter_oauth_consumer_secret = "<consumer_secret from twitter app>"

- Add keywords to be searched:

Go to a page eden/msg/twitter_search. You can add keywords / search queries records under this page. It will ask you for a PIN to enter before saving the keywords/queries. The pin is obtained from Twitter app that was created.

- Populating database with search results:

After saving the keywords/ queries, click on Results which triggers the search and msg_twitter_search_results table in the database gets populated.

'''Processing Tweets'''

After fetching the twitter feeds, the Geo-tagged tweets are processed. They are parsed to fetch user information, tweet data and location information in terms of latitude and longitude. All this information then goes into the msg_twitter_search_results table.

'''Plotting tweets on Map'''

To display tweets on map, a new layer named "Twitter" is added under the overlays section on the map page. When a user selects this option, the location ids from the msg_twitter_search_results are fetched and a marker is displayed on those locations. Clicking on the marker image displays additional tweet information such as content, time and user info.

===Cross Cutting Concerns===

==Design==

==Problem with Aspect Oriented Programming==

==Setup (Installation)==

==Summary==

===Moving toward a better way to build software===

==Future==

==References==
<references/>

==Further Reading==

==External Links==

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T20:11:41Z

Kspatel6: /* Map Feeds */

==Background==
The Sahana Software Foundation is dedicated to the mission of saving lives by providing information management solutions that enable organizations and communities to better prepare for and respond to disasters. It is an open source software platform which provides a range of solutions for Disaster Management practitioners to help them reduce the impact disasters have on our communities through tracking the needs of the affected populations & coordinating the responding agencies & their resources.It can be accessed from the web or locally from a flash
drive, allowing it to be used in environments with poor internet. Local & Web versions can be configured to synchronize to allow data to be
shared between them. These features are designed to help Disaster Management practitioners to better mitigate, prepare for, respond to and recover from disasters more effectively and efficiently.

Sahana Eden is designed to be rapidly configured and customized to support the diverse business processes used within Disaster Management. Sahana Eden's modular design allows different pieces of functionality to be enabled and disabled as required providing flexible solutions for changing contexts. The application can be configured to secure sensitive information, while also making data which needs to be shared available in a variety of different formats including Microsoft Excel and PDF. To ensure that Sahana Eden is accessible to every country, it can be translated into multiple languages.

==Core modules and outlines==

'''Organization Registry'''

Many diverse organizations are involved in Disaster Management, from responding to disasters to strengthening communities to providing support to people in need. Sahana Eden’s Organization Registry can track what organizations are active in different contexts, providing opportunities for collaboration and coordination.

'''Project Tracking'''

By telling you Who’s Doing What, Where, and When, Sahana Eden provides a valuable tool to help organizations responding to disasters know where the greatest needs are and coordinate with others who are engaged in similar work.

'''Human Resources'''

The most important part of Disaster Management is the people.Whether they are community volunteers or staff working for different organizations, the Human Resources module can help manage the people involved. It will track where they are, what skills they have and help ensure that everyone is effectively engaged with the work that needs to be done. Sahana Eden can also be used to provide a contact list to ensure that the right people can be contacted at the right time.

'''Inventory'''

Whether organizations are supplying basic essentials of life to people
affected by natural disasters or giving communities the tools they
need to restore their livelihoods, Sahana Eden can be used to manage
inventories of items and match requests for items with warehouses
and other facilities which have them available. Operationally, Sahana
Eden can be used to record and automate transactions for sending
and receiving shipments. Sahana Eden can support multiple Catalogs of
Items as well as providing alternative items to ensure more effective
use of supplies. Sahana Eden can be configured to load multiple
catalogs including a generic list of items and/or the IFRC Emergency
Item Catalog.

'''Assets'''

A wide range of assets are needed to respond to disasters, including
vehicles to transport people and relief items, radio equipment to
provide communication where telecommunication infrastructure has
been destroyed, and generators to provide backup power. Sahana
Eden is able to manage assets, track where they are, who they have
been assigned to, and what condition they are in. This ensures that
assets are used effectively and efficiently.

'''Assessments'''

Sahana Eden can be used to collect and analyze information from
assessments to help organizations more effectively plan their disaster
management activities. Different assessment templates can easily be
designed and imported into Sahana Eden to support assessments for
different organizations in different contexts. Data can either be
entered into an interactive web form or imported via an Excel
template.

'''Scenarios and Events'''

To help organizations better plan for disasters, Sahana Eden can be
used to plan for different scenarios, including recording what human
resources, assets, facilities and tasks will be needed to effectively
respond.
When an incident occurs events can be created from a scenario
template to allocate the resources and alert people of the need to
respond.

'''Map'''

Sahana Eden has fully integrated mapping functionality which allows
any location-based data to be visualized on a map. This information
can also be searched using a map-based boundary selection. Maps
provide situational awareness which is essential when either planning to
prepare for or respond to a disaster. Sahana Eden supports many
standard formats for overlaying data on maps from other sources
and Geographical Information Systems (GIS), for example natural
hazard risks, population or weather.

'''Shelter Management'''

When disasters are widespread and result in population displacement,
understanding and tracking the landscape of shelters - and the people
in them - is a critical activity. The Shelter Registry provides
functionality to list and track information on shelters and on the
people arriving and departing. Shelter details include location, services
provided, responsible organization and contacts, demographics, and
needs. In addition, individual person data includes name, age, relatives,
status, health, and many other details to provide a clear understanding
of population demographics within the site.

'''Messaging'''

In the complex domain of Disaster Management, communication is
critical. Sahana Eden provides support for messages to be sent
by Email, SMS, Twitter and Google Talk. Distribution Groups can be set
up to allow messages to be easily sent to many people at once. Users
are able to search for specific information and subscribe to receive
update messages when new information is added.

==Technical Overview==

Because Sahana Eden needs to be accessible to users at remote
locations, including the public, a browser-based solution was essential.
The system also needs to be able to be used on offline laptops, so it
needs to run on a lightweight stack.

Python was selected as a suitable high level language allowing the rapid
customization of code required for each individual circumstance yet
has a large number of powerful libraries available including for
Geospatial Information Systems (GIS).

'''Shana Eden Framework'''

The Sahana Eden Software Platform has been built around a Rapid
Application Development (RAD) Framework. This provides a high level
of automation to ensure that new solutions can be quickly and
effectively developed. Once a database table is defined, the Sahana
Eden Framework automatically generates HTML pages to handle CRUD
(Create, Read, Update, Delete) as well as Search, Map and Pivot
Reports. Web Services are available to import and export in XML, CSV,
JSON and EXtensible Stylesheet Language (XSL) transforms are
supported to produce other data standards.

'''Sahana Eden Architecture'''

Web Server: Apache. Other web servers can also be used,such as Cherokee.

Application: Sahana Eden

Web Application Framework: Web2Py

Programming Language: Python & JavaScript

Database: MySQL,PostgreSQL, or MySQL, PostgreSQL, and SQLite are supported. Other databases should be usable without major additional work
since Web2Py supplies many connectors.

Operating System: Linux (Debian recommended),Windows and Mac OS X are possible, but only recommended for single-user environments.

'''Installation'''

Sahana Eden can be installed on any environment which can run
Python, including Linux, Windows and OSX. The system supports a
number of different databases and has been widely tested on MySQL,
PostgreSQL and SQLite. A webserver is optional, but for production
installations we have experience of both Apache/mod_wsgi and
Cherokee/uwsgi.

Installation scripts and detailed instructions are available on the Wiki:
http://eden.sahanafoundation.org/wiki/InstallationGuidelines

'''Web2py'''

This is an MVC environment (like Rails & Django.).
Web2Py can work at several different levels of abstraction.
The Sahana Eden framework (S3) is built on Web2Py's Auth/Crud classes in tools.py (with some remnants of the older T2), however sometimes we need more control therefore need to drop down a level or two.
Can execute a controller to be able to access its functions using:
execfile("applications/eden/controllers/mycontroller.py", globals())

'''S3'''

The Sahana Eden framework (S3) is built on Web2Py and It is used for RAD in all the sahana applications. The Sahana api docs can be found at http://eden.sahanafoundation.org/wiki/DeveloperGuidelines

'''Directory Structure'''

After the installation, the typical directory structure of the instance
looks like:
[[Application_structure.png]]

==Social Media==
Social Media is playing a important role in Disaster and Emergency Management, for such things as:
- Sending warnings and emergency instructions to the public.
- Receiving help requests and incident reports from the public.
- Engaging with the public, encouraging preparedness, providing information.
- Detecting incidents not directly reported. f

==Map Feeds==
This project allows the user to add layers of Geo-tagged data from Twitter onto the Map. It searches for tweets with specific keywords (that can be configured by user on Sahana web page). It then plots the location of these tweets on the Map. This is the work that we have done as a part of our project implementation. The following stepa are involved in this:

After setting up Eden in the system twitterSearch library(https://pypi.python.org/pypi/TwitterSearch/) is to be installed which helps to fetch the tweets with specific keywords

'''Searching Tweets'''

- Configuring twitter account:

Sign into https://dev.twitter.com and create an app. (Select an application Type: Client). Put the Callback URL as blank and create your own Twitter application. After creating an app on twitter account, you will be able to see a tab called OAuth tool. Open eden/models/000_config.py file. Under Twitter Settings, add consumer_key and consumer_secret obtained from the twitter app's OAuth tool. Edit the following lines in 000_config.py
settings.msg.twitter_oauth_consumer_key = "<consumer key from twitter app>"
settings.msg.twiiter_oauth_consumer_secret = "<consumer_secret from twitter app>"
- Add keywords to be searched:

Go to a page eden/msg/twitter_search. You can add keywords / search queries records under this page. It will ask you for a PIN to enter before saving the keywords/queries. The pin is obtained from Twitter app that was created.
- Populating database with search results:

After saving the keywords/ queries, click on Results which triggers the search and msg_twitter_search_results table in the database gets populated.

===Cross Cutting Concerns===

==Design==

==Problem with Aspect Oriented Programming==

==Setup (Installation)==

==Summary==

===Moving toward a better way to build software===

==Future==

==References==
<references/>

==Further Reading==

==External Links==

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T20:10:56Z

Kspatel6: /* Map Feeds */

==Background==
The Sahana Software Foundation is dedicated to the mission of saving lives by providing information management solutions that enable organizations and communities to better prepare for and respond to disasters. It is an open source software platform which provides a range of solutions for Disaster Management practitioners to help them reduce the impact disasters have on our communities through tracking the needs of the affected populations & coordinating the responding agencies & their resources.It can be accessed from the web or locally from a flash
drive, allowing it to be used in environments with poor internet. Local & Web versions can be configured to synchronize to allow data to be
shared between them. These features are designed to help Disaster Management practitioners to better mitigate, prepare for, respond to and recover from disasters more effectively and efficiently.

Sahana Eden is designed to be rapidly configured and customized to support the diverse business processes used within Disaster Management. Sahana Eden's modular design allows different pieces of functionality to be enabled and disabled as required providing flexible solutions for changing contexts. The application can be configured to secure sensitive information, while also making data which needs to be shared available in a variety of different formats including Microsoft Excel and PDF. To ensure that Sahana Eden is accessible to every country, it can be translated into multiple languages.

==Core modules and outlines==

'''Organization Registry'''

Many diverse organizations are involved in Disaster Management, from responding to disasters to strengthening communities to providing support to people in need. Sahana Eden’s Organization Registry can track what organizations are active in different contexts, providing opportunities for collaboration and coordination.

'''Project Tracking'''

By telling you Who’s Doing What, Where, and When, Sahana Eden provides a valuable tool to help organizations responding to disasters know where the greatest needs are and coordinate with others who are engaged in similar work.

'''Human Resources'''

The most important part of Disaster Management is the people.Whether they are community volunteers or staff working for different organizations, the Human Resources module can help manage the people involved. It will track where they are, what skills they have and help ensure that everyone is effectively engaged with the work that needs to be done. Sahana Eden can also be used to provide a contact list to ensure that the right people can be contacted at the right time.

'''Inventory'''

Whether organizations are supplying basic essentials of life to people
affected by natural disasters or giving communities the tools they
need to restore their livelihoods, Sahana Eden can be used to manage
inventories of items and match requests for items with warehouses
and other facilities which have them available. Operationally, Sahana
Eden can be used to record and automate transactions for sending
and receiving shipments. Sahana Eden can support multiple Catalogs of
Items as well as providing alternative items to ensure more effective
use of supplies. Sahana Eden can be configured to load multiple
catalogs including a generic list of items and/or the IFRC Emergency
Item Catalog.

'''Assets'''

A wide range of assets are needed to respond to disasters, including
vehicles to transport people and relief items, radio equipment to
provide communication where telecommunication infrastructure has
been destroyed, and generators to provide backup power. Sahana
Eden is able to manage assets, track where they are, who they have
been assigned to, and what condition they are in. This ensures that
assets are used effectively and efficiently.

'''Assessments'''

Sahana Eden can be used to collect and analyze information from
assessments to help organizations more effectively plan their disaster
management activities. Different assessment templates can easily be
designed and imported into Sahana Eden to support assessments for
different organizations in different contexts. Data can either be
entered into an interactive web form or imported via an Excel
template.

'''Scenarios and Events'''

To help organizations better plan for disasters, Sahana Eden can be
used to plan for different scenarios, including recording what human
resources, assets, facilities and tasks will be needed to effectively
respond.
When an incident occurs events can be created from a scenario
template to allocate the resources and alert people of the need to
respond.

'''Map'''

Sahana Eden has fully integrated mapping functionality which allows
any location-based data to be visualized on a map. This information
can also be searched using a map-based boundary selection. Maps
provide situational awareness which is essential when either planning to
prepare for or respond to a disaster. Sahana Eden supports many
standard formats for overlaying data on maps from other sources
and Geographical Information Systems (GIS), for example natural
hazard risks, population or weather.

'''Shelter Management'''

When disasters are widespread and result in population displacement,
understanding and tracking the landscape of shelters - and the people
in them - is a critical activity. The Shelter Registry provides
functionality to list and track information on shelters and on the
people arriving and departing. Shelter details include location, services
provided, responsible organization and contacts, demographics, and
needs. In addition, individual person data includes name, age, relatives,
status, health, and many other details to provide a clear understanding
of population demographics within the site.

'''Messaging'''

In the complex domain of Disaster Management, communication is
critical. Sahana Eden provides support for messages to be sent
by Email, SMS, Twitter and Google Talk. Distribution Groups can be set
up to allow messages to be easily sent to many people at once. Users
are able to search for specific information and subscribe to receive
update messages when new information is added.

==Technical Overview==

Because Sahana Eden needs to be accessible to users at remote
locations, including the public, a browser-based solution was essential.
The system also needs to be able to be used on offline laptops, so it
needs to run on a lightweight stack.

Python was selected as a suitable high level language allowing the rapid
customization of code required for each individual circumstance yet
has a large number of powerful libraries available including for
Geospatial Information Systems (GIS).

'''Shana Eden Framework'''

The Sahana Eden Software Platform has been built around a Rapid
Application Development (RAD) Framework. This provides a high level
of automation to ensure that new solutions can be quickly and
effectively developed. Once a database table is defined, the Sahana
Eden Framework automatically generates HTML pages to handle CRUD
(Create, Read, Update, Delete) as well as Search, Map and Pivot
Reports. Web Services are available to import and export in XML, CSV,
JSON and EXtensible Stylesheet Language (XSL) transforms are
supported to produce other data standards.

'''Sahana Eden Architecture'''

Web Server: Apache. Other web servers can also be used,such as Cherokee.

Application: Sahana Eden

Web Application Framework: Web2Py

Programming Language: Python & JavaScript

Database: MySQL,PostgreSQL, or MySQL, PostgreSQL, and SQLite are supported. Other databases should be usable without major additional work
since Web2Py supplies many connectors.

Operating System: Linux (Debian recommended),Windows and Mac OS X are possible, but only recommended for single-user environments.

'''Installation'''

Sahana Eden can be installed on any environment which can run
Python, including Linux, Windows and OSX. The system supports a
number of different databases and has been widely tested on MySQL,
PostgreSQL and SQLite. A webserver is optional, but for production
installations we have experience of both Apache/mod_wsgi and
Cherokee/uwsgi.

Installation scripts and detailed instructions are available on the Wiki:
http://eden.sahanafoundation.org/wiki/InstallationGuidelines

'''Web2py'''

This is an MVC environment (like Rails & Django.).
Web2Py can work at several different levels of abstraction.
The Sahana Eden framework (S3) is built on Web2Py's Auth/Crud classes in tools.py (with some remnants of the older T2), however sometimes we need more control therefore need to drop down a level or two.
Can execute a controller to be able to access its functions using:
execfile("applications/eden/controllers/mycontroller.py", globals())

'''S3'''

The Sahana Eden framework (S3) is built on Web2Py and It is used for RAD in all the sahana applications. The Sahana api docs can be found at http://eden.sahanafoundation.org/wiki/DeveloperGuidelines

'''Directory Structure'''

After the installation, the typical directory structure of the instance
looks like:
[[Application_structure.png]]

==Social Media==
Social Media is playing a important role in Disaster and Emergency Management, for such things as:
- Sending warnings and emergency instructions to the public.
- Receiving help requests and incident reports from the public.
- Engaging with the public, encouraging preparedness, providing information.
- Detecting incidents not directly reported. f

==Map Feeds==
This project allows the user to add layers of Geo-tagged data from Twitter onto the Map. It searches for tweets with specific keywords (that can be configured by user on Sahana web page). It then plots the location of these tweets on the Map. This is the work that we have done as a part of our project implementation. The following stepa are involved in this:

After setting up Eden in the system twitterSearch library(https://pypi.python.org/pypi/TwitterSearch/) is to be installed which helps to fetch the tweets with specific keywords

'''Searching Tweets'''
- Configuring twitter account:

Sign into https://dev.twitter.com and create an app. (Select an application Type: Client). Put the Callback URL as blank and create your own Twitter application. After creating an app on twitter account, you will be able to see a tab called OAuth tool. Open eden/models/000_config.py file. Under Twitter Settings, add consumer_key and consumer_secret obtained from the twitter app's OAuth tool. Edit the following lines in 000_config.py
settings.msg.twitter_oauth_consumer_key = "<consumer key from twitter app>"
settings.msg.twiiter_oauth_consumer_secret = "<consumer_secret from twitter app>"
- Add keywords to be searched:

Go to a page eden/msg/twitter_search. You can add keywords / search queries records under this page. It will ask you for a PIN to enter before saving the keywords/queries. The pin is obtained from Twitter app that was created.
- Populating database with search results:

After saving the keywords/ queries, click on Results which triggers the search and msg_twitter_search_results table in the database gets populated.

===Cross Cutting Concerns===

==Design==

==Problem with Aspect Oriented Programming==

==Setup (Installation)==

==Summary==

===Moving toward a better way to build software===

==Future==

==References==
<references/>

==Further Reading==

==External Links==

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T20:08:22Z

Kspatel6: /* Map Feeds */

==Background==
The Sahana Software Foundation is dedicated to the mission of saving lives by providing information management solutions that enable organizations and communities to better prepare for and respond to disasters. It is an open source software platform which provides a range of solutions for Disaster Management practitioners to help them reduce the impact disasters have on our communities through tracking the needs of the affected populations & coordinating the responding agencies & their resources.It can be accessed from the web or locally from a flash
drive, allowing it to be used in environments with poor internet. Local & Web versions can be configured to synchronize to allow data to be
shared between them. These features are designed to help Disaster Management practitioners to better mitigate, prepare for, respond to and recover from disasters more effectively and efficiently.

Sahana Eden is designed to be rapidly configured and customized to support the diverse business processes used within Disaster Management. Sahana Eden's modular design allows different pieces of functionality to be enabled and disabled as required providing flexible solutions for changing contexts. The application can be configured to secure sensitive information, while also making data which needs to be shared available in a variety of different formats including Microsoft Excel and PDF. To ensure that Sahana Eden is accessible to every country, it can be translated into multiple languages.

==Core modules and outlines==

'''Organization Registry'''

Many diverse organizations are involved in Disaster Management, from responding to disasters to strengthening communities to providing support to people in need. Sahana Eden’s Organization Registry can track what organizations are active in different contexts, providing opportunities for collaboration and coordination.

'''Project Tracking'''

By telling you Who’s Doing What, Where, and When, Sahana Eden provides a valuable tool to help organizations responding to disasters know where the greatest needs are and coordinate with others who are engaged in similar work.

'''Human Resources'''

The most important part of Disaster Management is the people.Whether they are community volunteers or staff working for different organizations, the Human Resources module can help manage the people involved. It will track where they are, what skills they have and help ensure that everyone is effectively engaged with the work that needs to be done. Sahana Eden can also be used to provide a contact list to ensure that the right people can be contacted at the right time.

'''Inventory'''

Whether organizations are supplying basic essentials of life to people
affected by natural disasters or giving communities the tools they
need to restore their livelihoods, Sahana Eden can be used to manage
inventories of items and match requests for items with warehouses
and other facilities which have them available. Operationally, Sahana
Eden can be used to record and automate transactions for sending
and receiving shipments. Sahana Eden can support multiple Catalogs of
Items as well as providing alternative items to ensure more effective
use of supplies. Sahana Eden can be configured to load multiple
catalogs including a generic list of items and/or the IFRC Emergency
Item Catalog.

'''Assets'''

A wide range of assets are needed to respond to disasters, including
vehicles to transport people and relief items, radio equipment to
provide communication where telecommunication infrastructure has
been destroyed, and generators to provide backup power. Sahana
Eden is able to manage assets, track where they are, who they have
been assigned to, and what condition they are in. This ensures that
assets are used effectively and efficiently.

'''Assessments'''

Sahana Eden can be used to collect and analyze information from
assessments to help organizations more effectively plan their disaster
management activities. Different assessment templates can easily be
designed and imported into Sahana Eden to support assessments for
different organizations in different contexts. Data can either be
entered into an interactive web form or imported via an Excel
template.

'''Scenarios and Events'''

To help organizations better plan for disasters, Sahana Eden can be
used to plan for different scenarios, including recording what human
resources, assets, facilities and tasks will be needed to effectively
respond.
When an incident occurs events can be created from a scenario
template to allocate the resources and alert people of the need to
respond.

'''Map'''

Sahana Eden has fully integrated mapping functionality which allows
any location-based data to be visualized on a map. This information
can also be searched using a map-based boundary selection. Maps
provide situational awareness which is essential when either planning to
prepare for or respond to a disaster. Sahana Eden supports many
standard formats for overlaying data on maps from other sources
and Geographical Information Systems (GIS), for example natural
hazard risks, population or weather.

'''Shelter Management'''

When disasters are widespread and result in population displacement,
understanding and tracking the landscape of shelters - and the people
in them - is a critical activity. The Shelter Registry provides
functionality to list and track information on shelters and on the
people arriving and departing. Shelter details include location, services
provided, responsible organization and contacts, demographics, and
needs. In addition, individual person data includes name, age, relatives,
status, health, and many other details to provide a clear understanding
of population demographics within the site.

'''Messaging'''

In the complex domain of Disaster Management, communication is
critical. Sahana Eden provides support for messages to be sent
by Email, SMS, Twitter and Google Talk. Distribution Groups can be set
up to allow messages to be easily sent to many people at once. Users
are able to search for specific information and subscribe to receive
update messages when new information is added.

==Technical Overview==

Because Sahana Eden needs to be accessible to users at remote
locations, including the public, a browser-based solution was essential.
The system also needs to be able to be used on offline laptops, so it
needs to run on a lightweight stack.

Python was selected as a suitable high level language allowing the rapid
customization of code required for each individual circumstance yet
has a large number of powerful libraries available including for
Geospatial Information Systems (GIS).

'''Shana Eden Framework'''

The Sahana Eden Software Platform has been built around a Rapid
Application Development (RAD) Framework. This provides a high level
of automation to ensure that new solutions can be quickly and
effectively developed. Once a database table is defined, the Sahana
Eden Framework automatically generates HTML pages to handle CRUD
(Create, Read, Update, Delete) as well as Search, Map and Pivot
Reports. Web Services are available to import and export in XML, CSV,
JSON and EXtensible Stylesheet Language (XSL) transforms are
supported to produce other data standards.

'''Sahana Eden Architecture'''

Web Server: Apache. Other web servers can also be used,such as Cherokee.

Application: Sahana Eden

Web Application Framework: Web2Py

Programming Language: Python & JavaScript

Database: MySQL,PostgreSQL, or MySQL, PostgreSQL, and SQLite are supported. Other databases should be usable without major additional work
since Web2Py supplies many connectors.

Operating System: Linux (Debian recommended),Windows and Mac OS X are possible, but only recommended for single-user environments.

'''Installation'''

Sahana Eden can be installed on any environment which can run
Python, including Linux, Windows and OSX. The system supports a
number of different databases and has been widely tested on MySQL,
PostgreSQL and SQLite. A webserver is optional, but for production
installations we have experience of both Apache/mod_wsgi and
Cherokee/uwsgi.

Installation scripts and detailed instructions are available on the Wiki:
http://eden.sahanafoundation.org/wiki/InstallationGuidelines

'''Web2py'''

This is an MVC environment (like Rails & Django.).
Web2Py can work at several different levels of abstraction.
The Sahana Eden framework (S3) is built on Web2Py's Auth/Crud classes in tools.py (with some remnants of the older T2), however sometimes we need more control therefore need to drop down a level or two.
Can execute a controller to be able to access its functions using:
execfile("applications/eden/controllers/mycontroller.py", globals())

'''S3'''

The Sahana Eden framework (S3) is built on Web2Py and It is used for RAD in all the sahana applications. The Sahana api docs can be found at http://eden.sahanafoundation.org/wiki/DeveloperGuidelines

'''Directory Structure'''

After the installation, the typical directory structure of the instance
looks like:
[[Application_structure.png]]

==Social Media==
Social Media is playing a important role in Disaster and Emergency Management, for such things as:
- Sending warnings and emergency instructions to the public.
- Receiving help requests and incident reports from the public.
- Engaging with the public, encouraging preparedness, providing information.
- Detecting incidents not directly reported. f

==Map Feeds==
This project allows the user to add layers of Geo-tagged data from Twitter onto the Map. It searches for tweets with specific keywords (that can be configured by user on Sahana web page). It then plots the location of these tweets on the Map. This is the work that we have done as a part of our project implementation. The following stepa are involved in this:

After setting up Eden in the system twitterSearch library(https://pypi.python.org/pypi/TwitterSearch/) is to be installed which helps to fetch the tweets with specific keywords

'''Searching Tweets'''

===Cross Cutting Concerns===

==Design==

==Problem with Aspect Oriented Programming==

==Setup (Installation)==

==Summary==

===Moving toward a better way to build software===

==Future==

==References==
<references/>

==Further Reading==

==External Links==

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T20:08:10Z

Kspatel6: /* Social Media */

==Background==
The Sahana Software Foundation is dedicated to the mission of saving lives by providing information management solutions that enable organizations and communities to better prepare for and respond to disasters. It is an open source software platform which provides a range of solutions for Disaster Management practitioners to help them reduce the impact disasters have on our communities through tracking the needs of the affected populations & coordinating the responding agencies & their resources.It can be accessed from the web or locally from a flash
drive, allowing it to be used in environments with poor internet. Local & Web versions can be configured to synchronize to allow data to be
shared between them. These features are designed to help Disaster Management practitioners to better mitigate, prepare for, respond to and recover from disasters more effectively and efficiently.

Sahana Eden is designed to be rapidly configured and customized to support the diverse business processes used within Disaster Management. Sahana Eden's modular design allows different pieces of functionality to be enabled and disabled as required providing flexible solutions for changing contexts. The application can be configured to secure sensitive information, while also making data which needs to be shared available in a variety of different formats including Microsoft Excel and PDF. To ensure that Sahana Eden is accessible to every country, it can be translated into multiple languages.

==Core modules and outlines==

'''Organization Registry'''

Many diverse organizations are involved in Disaster Management, from responding to disasters to strengthening communities to providing support to people in need. Sahana Eden’s Organization Registry can track what organizations are active in different contexts, providing opportunities for collaboration and coordination.

'''Project Tracking'''

By telling you Who’s Doing What, Where, and When, Sahana Eden provides a valuable tool to help organizations responding to disasters know where the greatest needs are and coordinate with others who are engaged in similar work.

'''Human Resources'''

The most important part of Disaster Management is the people.Whether they are community volunteers or staff working for different organizations, the Human Resources module can help manage the people involved. It will track where they are, what skills they have and help ensure that everyone is effectively engaged with the work that needs to be done. Sahana Eden can also be used to provide a contact list to ensure that the right people can be contacted at the right time.

'''Inventory'''

Whether organizations are supplying basic essentials of life to people
affected by natural disasters or giving communities the tools they
need to restore their livelihoods, Sahana Eden can be used to manage
inventories of items and match requests for items with warehouses
and other facilities which have them available. Operationally, Sahana
Eden can be used to record and automate transactions for sending
and receiving shipments. Sahana Eden can support multiple Catalogs of
Items as well as providing alternative items to ensure more effective
use of supplies. Sahana Eden can be configured to load multiple
catalogs including a generic list of items and/or the IFRC Emergency
Item Catalog.

'''Assets'''

A wide range of assets are needed to respond to disasters, including
vehicles to transport people and relief items, radio equipment to
provide communication where telecommunication infrastructure has
been destroyed, and generators to provide backup power. Sahana
Eden is able to manage assets, track where they are, who they have
been assigned to, and what condition they are in. This ensures that
assets are used effectively and efficiently.

'''Assessments'''

Sahana Eden can be used to collect and analyze information from
assessments to help organizations more effectively plan their disaster
management activities. Different assessment templates can easily be
designed and imported into Sahana Eden to support assessments for
different organizations in different contexts. Data can either be
entered into an interactive web form or imported via an Excel
template.

'''Scenarios and Events'''

To help organizations better plan for disasters, Sahana Eden can be
used to plan for different scenarios, including recording what human
resources, assets, facilities and tasks will be needed to effectively
respond.
When an incident occurs events can be created from a scenario
template to allocate the resources and alert people of the need to
respond.

'''Map'''

Sahana Eden has fully integrated mapping functionality which allows
any location-based data to be visualized on a map. This information
can also be searched using a map-based boundary selection. Maps
provide situational awareness which is essential when either planning to
prepare for or respond to a disaster. Sahana Eden supports many
standard formats for overlaying data on maps from other sources
and Geographical Information Systems (GIS), for example natural
hazard risks, population or weather.

'''Shelter Management'''

When disasters are widespread and result in population displacement,
understanding and tracking the landscape of shelters - and the people
in them - is a critical activity. The Shelter Registry provides
functionality to list and track information on shelters and on the
people arriving and departing. Shelter details include location, services
provided, responsible organization and contacts, demographics, and
needs. In addition, individual person data includes name, age, relatives,
status, health, and many other details to provide a clear understanding
of population demographics within the site.

'''Messaging'''

In the complex domain of Disaster Management, communication is
critical. Sahana Eden provides support for messages to be sent
by Email, SMS, Twitter and Google Talk. Distribution Groups can be set
up to allow messages to be easily sent to many people at once. Users
are able to search for specific information and subscribe to receive
update messages when new information is added.

==Technical Overview==

Because Sahana Eden needs to be accessible to users at remote
locations, including the public, a browser-based solution was essential.
The system also needs to be able to be used on offline laptops, so it
needs to run on a lightweight stack.

Python was selected as a suitable high level language allowing the rapid
customization of code required for each individual circumstance yet
has a large number of powerful libraries available including for
Geospatial Information Systems (GIS).

'''Shana Eden Framework'''

The Sahana Eden Software Platform has been built around a Rapid
Application Development (RAD) Framework. This provides a high level
of automation to ensure that new solutions can be quickly and
effectively developed. Once a database table is defined, the Sahana
Eden Framework automatically generates HTML pages to handle CRUD
(Create, Read, Update, Delete) as well as Search, Map and Pivot
Reports. Web Services are available to import and export in XML, CSV,
JSON and EXtensible Stylesheet Language (XSL) transforms are
supported to produce other data standards.

'''Sahana Eden Architecture'''

Web Server: Apache. Other web servers can also be used,such as Cherokee.

Application: Sahana Eden

Web Application Framework: Web2Py

Programming Language: Python & JavaScript

Database: MySQL,PostgreSQL, or MySQL, PostgreSQL, and SQLite are supported. Other databases should be usable without major additional work
since Web2Py supplies many connectors.

Operating System: Linux (Debian recommended),Windows and Mac OS X are possible, but only recommended for single-user environments.

'''Installation'''

Sahana Eden can be installed on any environment which can run
Python, including Linux, Windows and OSX. The system supports a
number of different databases and has been widely tested on MySQL,
PostgreSQL and SQLite. A webserver is optional, but for production
installations we have experience of both Apache/mod_wsgi and
Cherokee/uwsgi.

Installation scripts and detailed instructions are available on the Wiki:
http://eden.sahanafoundation.org/wiki/InstallationGuidelines

'''Web2py'''

This is an MVC environment (like Rails & Django.).
Web2Py can work at several different levels of abstraction.
The Sahana Eden framework (S3) is built on Web2Py's Auth/Crud classes in tools.py (with some remnants of the older T2), however sometimes we need more control therefore need to drop down a level or two.
Can execute a controller to be able to access its functions using:
execfile("applications/eden/controllers/mycontroller.py", globals())

'''S3'''

The Sahana Eden framework (S3) is built on Web2Py and It is used for RAD in all the sahana applications. The Sahana api docs can be found at http://eden.sahanafoundation.org/wiki/DeveloperGuidelines

'''Directory Structure'''

After the installation, the typical directory structure of the instance
looks like:
[[Application_structure.png]]

==Social Media==
Social Media is playing a important role in Disaster and Emergency Management, for such things as:
- Sending warnings and emergency instructions to the public.
- Receiving help requests and incident reports from the public.
- Engaging with the public, encouraging preparedness, providing information.
- Detecting incidents not directly reported. f

===Map Feeds===
This project allows the user to add layers of Geo-tagged data from Twitter onto the Map. It searches for tweets with specific keywords (that can be configured by user on Sahana web page). It then plots the location of these tweets on the Map. This is the work that we have done as a part of our project implementation. The following stepa are involved in this:

After setting up Eden in the system twitterSearch library(https://pypi.python.org/pypi/TwitterSearch/) is to be installed which helps to fetch the tweets with specific keywords

'''Searching Tweets'''

===Cross Cutting Concerns===

==Design==

==Problem with Aspect Oriented Programming==

==Setup (Installation)==

==Summary==

===Moving toward a better way to build software===

==Future==

==References==
<references/>

==Further Reading==

==External Links==

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T20:07:22Z

Kspatel6:

==Background==
The Sahana Software Foundation is dedicated to the mission of saving lives by providing information management solutions that enable organizations and communities to better prepare for and respond to disasters. It is an open source software platform which provides a range of solutions for Disaster Management practitioners to help them reduce the impact disasters have on our communities through tracking the needs of the affected populations & coordinating the responding agencies & their resources.It can be accessed from the web or locally from a flash
drive, allowing it to be used in environments with poor internet. Local & Web versions can be configured to synchronize to allow data to be
shared between them. These features are designed to help Disaster Management practitioners to better mitigate, prepare for, respond to and recover from disasters more effectively and efficiently.

Sahana Eden is designed to be rapidly configured and customized to support the diverse business processes used within Disaster Management. Sahana Eden's modular design allows different pieces of functionality to be enabled and disabled as required providing flexible solutions for changing contexts. The application can be configured to secure sensitive information, while also making data which needs to be shared available in a variety of different formats including Microsoft Excel and PDF. To ensure that Sahana Eden is accessible to every country, it can be translated into multiple languages.

==Core modules and outlines==

'''Organization Registry'''

Many diverse organizations are involved in Disaster Management, from responding to disasters to strengthening communities to providing support to people in need. Sahana Eden’s Organization Registry can track what organizations are active in different contexts, providing opportunities for collaboration and coordination.

'''Project Tracking'''

By telling you Who’s Doing What, Where, and When, Sahana Eden provides a valuable tool to help organizations responding to disasters know where the greatest needs are and coordinate with others who are engaged in similar work.

'''Human Resources'''

The most important part of Disaster Management is the people.Whether they are community volunteers or staff working for different organizations, the Human Resources module can help manage the people involved. It will track where they are, what skills they have and help ensure that everyone is effectively engaged with the work that needs to be done. Sahana Eden can also be used to provide a contact list to ensure that the right people can be contacted at the right time.

'''Inventory'''

Whether organizations are supplying basic essentials of life to people
affected by natural disasters or giving communities the tools they
need to restore their livelihoods, Sahana Eden can be used to manage
inventories of items and match requests for items with warehouses
and other facilities which have them available. Operationally, Sahana
Eden can be used to record and automate transactions for sending
and receiving shipments. Sahana Eden can support multiple Catalogs of
Items as well as providing alternative items to ensure more effective
use of supplies. Sahana Eden can be configured to load multiple
catalogs including a generic list of items and/or the IFRC Emergency
Item Catalog.

'''Assets'''

A wide range of assets are needed to respond to disasters, including
vehicles to transport people and relief items, radio equipment to
provide communication where telecommunication infrastructure has
been destroyed, and generators to provide backup power. Sahana
Eden is able to manage assets, track where they are, who they have
been assigned to, and what condition they are in. This ensures that
assets are used effectively and efficiently.

'''Assessments'''

Sahana Eden can be used to collect and analyze information from
assessments to help organizations more effectively plan their disaster
management activities. Different assessment templates can easily be
designed and imported into Sahana Eden to support assessments for
different organizations in different contexts. Data can either be
entered into an interactive web form or imported via an Excel
template.

'''Scenarios and Events'''

To help organizations better plan for disasters, Sahana Eden can be
used to plan for different scenarios, including recording what human
resources, assets, facilities and tasks will be needed to effectively
respond.
When an incident occurs events can be created from a scenario
template to allocate the resources and alert people of the need to
respond.

'''Map'''

Sahana Eden has fully integrated mapping functionality which allows
any location-based data to be visualized on a map. This information
can also be searched using a map-based boundary selection. Maps
provide situational awareness which is essential when either planning to
prepare for or respond to a disaster. Sahana Eden supports many
standard formats for overlaying data on maps from other sources
and Geographical Information Systems (GIS), for example natural
hazard risks, population or weather.

'''Shelter Management'''

When disasters are widespread and result in population displacement,
understanding and tracking the landscape of shelters - and the people
in them - is a critical activity. The Shelter Registry provides
functionality to list and track information on shelters and on the
people arriving and departing. Shelter details include location, services
provided, responsible organization and contacts, demographics, and
needs. In addition, individual person data includes name, age, relatives,
status, health, and many other details to provide a clear understanding
of population demographics within the site.

'''Messaging'''

In the complex domain of Disaster Management, communication is
critical. Sahana Eden provides support for messages to be sent
by Email, SMS, Twitter and Google Talk. Distribution Groups can be set
up to allow messages to be easily sent to many people at once. Users
are able to search for specific information and subscribe to receive
update messages when new information is added.

==Technical Overview==

Because Sahana Eden needs to be accessible to users at remote
locations, including the public, a browser-based solution was essential.
The system also needs to be able to be used on offline laptops, so it
needs to run on a lightweight stack.

Python was selected as a suitable high level language allowing the rapid
customization of code required for each individual circumstance yet
has a large number of powerful libraries available including for
Geospatial Information Systems (GIS).

'''Shana Eden Framework'''

The Sahana Eden Software Platform has been built around a Rapid
Application Development (RAD) Framework. This provides a high level
of automation to ensure that new solutions can be quickly and
effectively developed. Once a database table is defined, the Sahana
Eden Framework automatically generates HTML pages to handle CRUD
(Create, Read, Update, Delete) as well as Search, Map and Pivot
Reports. Web Services are available to import and export in XML, CSV,
JSON and EXtensible Stylesheet Language (XSL) transforms are
supported to produce other data standards.

'''Sahana Eden Architecture'''

Web Server: Apache. Other web servers can also be used,such as Cherokee.

Application: Sahana Eden

Web Application Framework: Web2Py

Programming Language: Python & JavaScript

Database: MySQL,PostgreSQL, or MySQL, PostgreSQL, and SQLite are supported. Other databases should be usable without major additional work
since Web2Py supplies many connectors.

Operating System: Linux (Debian recommended),Windows and Mac OS X are possible, but only recommended for single-user environments.

'''Installation'''

Sahana Eden can be installed on any environment which can run
Python, including Linux, Windows and OSX. The system supports a
number of different databases and has been widely tested on MySQL,
PostgreSQL and SQLite. A webserver is optional, but for production
installations we have experience of both Apache/mod_wsgi and
Cherokee/uwsgi.

Installation scripts and detailed instructions are available on the Wiki:
http://eden.sahanafoundation.org/wiki/InstallationGuidelines

'''Web2py'''

This is an MVC environment (like Rails & Django.).
Web2Py can work at several different levels of abstraction.
The Sahana Eden framework (S3) is built on Web2Py's Auth/Crud classes in tools.py (with some remnants of the older T2), however sometimes we need more control therefore need to drop down a level or two.
Can execute a controller to be able to access its functions using:
execfile("applications/eden/controllers/mycontroller.py", globals())

'''S3'''

The Sahana Eden framework (S3) is built on Web2Py and It is used for RAD in all the sahana applications. The Sahana api docs can be found at http://eden.sahanafoundation.org/wiki/DeveloperGuidelines

'''Directory Structure'''

After the installation, the typical directory structure of the instance
looks like:
[[Application_structure.png]]

===Social Media===
Social Media is playing a important role in Disaster and Emergency Management, for such things as:
- Sending warnings and emergency instructions to the public.
- Receiving help requests and incident reports from the public.
- Engaging with the public, encouraging preparedness, providing information.
- Detecting incidents not directly reported. f

===Map Feeds===
This project allows the user to add layers of Geo-tagged data from Twitter onto the Map. It searches for tweets with specific keywords (that can be configured by user on Sahana web page). It then plots the location of these tweets on the Map. This is the work that we have done as a part of our project implementation. The following stepa are involved in this:

After setting up Eden in the system twitterSearch library(https://pypi.python.org/pypi/TwitterSearch/) is to be installed which helps to fetch the tweets with specific keywords

'''Searching Tweets'''

===Cross Cutting Concerns===

==Design==

==Problem with Aspect Oriented Programming==

==Setup (Installation)==

==Summary==

===Moving toward a better way to build software===

==Future==

==References==
<references/>

==Further Reading==

==External Links==

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T19:27:02Z

Kspatel6: /* Technical Overview */

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T16:28:36Z

Kspatel6: /* Technical Overview */

File:Application structure.png

2013-10-29T16:27:36Z

Kspatel6: uploaded a new version of "File:Application structure.png"

File:Application structure.png

2013-10-29T16:26:56Z

Kspatel6:

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T16:20:40Z

Kspatel6: /* Technical Overview */

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T16:00:53Z

Kspatel6: /* Technical Overview */

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T15:55:47Z

Kspatel6:

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T15:45:34Z

Kspatel6: /* Technical Overview */

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T15:43:35Z

Kspatel6:

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T15:29:51Z

Kspatel6: /* Core modules and outlines */

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T15:29:26Z

Kspatel6:

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T15:21:58Z

Kspatel6:

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T15:16:33Z

Kspatel6:

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T15:15:57Z

Kspatel6:

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T15:12:57Z

Kspatel6:

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T15:12:33Z

Kspatel6:

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T15:11:25Z

Kspatel6:

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T15:10:51Z

Kspatel6:

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T15:04:12Z

Kspatel6:

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T14:56:50Z

Kspatel6: /* History */

CSC/ECE 517 Fall 2013/oss mapFeeds

2013-10-29T14:12:00Z

Kspatel6: Created page with " ==History== ==Motivation== ==Description== ==Terminology== ===Cross Cutting Concerns=== ==Design== ==Problem with Aspect Oriented Programming== ==Setup (Installation)..."

==History==

==Motivation==

==Description==

==Terminology==

===Cross Cutting Concerns===

==Design==

==Problem with Aspect Oriented Programming==

==Setup (Installation)==

==Summary==

===Moving toward a better way to build software===

==Future==

==References==
<references/>

==Further Reading==

==External Links==

CSC/ECE 517 Fall 2013

2013-10-29T14:10:14Z

Kspatel6:

* [[ CSC/ECE 517 Fall 2012/ch1 1w23 ph ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w30 nn]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w21 w]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w01 aj]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w24 nv]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w29 rkld]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w25 aras]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w30 ps]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w19 rj]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w18 bs]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w17 pk]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w22 ss]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w12 vn]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w14 st]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w08 cc]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w10 ga ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w26 as ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w27 ma ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w13 aa ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w11 sv ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w07 d ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w20 gq ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w03 ss ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w28 nm ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w02 pp ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w6 zs ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w04 y ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w05 st ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w09 hs ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w32 av ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w48 x ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w43 av]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w46 ka]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w33 aa]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w35 sa ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w39 as ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w31 vm ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w43 sm ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w44 s ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w47 ka ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w34 fs ]]
* [[ CSC/ECE 517 Fall 2013/ch1 1w40 ao ]]
* [[ CSC/ECE 517 Fall 2013/oss fmv ]]
* [[ CSC/ECE 517 Fall 2013/oss vna ]]
* [[ CSC/ECE 517 Fall 2013/oss paa ]]
* [[ CSC/ECE 517 Fall 2013/oss mapFeeds ]]

CSC/ECE 517 Fall 2013/ch1 1w47 ka

2013-10-11T01:47:23Z

Kspatel6:

== Big Data in Rails applications ==

This wiki discusses the implementation and usage of Ruby on Rails (RoR) for Big Data for its analysis and storage using different technologies.

== Introduction to Big Data ==
With the increase in data size it becomes difficult to store the data in relational databases and also processing the data becomes very time consuming. Even if it is feasible to store the data on multiple servers, it becomes difficult to visualize the data all together since it is spread over multiple servers and processing time is also very large. Hence there arises a need of storing and retrieving huge amount of data effectively which involves massive parallel processing to fetch a huge amount of data in less time. This process of storing huge amount of data on multiple servers and processing that data which is not possible using traditional database processing techniques is called big data analysis and this collection of large data sets is called big data.

There are number of frameworks which support big data analysis and storage. To name a few we have Redis, Riak, MongoDB, Cassandra, Neo4J and the biggest of all Hadoop. All of them are based on different [http://en.wikipedia.org/wiki/Data_store datastores]. Different types of Data stores are as follows:
*Key-Value Data Store
*Document Data Stores
*Graph Data Stores
*Map Reduce

== Key Value Data Store: ==
Key-Value Data Store is similar to hash table storage where a record is accessed using the key. Hence it is very fast but for complex data it is very difficult to use. Redis and Riak are based on key-value data stores.
Example of key value data store is as follow:

you have a key in the left column and a value on the right side.

{
Name Mark
Age 20
Size Large
}

== Document Data Store: ==
Document Data Store is a database which is used for storing, retrieving and managing documents. Each document has a predefined structure and it is uniquely represented by a document key which helps in accessing and storing the document. Each document is similar to a row in relational database. The only difference being each row has a fixed number of attributes(columns) whereas in the documents the number of attributes may be different. MongoDB and Cassandra are document Data stores.
Example of Document Data Store:
{
name: "larry"
unityId: "larryp"
}

== Graph Data Store: ==
Graph Data Store is a database in which data is represented by nodes and edges. Lookup of elements is possible using pointers to adjacent elements and hence index look-up is not possible. Neo4J uses graph data store.
Example of graph data store can be viewed in the file.

'''[[File:Graph_data_store.jpg]]'''

== MapReduce Data Store: ==
MapReduce is a program which can be used to retrieve data from a cluster of data nodes using parallel processing. Map() function delegates the work to different data nodes in the cluster and reduce function performs operations on the data retrieved. Hadoop uses the map reduce technology for efficient data storage and retrieval[1].

Example of MapReduce Data Store:

'''function''' <u>map</u>(String name, String document):
''// name: document name''
''// document: document contents''
'''for each''' word w '''in''' document:
emit (w, 1)

'''function''' <u>reduce</u>(String word, Iterator partialCounts):
''// word: a word''
''// partialCounts: a list of aggregated partial counts''
sum = 0
'''for each''' pc '''in''' partialCounts:
sum += ParseInt(pc)
emit (word, sum)

== Rails and Riak ==
Raik is a NoSQL database that was designed manly for speed of retrieval. As the data becomes complex it becomes difficult to store using key value pair. Riak was developed using programming language Erlang, while supporting a variety of additional language drivers such as Python, Java, PHP and Ruby. To use Riak in the application, first Erlang needs to be installed and then riak.

Put
gem 'ripple', :git => 'http://github.com/seancribbs/ripple.git'
gem 'curb'
in the .gemfile of the project and run bundle install.

Next add Ripple into or config/database.yml:

ripple:
development:
port: 8098
host: localhost

and in all model classes put the following line:
require 'ripple'
class xyz
include Ripple::Document
statement x
statement y
end

After this start riak by going to "path where riak is stored/bin" and running the riak start command.

Now the riak is running and all the CRUD operations will be successfully performed.

==Rails and Redis ==
Redis is a extremely quick, key value data store that allows storage of different data types like strings,lists, hashes and sets.Redis keeps all the data in RAM and it periodially writes to disk providing persistence.
As a first step install redis source and run make command. Then start the rails server using following command:
./redis-server

To use redis install redis gem
gem install redis

In the .gemfile put
gem 'redis'
then run bundle install.

Now if the object needs to be saved than a connection object has to be created. For this generate a module as follows:
module RedisMod
@@redis_connection = Redis.new
def self.conn
@@redis_connection
end

Now in the model class to save a model object we first need to generate a key as redis is a key-value data store. So first gnerate a key and assign the object to be saved to the key and call conn function to save the record as follows:

def save
#make generate key function using the logic you want
generate_key unless @key
return false unless valid?
# store the key/value pair with @object being the object to be saved.
RedisMod.conn[@key] = @object
true
end

==References ==
*[1] http://research.google.com/archive/mapreduce-osdi04-slides/index-auto-0004.html
*http://www.slideshare.net/vastydeep/ruby-rails-no-sql-and-big-data
*http://www.pikasoft.com/journal/2011/1/2/a-quick-redis-key-value-example-for-the-holidays.html
*http://www.pikasoft.com/journal/2010/7/31/nosql-on-the-cloud-our-first-application.html
*http://jit.nuance9.com/2010/07/ruby-192-rails-3-riak-and-ripple.html
*http://www.pikasoft.com/journal/2011/1/9/nosql-next-up-hadoop-and-cloudera.html
*http://en.wikipedia.org/wiki/Data_store

CSC/ECE 517 Fall 2013/ch1 1w47 ka

2013-10-08T02:21:49Z

Kspatel6:

== Big Data in Rails applications ==

== Introduction to Big Data ==
With the increase in data size it becomes difficult to store the data in relational databases and also processing the data becomes very time consuming. Even if it is feasible to store the data on multiple servers, it becomes difficult to visualize the data all together since it is spread over multiple servers and processing time is also very large. Hence there arises a need of storing and retrieving huge amount of data effectively which involves massive parallel processing to fetch a huge amount of data in less time. This process of storing huge amount of data on multiple servers and processing that data which is not possible using traditional database processing techniques is called big data analysis and this collection of large data sets is called big data.

There are number of frameworks which support big data analysis and storage. To name a few we have Redis, Riak, MongoDB, Cassandra, Neo4J and the biggest of all Hadoop. All of them are based on different data stores. Different types of Data stores are as follows:
*Key-Value Data Store
*Document Data Stores
*Graph Data Stores
*Map Reduce

Key-Value Data Store is similar to hash table storage where a record is accessed using the key. Hence it is very fast but for complex data it is very difficult to use. Redis and Riak are based on key-value data stores.

Document Data Store is a database which is used for storing, retrieving and managing documents. Each document has a predefined structure and it is uniquely represented by a document key which helps in accessing and storing the document. Each document is similar to a row in relational database. The only difference being each row has a fixed number of attributes(columns) whereas in the documents the number of attributes may be different. MongoDB and Cassandra are document Data stores.

An example document in a document data store is as follows:
{
name: "larry"
unityId: "larryp"
}

Graph Data Store is a database in which data is represented by nodes and edges. Lookup of elements is possible using pointers to adjacent elements and hence index look-up is not possible. Neo4J uses graph data store.

MapReduce is a program which can be used to retrieve data from a cluster of data nodes using parallel processing. Map() function delegates the work to different data nodes in the cluster and reduce function performs operations on the data retrieved. Hadoop uses the map reduce technology for efficient data storage and retrieval.

== Rails and Riak ==
Riak was designed manly for speed of retrieval. As the data becomes complex it becomes difficult to store using key value pair. Riak was developed using programming language Erlang, so first Erlang needs to be installed and then install riak.

Put
gem 'ripple', :git => 'http://github.com/seancribbs/ripple.git'
gem 'curb'
in the .gemfile of the project and run bundle install.

Next add Ripple into or config/database.yml:

ripple:
development:
port: 8098
host: localhost

and in all model classes put the following line:
require 'ripple'
class xyz
include Ripple::Document
statement x
statement y
end

After this start riak by going to "path where riak is stored/bin" and running the riak start command.

Now the riak is running and all the CRUD operations will be successfully performed.

==Rais and Redis ==
As a first step install redis source and run make command. Then start the rails server using following command:
./redis-server

To use redis install redis gem
gem install redis

In the .gemfile put
gem 'redis'
then run bundle install.

Now if the object needs to be saved than a connection object has to be created. For this generate a module as follows:
module RedisMod
@@redis_connection = Redis.new
def self.conn
@@redis_connection
end
end

Now in the model class to save a model object we first need to generate a key as redis is a key-value data store. So first gnerate a key and assign the object to be saved to the key and call conn function to save the record as follows:

def save
#make generate key function using the logic you want
generate_key unless @key
return false unless valid?
# store the key/value pair with @object being the object to be saved.
RedisMod.conn[@key] = @object
true
end

==References ==
*http://www.slideshare.net/vastydeep/ruby-rails-no-sql-and-big-data
*http://www.pikasoft.com/journal/2011/1/2/a-quick-redis-key-value-example-for-the-holidays.html
*http://www.pikasoft.com/journal/2010/7/31/nosql-on-the-cloud-our-first-application.html
*http://jit.nuance9.com/2010/07/ruby-192-rails-3-riak-and-ripple.html
*http://www.pikasoft.com/journal/2011/1/9/nosql-next-up-hadoop-and-cloudera.html

CSC/ECE 517 Fall 2013/ch1 1w47 ka

2013-10-08T02:20:36Z

Kspatel6:

== Big Data in Rails applications ==

== Introduction to Big Data ==
With the increase in data size it becomes difficult to store the data in relational databases and also processing the data becomes very time consuming. Even if it is feasible to store the data on multiple servers, it becomes difficult to visualize the data all together since it is spread over multiple servers and processing time is also very large. Hence there arises a need of storing and retrieving huge amount of data effectively which involves massive parallel processing to fetch a huge amount of data in less time. This process of storing huge amount of data on multiple servers and processing that data which is not possible using traditional database processing techniques is called big data analysis and this collection of large data sets is called big data.

There are number of frameworks which support big data analysis and storage. To name a few we have Redis, Riak, MongoDB, Cassandra, Neo4J and the biggest of all Hadoop. All of them are based on different data stores. Different types of Data stores are as follows:
*Key-Value Data Store
*Document Data Stores
*Graph Data Stores
*Map Reduce

Key-Value Data Store is similar to hash table storage where a record is accessed using the key. Hence it is very fast but for complex data it is very difficult to use. Redis and Riak are based on key-value data stores.

Document Data Store is a database which is used for storing, retrieving and managing documents. Each document has a predefined structure and it is uniquely represented by a document key which helps in accessing and storing the document. Each document is similar to a row in relational database. The only difference being each row has a fixed number of attributes(columns) whereas in the documents the number of attributes may be different. MongoDB and Cassandra are document Data stores.

An example document in a document data store is as follows:
{
name: "larry"
unityId: "larryp"
}

Graph Data Store is a database in which data is represented by nodes and edges. Lookup of elements is possible using pointers to adjacent elements and hence index look-up is not possible. Neo4J uses graph data store.

MapReduce is a program which can be used to retrieve data from a cluster of data nodes using parallel processing. Map() function delegates the work to different data nodes in the cluster and reduce function performs operations on the data retrieved. Hadoop uses the map reduce technology for efficient data storage and retrieval.

== Rails and Riak ==
Riak was designed manly for speed of retrieval. As the data becomes complex it becomes difficult to store using key value pair. Riak was developed using programming language Erlang, so first Erlang needs to be installed and then install riak.

Put
gem 'ripple', :git => 'http://github.com/seancribbs/ripple.git'
gem 'curb'
in the .gemfile of the project and run bundle install.

Next add Ripple into or config/database.yml:

ripple:
development:
port: 8098
host: localhost

and in all model classes put the following line:
require 'ripple'
class xyz
include Ripple::Document
statement x
statement y
end

After this start riak by going to "path where riak is stored/bin" and running the riak start command.

Now the riak is running and all the CRUD operations will be successfully performed.

==Rais and Redis ==
As a first step install redis source and run make command. Then start the rails server using following command:
./redis-server

To use redis install redis gem
gem install redis

In the .gemfile put
gem 'redis'
then run bundle install.

Now if the object needs to be saved than a connection object has to be created. For this generate a module as follows:
module RedisMod
@@redis_connection = Redis.new
def self.conn
@@redis_connection
end
end

Now in the model class to save a model object we first need to generate a key as redis is a key-value data store. So first gnerate a key and assign the object to be saved to the key and call conn function to save the record as follows:

def save
#make generate key function using the logic you want
generate_key unless @key
return false unless valid?
# store the key/value pair with @object being the object to be saved.
RedisMod.conn[@key] = @object
true
end

==References ==
*[http://www.slideshare.net/vastydeep/ruby-rails-no-sql-and-big-data]
*[http://www.pikasoft.com/journal/2011/1/2/a-quick-redis-key-value-example-for-the-holidays.html]
*[http://www.pikasoft.com/journal/2010/7/31/nosql-on-the-cloud-our-first-application.html]
*[http://jit.nuance9.com/2010/07/ruby-192-rails-3-riak-and-ripple.html]
*[http://www.pikasoft.com/journal/2011/1/9/nosql-next-up-hadoop-and-cloudera.html]

CSC/ECE 517 Fall 2013/ch1 1w47 ka

2013-10-08T02:19:10Z

Kspatel6:

== Big Data in Rails applications ==

== Introduction to Big Data ==
With the increase in data size it becomes difficult to store the data in relational databases and also processing the data becomes very time consuming. Even if it is feasible to store the data on multiple servers, it becomes difficult to visualize the data all together since it is spread over multiple servers and processing time is also very large. Hence there arises a need of storing and retrieving huge amount of data effectively which involves massive parallel processing to fetch a huge amount of data in less time. This process of storing huge amount of data on multiple servers and processing that data which is not possible using traditional database processing techniques is called big data analysis and this collection of large data sets is called big data.

There are number of frameworks which support big data analysis and storage. To name a few we have Redis, Riak, MongoDB, Cassandra, Neo4J and the biggest of all Hadoop. All of them are based on different data stores. Different types of Data stores are as follows:
*Key-Value Data Store
*Document Data Stores
*Graph Data Stores
*Map Reduce

Key-Value Data Store is similar to hash table storage where a record is accessed using the key. Hence it is very fast but for complex data it is very difficult to use. Redis and Riak are based on key-value data stores.

Document Data Store is a database which is used for storing, retrieving and managing documents. Each document has a predefined structure and it is uniquely represented by a document key which helps in accessing and storing the document. Each document is similar to a row in relational database. The only difference being each row has a fixed number of attributes(columns) whereas in the documents the number of attributes may be different. MongoDB and Cassandra are document Data stores.

An example document in a document data store is as follows:
{
name: "larry"
unityId: "larryp"
}

Graph Data Store is a database in which data is represented by nodes and edges. Lookup of elements is possible using pointers to adjacent elements and hence index look-up is not possible. Neo4J uses graph data store.

MapReduce is a program which can be used to retrieve data from a cluster of data nodes using parallel processing. Map() function delegates the work to different data nodes in the cluster and reduce function performs operations on the data retrieved. Hadoop uses the map reduce technology for efficient data storage and retrieval.

== Rails and Riak ==
Riak was designed manly for speed of retrieval. As the data becomes complex it becomes difficult to store using key value pair. Riak was developed using programming language Erlang, so first Erlang needs to be installed and then install riak.

Put
gem 'ripple', :git => 'http://github.com/seancribbs/ripple.git'
gem 'curb'
in the .gemfile of the project and run bundle install.

Next add Ripple into or config/database.yml:

ripple:
development:
port: 8098
host: localhost

and in all model classes put the following line:
require 'ripple'
class xyz
include Ripple::Document
statement x
statement y
end

After this start riak by going to "path where riak is stored/bin" and running the riak start command.

Now the riak is running and all the CRUD operations will be successfully performed.

==Rais and Redis ==
As a first step install redis source and run make command. Then start the rails server using following command:
./redis-server

To use redis install redis gem
gem install redis

In the .gemfile put
gem 'redis'
then run bundle install.

Now if the object needs to be saved than a connection object has to be created. For this generate a module as follows:
module RedisMod
@@redis_connection = Redis.new
def self.conn
@@redis_connection
end
end

Now in the model class to save a model object we first need to generate a key as redis is a key-value data store. So first gnerate a key and assign the object to be saved to the key and call conn function to save the record as follows:

def save
#make generate key function using the logic you want
generate_key unless @key
return false unless valid?
# store the key/value pair with @object being the object to be saved.
RedisMod.conn[@key] = @object
true
end

==References ==
[http://www.slideshare.net/vastydeep/ruby-rails-no-sql-and-big-data]
[http://www.pikasoft.com/journal/2011/1/2/a-quick-redis-key-value-example-for-the-holidays.html]
[http://www.pikasoft.com/journal/2010/7/31/nosql-on-the-cloud-our-first-application.html]
[http://jit.nuance9.com/2010/07/ruby-192-rails-3-riak-and-ripple.html]
[http://www.pikasoft.com/journal/2011/1/9/nosql-next-up-hadoop-and-cloudera.html]

CSC/ECE 517 Fall 2013/ch1 1w47 ka

2013-10-08T02:08:43Z

Kspatel6:

CSC/ECE 517 Fall 2013/ch1 1w47 ka

2013-10-08T02:02:05Z

Kspatel6:

CSC/ECE 517 Fall 2013/ch1 1w47 ka

2013-10-08T01:46:55Z

Kspatel6:

CSC/ECE 517 Fall 2013/ch1 1w47 ka

2013-10-08T01:42:43Z

Kspatel6:

CSC/ECE 517 Fall 2013/ch1 1w47 ka

2013-10-08T01:42:10Z

Kspatel6:

CSC/ECE 517 Fall 2013/ch1 1w47 ka

2013-10-08T01:41:29Z

Kspatel6: