<?xml version="1.0"?>
<feed xmlns="http://www.w3.org/2005/Atom" xml:lang="en">
	<id>https://wiki.expertiza.ncsu.edu/api.php?action=feedcontributions&amp;feedformat=atom&amp;user=Rkovilk</id>
	<title>Expertiza_Wiki - User contributions [en]</title>
	<link rel="self" type="application/atom+xml" href="https://wiki.expertiza.ncsu.edu/api.php?action=feedcontributions&amp;feedformat=atom&amp;user=Rkovilk"/>
	<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=Special:Contributions/Rkovilk"/>
	<updated>2026-07-14T05:46:15Z</updated>
	<subtitle>User contributions</subtitle>
	<generator>MediaWiki 1.41.0</generator>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121239</id>
		<title>CSC/ECE 517 Fall 2018/E1855 let course staff as well as students do reviews</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121239"/>
		<updated>2018-12-07T23:33:20Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Team */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
&lt;br /&gt;
The way Expertiza is set up right now is that only peers can review your work. However, there are cases when the course staff (Instructor/ TAs) would want to submit reviews as well. This project aims to implement this feature by allowing course staff to review the project on the same metrics as other students who review the project. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
The current system does not allow instructors to submit reviews of student work. We will work upon the feature which will let them review using the same review form that students use to do reviews.&lt;br /&gt;
&lt;br /&gt;
=== Current scenario ===&lt;br /&gt;
&lt;br /&gt;
This is how some of the pages we are concerned with, currently look.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== Submissions page for an assignment in Instructor View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Submissions_instr.jpeg | center]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== A typical Scores table in a Student View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Grades_view_team_current.png | center]]&lt;br /&gt;
&lt;br /&gt;
== '''Proposed Solutions and Implementation''' ==&lt;br /&gt;
&lt;br /&gt;
Following changes will be made to let staff perform reviews as well:&lt;br /&gt;
&lt;br /&gt;
'''Step 1: Add a way for the instructors to perform a review.'''&lt;br /&gt;
&lt;br /&gt;
We are planning to implement links to ''Begin review'', ''Edit review'','' View review'' and ''Submit review'' in the assignment submissions view. &lt;br /&gt;
When the instructor/TA reviews a work for the first time, he/she is added as a participant and a review response mapping is created. &lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''View: ''' ''app/views/assignments/list_submissions.html.erb'' - To add links in the instructor view&lt;br /&gt;
* '''Controller: ''' ''app/controllers/review_mapping_controller.rb''  - Method: add_instructor_as_reviewer&lt;br /&gt;
  &lt;br /&gt;
In the second case, we can see a 'Begin review' link. This is the initial state when instructor review has not been added to the submission.&lt;br /&gt;
Once the instructor adds a review and submits it, we can see the 'View review' link. In case he just saves the review, an 'Edit review' link will appear.&lt;br /&gt;
If the review deadline of one round is passed, the 'Edit review' link becomes 'Update review' link. This follows in line with what the student sees while performing a review. Similarly, just like students instructor would not able to edit or update the review once submitted.&lt;br /&gt;
&lt;br /&gt;
[[File:Ins_TA_Review.png]]&lt;br /&gt;
&lt;br /&gt;
'''Step 2: Add the instructor review in ''Your Scores'' table in case he has reviewed your work. Provide an icon to highlight the special nature of an instructors review.'''&lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''Assets: ''' ''app/assets/stylesheets/grades.scss'' - Icon to make an instructor's review distinct from other reviews&lt;br /&gt;
* '''View: ''' ''app/views/grades/view_team.html.erb'' - To modify the &amp;quot;Your scores&amp;quot; page to include an icon next to the peer review score indicating that the instructor's score is not included in the final peer review score.&lt;br /&gt;
* '''Models: ''' &lt;br /&gt;
** ''app/models/answer.rb'' - Method: compute_scores | Modification in logic to ensure instructor review scores are not counted in the overall score of the student.&lt;br /&gt;
** ''app/models/vm_question_response_score_cell.rb'' - Included a new variable called 'is_instructor_review' to identify an instructor review&lt;br /&gt;
** ''app/models/vm_question_response_row.rb'' - Change in average_score_for_row method to not include an instructor review score&lt;br /&gt;
** ''app/models/vm_question_response.rb'' - Modified the add_answer method to include the is_instructor_review to each row_score object&lt;br /&gt;
&lt;br /&gt;
A student should be able to make out if an instructor has reviewed his/his team's work. In case the instructor performs a review on the team's work, there will be an icon next to the instructor's review along with explicitly stating that it is an 'Instructor review'.&lt;br /&gt;
The average peer review score for the team has been modified to exclude the instructor's scores. Same has been taken into account for the average score calculated for each row.&lt;br /&gt;
&lt;br /&gt;
[[File:Score_hover.png]]&lt;br /&gt;
&lt;br /&gt;
Like shown in the above picture we can see a info button on which if we hover the text is shown.&lt;br /&gt;
&lt;br /&gt;
Possible icons :&lt;br /&gt;
 [[File:Instuctor.jpg]]  [[File:Instructor1.jpg]]&lt;br /&gt;
&lt;br /&gt;
== '''Test Plan''' ==&lt;br /&gt;
&lt;br /&gt;
'''Features testing:''' Many of our changes are reflected on views (user interface). Following is the list of tests that we will conduct with rspec/capybara.&lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs perform a review for the submission of latest finished round if instructor/TAs has not started a review for the submission yet&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs save a review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs review a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs edit a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should allow instructor/TAs perform a review after the deadline for reviewing has passed&amp;quot;&lt;br /&gt;
&lt;br /&gt;
'''More testing:''' &lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs update a review for the submission of latest finished round if instructor/TAs performed and saved a review for the previous round&amp;quot;&lt;br /&gt;
# it &amp;quot;should show &amp;quot;Instructor review&amp;quot; when a student views feedback on his/her submission if an instructor/TA has reviewed his/his team's work&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average peer review score for the team&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average score for each question in the review&amp;quot;&lt;br /&gt;
&lt;br /&gt;
== '''Team''' ==&lt;br /&gt;
'''Members : '''&lt;br /&gt;
Harsh Shah, &lt;br /&gt;
Prachi Gupta, &lt;br /&gt;
Ramkumaar Kovil Kanthadai, &lt;br /&gt;
Raveena D'Costa.&lt;br /&gt;
&lt;br /&gt;
'''Mentor :''' Dr.Edward Gehringer&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
&lt;br /&gt;
Expertiza&lt;br /&gt;
* https://expertiza.ncsu.edu/ &lt;br /&gt;
&lt;br /&gt;
Pull Request&lt;br /&gt;
* https://github.com/expertiza/expertiza/pull/1304&lt;br /&gt;
&lt;br /&gt;
Expertiza Github&lt;br /&gt;
* https://github.com/expertiza/expertiza&lt;br /&gt;
&lt;br /&gt;
Expertiza Documentation&lt;br /&gt;
* http://wiki.expertiza.ncsu.edu/index.php/Expertiza_documentation&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121238</id>
		<title>CSC/ECE 517 Fall 2018/E1855 let course staff as well as students do reviews</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121238"/>
		<updated>2018-12-07T23:32:59Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Team */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
&lt;br /&gt;
The way Expertiza is set up right now is that only peers can review your work. However, there are cases when the course staff (Instructor/ TAs) would want to submit reviews as well. This project aims to implement this feature by allowing course staff to review the project on the same metrics as other students who review the project. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
The current system does not allow instructors to submit reviews of student work. We will work upon the feature which will let them review using the same review form that students use to do reviews.&lt;br /&gt;
&lt;br /&gt;
=== Current scenario ===&lt;br /&gt;
&lt;br /&gt;
This is how some of the pages we are concerned with, currently look.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== Submissions page for an assignment in Instructor View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Submissions_instr.jpeg | center]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== A typical Scores table in a Student View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Grades_view_team_current.png | center]]&lt;br /&gt;
&lt;br /&gt;
== '''Proposed Solutions and Implementation''' ==&lt;br /&gt;
&lt;br /&gt;
Following changes will be made to let staff perform reviews as well:&lt;br /&gt;
&lt;br /&gt;
'''Step 1: Add a way for the instructors to perform a review.'''&lt;br /&gt;
&lt;br /&gt;
We are planning to implement links to ''Begin review'', ''Edit review'','' View review'' and ''Submit review'' in the assignment submissions view. &lt;br /&gt;
When the instructor/TA reviews a work for the first time, he/she is added as a participant and a review response mapping is created. &lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''View: ''' ''app/views/assignments/list_submissions.html.erb'' - To add links in the instructor view&lt;br /&gt;
* '''Controller: ''' ''app/controllers/review_mapping_controller.rb''  - Method: add_instructor_as_reviewer&lt;br /&gt;
  &lt;br /&gt;
In the second case, we can see a 'Begin review' link. This is the initial state when instructor review has not been added to the submission.&lt;br /&gt;
Once the instructor adds a review and submits it, we can see the 'View review' link. In case he just saves the review, an 'Edit review' link will appear.&lt;br /&gt;
If the review deadline of one round is passed, the 'Edit review' link becomes 'Update review' link. This follows in line with what the student sees while performing a review. Similarly, just like students instructor would not able to edit or update the review once submitted.&lt;br /&gt;
&lt;br /&gt;
[[File:Ins_TA_Review.png]]&lt;br /&gt;
&lt;br /&gt;
'''Step 2: Add the instructor review in ''Your Scores'' table in case he has reviewed your work. Provide an icon to highlight the special nature of an instructors review.'''&lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''Assets: ''' ''app/assets/stylesheets/grades.scss'' - Icon to make an instructor's review distinct from other reviews&lt;br /&gt;
* '''View: ''' ''app/views/grades/view_team.html.erb'' - To modify the &amp;quot;Your scores&amp;quot; page to include an icon next to the peer review score indicating that the instructor's score is not included in the final peer review score.&lt;br /&gt;
* '''Models: ''' &lt;br /&gt;
** ''app/models/answer.rb'' - Method: compute_scores | Modification in logic to ensure instructor review scores are not counted in the overall score of the student.&lt;br /&gt;
** ''app/models/vm_question_response_score_cell.rb'' - Included a new variable called 'is_instructor_review' to identify an instructor review&lt;br /&gt;
** ''app/models/vm_question_response_row.rb'' - Change in average_score_for_row method to not include an instructor review score&lt;br /&gt;
** ''app/models/vm_question_response.rb'' - Modified the add_answer method to include the is_instructor_review to each row_score object&lt;br /&gt;
&lt;br /&gt;
A student should be able to make out if an instructor has reviewed his/his team's work. In case the instructor performs a review on the team's work, there will be an icon next to the instructor's review along with explicitly stating that it is an 'Instructor review'.&lt;br /&gt;
The average peer review score for the team has been modified to exclude the instructor's scores. Same has been taken into account for the average score calculated for each row.&lt;br /&gt;
&lt;br /&gt;
[[File:Score_hover.png]]&lt;br /&gt;
&lt;br /&gt;
Like shown in the above picture we can see a info button on which if we hover the text is shown.&lt;br /&gt;
&lt;br /&gt;
Possible icons :&lt;br /&gt;
 [[File:Instuctor.jpg]]  [[File:Instructor1.jpg]]&lt;br /&gt;
&lt;br /&gt;
== '''Test Plan''' ==&lt;br /&gt;
&lt;br /&gt;
'''Features testing:''' Many of our changes are reflected on views (user interface). Following is the list of tests that we will conduct with rspec/capybara.&lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs perform a review for the submission of latest finished round if instructor/TAs has not started a review for the submission yet&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs save a review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs review a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs edit a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should allow instructor/TAs perform a review after the deadline for reviewing has passed&amp;quot;&lt;br /&gt;
&lt;br /&gt;
'''More testing:''' &lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs update a review for the submission of latest finished round if instructor/TAs performed and saved a review for the previous round&amp;quot;&lt;br /&gt;
# it &amp;quot;should show &amp;quot;Instructor review&amp;quot; when a student views feedback on his/her submission if an instructor/TA has reviewed his/his team's work&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average peer review score for the team&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average score for each question in the review&amp;quot;&lt;br /&gt;
&lt;br /&gt;
== '''Team''' ==&lt;br /&gt;
'''Members :'''&lt;br /&gt;
&lt;br /&gt;
Harsh Shah, &lt;br /&gt;
Prachi Gupta, &lt;br /&gt;
Ramkumaar Kovil Kanthadai, &lt;br /&gt;
Raveena D'Costa.&lt;br /&gt;
&lt;br /&gt;
'''Mentor :''' Dr.Edward Gehringer&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
&lt;br /&gt;
Expertiza&lt;br /&gt;
* https://expertiza.ncsu.edu/ &lt;br /&gt;
&lt;br /&gt;
Pull Request&lt;br /&gt;
* https://github.com/expertiza/expertiza/pull/1304&lt;br /&gt;
&lt;br /&gt;
Expertiza Github&lt;br /&gt;
* https://github.com/expertiza/expertiza&lt;br /&gt;
&lt;br /&gt;
Expertiza Documentation&lt;br /&gt;
* http://wiki.expertiza.ncsu.edu/index.php/Expertiza_documentation&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121237</id>
		<title>CSC/ECE 517 Fall 2018/E1855 let course staff as well as students do reviews</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121237"/>
		<updated>2018-12-07T23:31:58Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Team */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
&lt;br /&gt;
The way Expertiza is set up right now is that only peers can review your work. However, there are cases when the course staff (Instructor/ TAs) would want to submit reviews as well. This project aims to implement this feature by allowing course staff to review the project on the same metrics as other students who review the project. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
The current system does not allow instructors to submit reviews of student work. We will work upon the feature which will let them review using the same review form that students use to do reviews.&lt;br /&gt;
&lt;br /&gt;
=== Current scenario ===&lt;br /&gt;
&lt;br /&gt;
This is how some of the pages we are concerned with, currently look.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== Submissions page for an assignment in Instructor View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Submissions_instr.jpeg | center]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== A typical Scores table in a Student View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Grades_view_team_current.png | center]]&lt;br /&gt;
&lt;br /&gt;
== '''Proposed Solutions and Implementation''' ==&lt;br /&gt;
&lt;br /&gt;
Following changes will be made to let staff perform reviews as well:&lt;br /&gt;
&lt;br /&gt;
'''Step 1: Add a way for the instructors to perform a review.'''&lt;br /&gt;
&lt;br /&gt;
We are planning to implement links to ''Begin review'', ''Edit review'','' View review'' and ''Submit review'' in the assignment submissions view. &lt;br /&gt;
When the instructor/TA reviews a work for the first time, he/she is added as a participant and a review response mapping is created. &lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''View: ''' ''app/views/assignments/list_submissions.html.erb'' - To add links in the instructor view&lt;br /&gt;
* '''Controller: ''' ''app/controllers/review_mapping_controller.rb''  - Method: add_instructor_as_reviewer&lt;br /&gt;
  &lt;br /&gt;
In the second case, we can see a 'Begin review' link. This is the initial state when instructor review has not been added to the submission.&lt;br /&gt;
Once the instructor adds a review and submits it, we can see the 'View review' link. In case he just saves the review, an 'Edit review' link will appear.&lt;br /&gt;
If the review deadline of one round is passed, the 'Edit review' link becomes 'Update review' link. This follows in line with what the student sees while performing a review. Similarly, just like students instructor would not able to edit or update the review once submitted.&lt;br /&gt;
&lt;br /&gt;
[[File:Ins_TA_Review.png]]&lt;br /&gt;
&lt;br /&gt;
'''Step 2: Add the instructor review in ''Your Scores'' table in case he has reviewed your work. Provide an icon to highlight the special nature of an instructors review.'''&lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''Assets: ''' ''app/assets/stylesheets/grades.scss'' - Icon to make an instructor's review distinct from other reviews&lt;br /&gt;
* '''View: ''' ''app/views/grades/view_team.html.erb'' - To modify the &amp;quot;Your scores&amp;quot; page to include an icon next to the peer review score indicating that the instructor's score is not included in the final peer review score.&lt;br /&gt;
* '''Models: ''' &lt;br /&gt;
** ''app/models/answer.rb'' - Method: compute_scores | Modification in logic to ensure instructor review scores are not counted in the overall score of the student.&lt;br /&gt;
** ''app/models/vm_question_response_score_cell.rb'' - Included a new variable called 'is_instructor_review' to identify an instructor review&lt;br /&gt;
** ''app/models/vm_question_response_row.rb'' - Change in average_score_for_row method to not include an instructor review score&lt;br /&gt;
** ''app/models/vm_question_response.rb'' - Modified the add_answer method to include the is_instructor_review to each row_score object&lt;br /&gt;
&lt;br /&gt;
A student should be able to make out if an instructor has reviewed his/his team's work. In case the instructor performs a review on the team's work, there will be an icon next to the instructor's review along with explicitly stating that it is an 'Instructor review'.&lt;br /&gt;
The average peer review score for the team has been modified to exclude the instructor's scores. Same has been taken into account for the average score calculated for each row.&lt;br /&gt;
&lt;br /&gt;
[[File:Score_hover.png]]&lt;br /&gt;
&lt;br /&gt;
Like shown in the above picture we can see a info button on which if we hover the text is shown.&lt;br /&gt;
&lt;br /&gt;
Possible icons :&lt;br /&gt;
 [[File:Instuctor.jpg]]  [[File:Instructor1.jpg]]&lt;br /&gt;
&lt;br /&gt;
== '''Test Plan''' ==&lt;br /&gt;
&lt;br /&gt;
'''Features testing:''' Many of our changes are reflected on views (user interface). Following is the list of tests that we will conduct with rspec/capybara.&lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs perform a review for the submission of latest finished round if instructor/TAs has not started a review for the submission yet&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs save a review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs review a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs edit a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should allow instructor/TAs perform a review after the deadline for reviewing has passed&amp;quot;&lt;br /&gt;
&lt;br /&gt;
'''More testing:''' &lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs update a review for the submission of latest finished round if instructor/TAs performed and saved a review for the previous round&amp;quot;&lt;br /&gt;
# it &amp;quot;should show &amp;quot;Instructor review&amp;quot; when a student views feedback on his/her submission if an instructor/TA has reviewed his/his team's work&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average peer review score for the team&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average score for each question in the review&amp;quot;&lt;br /&gt;
&lt;br /&gt;
== '''Team''' ==&lt;br /&gt;
Members :&lt;br /&gt;
&lt;br /&gt;
Harsh Shah&lt;br /&gt;
Prachi Gupta&lt;br /&gt;
Ramkumaar Kovil Kanthadai&lt;br /&gt;
Raveena D'Costa&lt;br /&gt;
&lt;br /&gt;
Mentor : Dr.Edward Gehringer&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
&lt;br /&gt;
Expertiza&lt;br /&gt;
* https://expertiza.ncsu.edu/ &lt;br /&gt;
&lt;br /&gt;
Pull Request&lt;br /&gt;
* https://github.com/expertiza/expertiza/pull/1304&lt;br /&gt;
&lt;br /&gt;
Expertiza Github&lt;br /&gt;
* https://github.com/expertiza/expertiza&lt;br /&gt;
&lt;br /&gt;
Expertiza Documentation&lt;br /&gt;
* http://wiki.expertiza.ncsu.edu/index.php/Expertiza_documentation&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121236</id>
		<title>CSC/ECE 517 Fall 2018/E1855 let course staff as well as students do reviews</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121236"/>
		<updated>2018-12-07T23:31:43Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Team */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
&lt;br /&gt;
The way Expertiza is set up right now is that only peers can review your work. However, there are cases when the course staff (Instructor/ TAs) would want to submit reviews as well. This project aims to implement this feature by allowing course staff to review the project on the same metrics as other students who review the project. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
The current system does not allow instructors to submit reviews of student work. We will work upon the feature which will let them review using the same review form that students use to do reviews.&lt;br /&gt;
&lt;br /&gt;
=== Current scenario ===&lt;br /&gt;
&lt;br /&gt;
This is how some of the pages we are concerned with, currently look.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== Submissions page for an assignment in Instructor View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Submissions_instr.jpeg | center]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== A typical Scores table in a Student View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Grades_view_team_current.png | center]]&lt;br /&gt;
&lt;br /&gt;
== '''Proposed Solutions and Implementation''' ==&lt;br /&gt;
&lt;br /&gt;
Following changes will be made to let staff perform reviews as well:&lt;br /&gt;
&lt;br /&gt;
'''Step 1: Add a way for the instructors to perform a review.'''&lt;br /&gt;
&lt;br /&gt;
We are planning to implement links to ''Begin review'', ''Edit review'','' View review'' and ''Submit review'' in the assignment submissions view. &lt;br /&gt;
When the instructor/TA reviews a work for the first time, he/she is added as a participant and a review response mapping is created. &lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''View: ''' ''app/views/assignments/list_submissions.html.erb'' - To add links in the instructor view&lt;br /&gt;
* '''Controller: ''' ''app/controllers/review_mapping_controller.rb''  - Method: add_instructor_as_reviewer&lt;br /&gt;
  &lt;br /&gt;
In the second case, we can see a 'Begin review' link. This is the initial state when instructor review has not been added to the submission.&lt;br /&gt;
Once the instructor adds a review and submits it, we can see the 'View review' link. In case he just saves the review, an 'Edit review' link will appear.&lt;br /&gt;
If the review deadline of one round is passed, the 'Edit review' link becomes 'Update review' link. This follows in line with what the student sees while performing a review. Similarly, just like students instructor would not able to edit or update the review once submitted.&lt;br /&gt;
&lt;br /&gt;
[[File:Ins_TA_Review.png]]&lt;br /&gt;
&lt;br /&gt;
'''Step 2: Add the instructor review in ''Your Scores'' table in case he has reviewed your work. Provide an icon to highlight the special nature of an instructors review.'''&lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''Assets: ''' ''app/assets/stylesheets/grades.scss'' - Icon to make an instructor's review distinct from other reviews&lt;br /&gt;
* '''View: ''' ''app/views/grades/view_team.html.erb'' - To modify the &amp;quot;Your scores&amp;quot; page to include an icon next to the peer review score indicating that the instructor's score is not included in the final peer review score.&lt;br /&gt;
* '''Models: ''' &lt;br /&gt;
** ''app/models/answer.rb'' - Method: compute_scores | Modification in logic to ensure instructor review scores are not counted in the overall score of the student.&lt;br /&gt;
** ''app/models/vm_question_response_score_cell.rb'' - Included a new variable called 'is_instructor_review' to identify an instructor review&lt;br /&gt;
** ''app/models/vm_question_response_row.rb'' - Change in average_score_for_row method to not include an instructor review score&lt;br /&gt;
** ''app/models/vm_question_response.rb'' - Modified the add_answer method to include the is_instructor_review to each row_score object&lt;br /&gt;
&lt;br /&gt;
A student should be able to make out if an instructor has reviewed his/his team's work. In case the instructor performs a review on the team's work, there will be an icon next to the instructor's review along with explicitly stating that it is an 'Instructor review'.&lt;br /&gt;
The average peer review score for the team has been modified to exclude the instructor's scores. Same has been taken into account for the average score calculated for each row.&lt;br /&gt;
&lt;br /&gt;
[[File:Score_hover.png]]&lt;br /&gt;
&lt;br /&gt;
Like shown in the above picture we can see a info button on which if we hover the text is shown.&lt;br /&gt;
&lt;br /&gt;
Possible icons :&lt;br /&gt;
 [[File:Instuctor.jpg]]  [[File:Instructor1.jpg]]&lt;br /&gt;
&lt;br /&gt;
== '''Test Plan''' ==&lt;br /&gt;
&lt;br /&gt;
'''Features testing:''' Many of our changes are reflected on views (user interface). Following is the list of tests that we will conduct with rspec/capybara.&lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs perform a review for the submission of latest finished round if instructor/TAs has not started a review for the submission yet&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs save a review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs review a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs edit a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should allow instructor/TAs perform a review after the deadline for reviewing has passed&amp;quot;&lt;br /&gt;
&lt;br /&gt;
'''More testing:''' &lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs update a review for the submission of latest finished round if instructor/TAs performed and saved a review for the previous round&amp;quot;&lt;br /&gt;
# it &amp;quot;should show &amp;quot;Instructor review&amp;quot; when a student views feedback on his/her submission if an instructor/TA has reviewed his/his team's work&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average peer review score for the team&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average score for each question in the review&amp;quot;&lt;br /&gt;
&lt;br /&gt;
== '''Team''' ==&lt;br /&gt;
Members :&lt;br /&gt;
&lt;br /&gt;
Harsh Shah&lt;br /&gt;
&lt;br /&gt;
Prachi Gupta&lt;br /&gt;
&lt;br /&gt;
Ramkumaar Kovil Kanthadai&lt;br /&gt;
&lt;br /&gt;
Raveena D'Costa&lt;br /&gt;
&lt;br /&gt;
Mentor : Dr.Edward Gehringer&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
&lt;br /&gt;
Expertiza&lt;br /&gt;
* https://expertiza.ncsu.edu/ &lt;br /&gt;
&lt;br /&gt;
Pull Request&lt;br /&gt;
* https://github.com/expertiza/expertiza/pull/1304&lt;br /&gt;
&lt;br /&gt;
Expertiza Github&lt;br /&gt;
* https://github.com/expertiza/expertiza&lt;br /&gt;
&lt;br /&gt;
Expertiza Documentation&lt;br /&gt;
* http://wiki.expertiza.ncsu.edu/index.php/Expertiza_documentation&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121235</id>
		<title>CSC/ECE 517 Fall 2018/E1855 let course staff as well as students do reviews</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121235"/>
		<updated>2018-12-07T23:31:20Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* References */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
&lt;br /&gt;
The way Expertiza is set up right now is that only peers can review your work. However, there are cases when the course staff (Instructor/ TAs) would want to submit reviews as well. This project aims to implement this feature by allowing course staff to review the project on the same metrics as other students who review the project. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
The current system does not allow instructors to submit reviews of student work. We will work upon the feature which will let them review using the same review form that students use to do reviews.&lt;br /&gt;
&lt;br /&gt;
=== Current scenario ===&lt;br /&gt;
&lt;br /&gt;
This is how some of the pages we are concerned with, currently look.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== Submissions page for an assignment in Instructor View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Submissions_instr.jpeg | center]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== A typical Scores table in a Student View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Grades_view_team_current.png | center]]&lt;br /&gt;
&lt;br /&gt;
== '''Proposed Solutions and Implementation''' ==&lt;br /&gt;
&lt;br /&gt;
Following changes will be made to let staff perform reviews as well:&lt;br /&gt;
&lt;br /&gt;
'''Step 1: Add a way for the instructors to perform a review.'''&lt;br /&gt;
&lt;br /&gt;
We are planning to implement links to ''Begin review'', ''Edit review'','' View review'' and ''Submit review'' in the assignment submissions view. &lt;br /&gt;
When the instructor/TA reviews a work for the first time, he/she is added as a participant and a review response mapping is created. &lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''View: ''' ''app/views/assignments/list_submissions.html.erb'' - To add links in the instructor view&lt;br /&gt;
* '''Controller: ''' ''app/controllers/review_mapping_controller.rb''  - Method: add_instructor_as_reviewer&lt;br /&gt;
  &lt;br /&gt;
In the second case, we can see a 'Begin review' link. This is the initial state when instructor review has not been added to the submission.&lt;br /&gt;
Once the instructor adds a review and submits it, we can see the 'View review' link. In case he just saves the review, an 'Edit review' link will appear.&lt;br /&gt;
If the review deadline of one round is passed, the 'Edit review' link becomes 'Update review' link. This follows in line with what the student sees while performing a review. Similarly, just like students instructor would not able to edit or update the review once submitted.&lt;br /&gt;
&lt;br /&gt;
[[File:Ins_TA_Review.png]]&lt;br /&gt;
&lt;br /&gt;
'''Step 2: Add the instructor review in ''Your Scores'' table in case he has reviewed your work. Provide an icon to highlight the special nature of an instructors review.'''&lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''Assets: ''' ''app/assets/stylesheets/grades.scss'' - Icon to make an instructor's review distinct from other reviews&lt;br /&gt;
* '''View: ''' ''app/views/grades/view_team.html.erb'' - To modify the &amp;quot;Your scores&amp;quot; page to include an icon next to the peer review score indicating that the instructor's score is not included in the final peer review score.&lt;br /&gt;
* '''Models: ''' &lt;br /&gt;
** ''app/models/answer.rb'' - Method: compute_scores | Modification in logic to ensure instructor review scores are not counted in the overall score of the student.&lt;br /&gt;
** ''app/models/vm_question_response_score_cell.rb'' - Included a new variable called 'is_instructor_review' to identify an instructor review&lt;br /&gt;
** ''app/models/vm_question_response_row.rb'' - Change in average_score_for_row method to not include an instructor review score&lt;br /&gt;
** ''app/models/vm_question_response.rb'' - Modified the add_answer method to include the is_instructor_review to each row_score object&lt;br /&gt;
&lt;br /&gt;
A student should be able to make out if an instructor has reviewed his/his team's work. In case the instructor performs a review on the team's work, there will be an icon next to the instructor's review along with explicitly stating that it is an 'Instructor review'.&lt;br /&gt;
The average peer review score for the team has been modified to exclude the instructor's scores. Same has been taken into account for the average score calculated for each row.&lt;br /&gt;
&lt;br /&gt;
[[File:Score_hover.png]]&lt;br /&gt;
&lt;br /&gt;
Like shown in the above picture we can see a info button on which if we hover the text is shown.&lt;br /&gt;
&lt;br /&gt;
Possible icons :&lt;br /&gt;
 [[File:Instuctor.jpg]]  [[File:Instructor1.jpg]]&lt;br /&gt;
&lt;br /&gt;
== '''Test Plan''' ==&lt;br /&gt;
&lt;br /&gt;
'''Features testing:''' Many of our changes are reflected on views (user interface). Following is the list of tests that we will conduct with rspec/capybara.&lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs perform a review for the submission of latest finished round if instructor/TAs has not started a review for the submission yet&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs save a review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs review a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs edit a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should allow instructor/TAs perform a review after the deadline for reviewing has passed&amp;quot;&lt;br /&gt;
&lt;br /&gt;
'''More testing:''' &lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs update a review for the submission of latest finished round if instructor/TAs performed and saved a review for the previous round&amp;quot;&lt;br /&gt;
# it &amp;quot;should show &amp;quot;Instructor review&amp;quot; when a student views feedback on his/her submission if an instructor/TA has reviewed his/his team's work&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average peer review score for the team&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average score for each question in the review&amp;quot;&lt;br /&gt;
&lt;br /&gt;
== '''Team''' ==&lt;br /&gt;
Members :&lt;br /&gt;
Harsh Shah&lt;br /&gt;
Prachi Gupta&lt;br /&gt;
Ramkumaar Kovil Kanthadai&lt;br /&gt;
Raveena D'Costa&lt;br /&gt;
&lt;br /&gt;
Mentor : Dr.Edward Gehringer&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
&lt;br /&gt;
Expertiza&lt;br /&gt;
* https://expertiza.ncsu.edu/ &lt;br /&gt;
&lt;br /&gt;
Pull Request&lt;br /&gt;
* https://github.com/expertiza/expertiza/pull/1304&lt;br /&gt;
&lt;br /&gt;
Expertiza Github&lt;br /&gt;
* https://github.com/expertiza/expertiza&lt;br /&gt;
&lt;br /&gt;
Expertiza Documentation&lt;br /&gt;
* http://wiki.expertiza.ncsu.edu/index.php/Expertiza_documentation&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121231</id>
		<title>CSC/ECE 517 Fall 2018/E1855 let course staff as well as students do reviews</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121231"/>
		<updated>2018-12-07T23:25:44Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Proposed Solutions and Implementation */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
&lt;br /&gt;
The way Expertiza is set up right now is that only peers can review your work. However, there are cases when the course staff (Instructor/ TAs) would want to submit reviews as well. This project aims to implement this feature by allowing course staff to review the project on the same metrics as other students who review the project. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
The current system does not allow instructors to submit reviews of student work. We will work upon the feature which will let them review using the same review form that students use to do reviews.&lt;br /&gt;
&lt;br /&gt;
=== Current scenario ===&lt;br /&gt;
&lt;br /&gt;
This is how some of the pages we are concerned with, currently look.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== Submissions page for an assignment in Instructor View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Submissions_instr.jpeg | center]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== A typical Scores table in a Student View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Grades_view_team_current.png | center]]&lt;br /&gt;
&lt;br /&gt;
== '''Proposed Solutions and Implementation''' ==&lt;br /&gt;
&lt;br /&gt;
Following changes will be made to let staff perform reviews as well:&lt;br /&gt;
&lt;br /&gt;
'''Step 1: Add a way for the instructors to perform a review.'''&lt;br /&gt;
&lt;br /&gt;
We are planning to implement links to ''Begin review'', ''Edit review'','' View review'' and ''Submit review'' in the assignment submissions view. &lt;br /&gt;
When the instructor/TA reviews a work for the first time, he/she is added as a participant and a review response mapping is created. &lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''View: ''' ''app/views/assignments/list_submissions.html.erb'' - To add links in the instructor view&lt;br /&gt;
* '''Controller: ''' ''app/controllers/review_mapping_controller.rb''  - Method: add_instructor_as_reviewer&lt;br /&gt;
  &lt;br /&gt;
In the second case, we can see a 'Begin review' link. This is the initial state when instructor review has not been added to the submission.&lt;br /&gt;
Once the instructor adds a review and submits it, we can see the 'View review' link. In case he just saves the review, an 'Edit review' link will appear.&lt;br /&gt;
If the review deadline of one round is passed, the 'Edit review' link becomes 'Update review' link. This follows in line with what the student sees while performing a review. Similarly, just like students instructor would not able to edit or update the review once submitted.&lt;br /&gt;
&lt;br /&gt;
[[File:Ins_TA_Review.png]]&lt;br /&gt;
&lt;br /&gt;
'''Step 2: Add the instructor review in ''Your Scores'' table in case he has reviewed your work. Provide an icon to highlight the special nature of an instructors review.'''&lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''Assets: ''' ''app/assets/stylesheets/grades.scss'' - Icon to make an instructor's review distinct from other reviews&lt;br /&gt;
* '''View: ''' ''app/views/grades/view_team.html.erb'' - To modify the &amp;quot;Your scores&amp;quot; page to include an icon next to the peer review score indicating that the instructor's score is not included in the final peer review score.&lt;br /&gt;
* '''Models: ''' &lt;br /&gt;
** ''app/models/answer.rb'' - Method: compute_scores | Modification in logic to ensure instructor review scores are not counted in the overall score of the student.&lt;br /&gt;
** ''app/models/vm_question_response_score_cell.rb'' - Included a new variable called 'is_instructor_review' to identify an instructor review&lt;br /&gt;
** ''app/models/vm_question_response_row.rb'' - Change in average_score_for_row method to not include an instructor review score&lt;br /&gt;
** ''app/models/vm_question_response.rb'' - Modified the add_answer method to include the is_instructor_review to each row_score object&lt;br /&gt;
&lt;br /&gt;
A student should be able to make out if an instructor has reviewed his/his team's work. In case the instructor performs a review on the team's work, there will be an icon next to the instructor's review along with explicitly stating that it is an 'Instructor review'.&lt;br /&gt;
The average peer review score for the team has been modified to exclude the instructor's scores. Same has been taken into account for the average score calculated for each row.&lt;br /&gt;
&lt;br /&gt;
[[File:Score_hover.png]]&lt;br /&gt;
&lt;br /&gt;
Like shown in the above picture we can see a info button on which if we hover the text is shown.&lt;br /&gt;
&lt;br /&gt;
Possible icons :&lt;br /&gt;
 [[File:Instuctor.jpg]]  [[File:Instructor1.jpg]]&lt;br /&gt;
&lt;br /&gt;
== '''Test Plan''' ==&lt;br /&gt;
&lt;br /&gt;
'''Features testing:''' Many of our changes are reflected on views (user interface). Following is the list of tests that we will conduct with rspec/capybara.&lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs perform a review for the submission of latest finished round if instructor/TAs has not started a review for the submission yet&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs save a review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs review a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs edit a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should allow instructor/TAs perform a review after the deadline for reviewing has passed&amp;quot;&lt;br /&gt;
&lt;br /&gt;
'''More testing:''' &lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs update a review for the submission of latest finished round if instructor/TAs performed and saved a review for the previous round&amp;quot;&lt;br /&gt;
# it &amp;quot;should show &amp;quot;Instructor review&amp;quot; when a student views feedback on his/her submission if an instructor/TA has reviewed his/his team's work&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average peer review score for the team&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average score for each question in the review&amp;quot;&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
&lt;br /&gt;
Expertiza&lt;br /&gt;
* https://expertiza.ncsu.edu/ &lt;br /&gt;
&lt;br /&gt;
Pull Request&lt;br /&gt;
* https://github.com/expertiza/expertiza/pull/1304&lt;br /&gt;
&lt;br /&gt;
Expertiza Github&lt;br /&gt;
* https://github.com/expertiza/expertiza&lt;br /&gt;
&lt;br /&gt;
Expertiza Documentation&lt;br /&gt;
* http://wiki.expertiza.ncsu.edu/index.php/Expertiza_documentation&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121228</id>
		<title>CSC/ECE 517 Fall 2018/E1855 let course staff as well as students do reviews</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121228"/>
		<updated>2018-12-07T23:24:33Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Proposed Solutions and Implementation */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
&lt;br /&gt;
The way Expertiza is set up right now is that only peers can review your work. However, there are cases when the course staff (Instructor/ TAs) would want to submit reviews as well. This project aims to implement this feature by allowing course staff to review the project on the same metrics as other students who review the project. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
The current system does not allow instructors to submit reviews of student work. We will work upon the feature which will let them review using the same review form that students use to do reviews.&lt;br /&gt;
&lt;br /&gt;
=== Current scenario ===&lt;br /&gt;
&lt;br /&gt;
This is how some of the pages we are concerned with, currently look.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== Submissions page for an assignment in Instructor View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Submissions_instr.jpeg | center]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== A typical Scores table in a Student View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Grades_view_team_current.png | center]]&lt;br /&gt;
&lt;br /&gt;
== '''Proposed Solutions and Implementation''' ==&lt;br /&gt;
&lt;br /&gt;
Following changes will be made to let staff perform reviews as well:&lt;br /&gt;
&lt;br /&gt;
'''Step 1: Add a way for the instructors to perform a review.'''&lt;br /&gt;
&lt;br /&gt;
We are planning to implement links to ''Begin review'', ''Edit review'','' View review'' and ''Submit review'' in the assignment submissions view. &lt;br /&gt;
When the instructor/TA reviews a work for the first time, he/she is added as a participant and a review response mapping is created. &lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''View: ''' ''app/views/assignments/list_submissions.html.erb'' - To add links in the instructor view&lt;br /&gt;
* '''Controller: ''' ''app/controllers/review_mapping_controller.rb''  - Method: add_instructor_as_reviewer&lt;br /&gt;
  &lt;br /&gt;
In the second case, we can see a 'Begin review' link. This is the initial state when instructor review has not been added to the submission.&lt;br /&gt;
Once the instructor adds a review and submits it, we can see the 'View review' link. In case he just saves the review, an 'Edit review' link will appear.&lt;br /&gt;
If the review deadline of one round is passed, the 'Edit review' link becomes 'Update review' link. This follows in line with what the student sees while performing a review. Similarly, just like students instructor would not able to edit or update the review once submitted.&lt;br /&gt;
&lt;br /&gt;
[[File:Ins_TA_Review.png]]&lt;br /&gt;
&lt;br /&gt;
'''Step 2: Add the instructor review in ''Your Scores'' table in case he has reviewed your work. Provide an icon to highlight the special nature of an instructors review.'''&lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''Assets: ''' ''app/assets/stylesheets/grades.scss'' - Icon to make an instructor's review distinct from other reviews&lt;br /&gt;
* '''View: ''' ''app/views/grades/view_team.html.erb'' - To modify the &amp;quot;Your scores&amp;quot; page to include an icon next to the peer review score indicating that the instructor's score is not included in the final peer review score.&lt;br /&gt;
* '''Models: ''' &lt;br /&gt;
** ''app/models/answer.rb'' - Method: compute_scores | Modification in logic to ensure instructor review scores are not counted in the overall score of the student.&lt;br /&gt;
** ''app/models/vm_question_response_score_cell.rb'' - Included a new variable called 'is_instructor_review' to identify an instructor review&lt;br /&gt;
** ''app/models/vm_question_response_row.rb'' - Change in average_score_for_row method to not include an instructor review score&lt;br /&gt;
** ''app/models/vm_question_response.rb'' - Modified the add_answer method to include the is_instructor_review to each row_score object&lt;br /&gt;
&lt;br /&gt;
A student should be able to make out if an instructor has reviewed his/his team's work. In case the instructor performs a review on the team's work, there will be an icon next to the instructor's review along with explicitly stating that it is an 'Instructor review'.&lt;br /&gt;
The average peer review score for the team has been modified to exclude the instructor's scores. Same has been taken into account for the average score calculated for each row.&lt;br /&gt;
&lt;br /&gt;
[[File:Score_hover.png]]&lt;br /&gt;
&lt;br /&gt;
Possible icons :&lt;br /&gt;
 [[File:Instuctor.jpg]]  [[File:Instructor1.jpg]]&lt;br /&gt;
&lt;br /&gt;
== '''Test Plan''' ==&lt;br /&gt;
&lt;br /&gt;
'''Features testing:''' Many of our changes are reflected on views (user interface). Following is the list of tests that we will conduct with rspec/capybara.&lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs perform a review for the submission of latest finished round if instructor/TAs has not started a review for the submission yet&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs save a review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs review a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs edit a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should allow instructor/TAs perform a review after the deadline for reviewing has passed&amp;quot;&lt;br /&gt;
&lt;br /&gt;
'''More testing:''' &lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs update a review for the submission of latest finished round if instructor/TAs performed and saved a review for the previous round&amp;quot;&lt;br /&gt;
# it &amp;quot;should show &amp;quot;Instructor review&amp;quot; when a student views feedback on his/her submission if an instructor/TA has reviewed his/his team's work&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average peer review score for the team&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average score for each question in the review&amp;quot;&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
&lt;br /&gt;
Expertiza&lt;br /&gt;
* https://expertiza.ncsu.edu/ &lt;br /&gt;
&lt;br /&gt;
Pull Request&lt;br /&gt;
* https://github.com/expertiza/expertiza/pull/1304&lt;br /&gt;
&lt;br /&gt;
Expertiza Github&lt;br /&gt;
* https://github.com/expertiza/expertiza&lt;br /&gt;
&lt;br /&gt;
Expertiza Documentation&lt;br /&gt;
* http://wiki.expertiza.ncsu.edu/index.php/Expertiza_documentation&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121227</id>
		<title>CSC/ECE 517 Fall 2018/E1855 let course staff as well as students do reviews</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121227"/>
		<updated>2018-12-07T23:24:01Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Proposed Solutions and Implementation */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
&lt;br /&gt;
The way Expertiza is set up right now is that only peers can review your work. However, there are cases when the course staff (Instructor/ TAs) would want to submit reviews as well. This project aims to implement this feature by allowing course staff to review the project on the same metrics as other students who review the project. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
The current system does not allow instructors to submit reviews of student work. We will work upon the feature which will let them review using the same review form that students use to do reviews.&lt;br /&gt;
&lt;br /&gt;
=== Current scenario ===&lt;br /&gt;
&lt;br /&gt;
This is how some of the pages we are concerned with, currently look.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== Submissions page for an assignment in Instructor View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Submissions_instr.jpeg | center]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== A typical Scores table in a Student View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Grades_view_team_current.png | center]]&lt;br /&gt;
&lt;br /&gt;
== '''Proposed Solutions and Implementation''' ==&lt;br /&gt;
&lt;br /&gt;
Following changes will be made to let staff perform reviews as well:&lt;br /&gt;
&lt;br /&gt;
'''Step 1: Add a way for the instructors to perform a review.'''&lt;br /&gt;
&lt;br /&gt;
We are planning to implement links to ''Begin review'', ''Edit review'','' View review'' and ''Submit review'' in the assignment submissions view. &lt;br /&gt;
When the instructor/TA reviews a work for the first time, he/she is added as a participant and a review response mapping is created. &lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''View: ''' ''app/views/assignments/list_submissions.html.erb'' - To add links in the instructor view&lt;br /&gt;
* '''Controller: ''' ''app/controllers/review_mapping_controller.rb''  - Method: add_instructor_as_reviewer&lt;br /&gt;
  &lt;br /&gt;
In the second case, we can see a 'Begin review' link. This is the initial state when instructor review has not been added to the submission.&lt;br /&gt;
Once the instructor adds a review and submits it, we can see the 'View review' link. In case he just saves the review, an 'Edit review' link will appear.&lt;br /&gt;
If the review deadline of one round is passed, the 'Edit review' link becomes 'Update review' link. This follows in line with what the student sees while performing a review. Similarly, just like students instructor would not able to edit or update the review once submitted.&lt;br /&gt;
&lt;br /&gt;
'''Step 2: Add the instructor review in ''Your Scores'' table in case he has reviewed your work. Provide an icon to highlight the special nature of an instructors review.'''&lt;br /&gt;
&lt;br /&gt;
[[File:Ins_TA_Review.png]]&lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''Assets: ''' ''app/assets/stylesheets/grades.scss'' - Icon to make an instructor's review distinct from other reviews&lt;br /&gt;
* '''View: ''' ''app/views/grades/view_team.html.erb'' - To modify the &amp;quot;Your scores&amp;quot; page to include an icon next to the peer review score indicating that the instructor's score is not included in the final peer review score.&lt;br /&gt;
* '''Models: ''' &lt;br /&gt;
** ''app/models/answer.rb'' - Method: compute_scores | Modification in logic to ensure instructor review scores are not counted in the overall score of the student.&lt;br /&gt;
** ''app/models/vm_question_response_score_cell.rb'' - Included a new variable called 'is_instructor_review' to identify an instructor review&lt;br /&gt;
** ''app/models/vm_question_response_row.rb'' - Change in average_score_for_row method to not include an instructor review score&lt;br /&gt;
** ''app/models/vm_question_response.rb'' - Modified the add_answer method to include the is_instructor_review to each row_score object&lt;br /&gt;
&lt;br /&gt;
A student should be able to make out if an instructor has reviewed his/his team's work. In case the instructor performs a review on the team's work, there will be an icon next to the instructor's review along with explicitly stating that it is an 'Instructor review'.&lt;br /&gt;
The average peer review score for the team has been modified to exclude the instructor's scores. Same has been taken into account for the average score calculated for each row.&lt;br /&gt;
&lt;br /&gt;
[[File:Score_hover.png]]&lt;br /&gt;
&lt;br /&gt;
Possible icons :&lt;br /&gt;
 [[File:Instuctor.jpg]]  [[File:Instructor1.jpg]]&lt;br /&gt;
&lt;br /&gt;
== '''Test Plan''' ==&lt;br /&gt;
&lt;br /&gt;
'''Features testing:''' Many of our changes are reflected on views (user interface). Following is the list of tests that we will conduct with rspec/capybara.&lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs perform a review for the submission of latest finished round if instructor/TAs has not started a review for the submission yet&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs save a review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs review a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs edit a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should allow instructor/TAs perform a review after the deadline for reviewing has passed&amp;quot;&lt;br /&gt;
&lt;br /&gt;
'''More testing:''' &lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs update a review for the submission of latest finished round if instructor/TAs performed and saved a review for the previous round&amp;quot;&lt;br /&gt;
# it &amp;quot;should show &amp;quot;Instructor review&amp;quot; when a student views feedback on his/her submission if an instructor/TA has reviewed his/his team's work&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average peer review score for the team&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average score for each question in the review&amp;quot;&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
&lt;br /&gt;
Expertiza&lt;br /&gt;
* https://expertiza.ncsu.edu/ &lt;br /&gt;
&lt;br /&gt;
Pull Request&lt;br /&gt;
* https://github.com/expertiza/expertiza/pull/1304&lt;br /&gt;
&lt;br /&gt;
Expertiza Github&lt;br /&gt;
* https://github.com/expertiza/expertiza&lt;br /&gt;
&lt;br /&gt;
Expertiza Documentation&lt;br /&gt;
* http://wiki.expertiza.ncsu.edu/index.php/Expertiza_documentation&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:Score_hover.png&amp;diff=121225</id>
		<title>File:Score hover.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:Score_hover.png&amp;diff=121225"/>
		<updated>2018-12-07T23:22:49Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121224</id>
		<title>CSC/ECE 517 Fall 2018/E1855 let course staff as well as students do reviews</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121224"/>
		<updated>2018-12-07T23:22:18Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Proposed Solutions and Implementation */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
&lt;br /&gt;
The way Expertiza is set up right now is that only peers can review your work. However, there are cases when the course staff (Instructor/ TAs) would want to submit reviews as well. This project aims to implement this feature by allowing course staff to review the project on the same metrics as other students who review the project. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
The current system does not allow instructors to submit reviews of student work. We will work upon the feature which will let them review using the same review form that students use to do reviews.&lt;br /&gt;
&lt;br /&gt;
=== Current scenario ===&lt;br /&gt;
&lt;br /&gt;
This is how some of the pages we are concerned with, currently look.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== Submissions page for an assignment in Instructor View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Submissions_instr.jpeg | center]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== A typical Scores table in a Student View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Grades_view_team_current.png | center]]&lt;br /&gt;
&lt;br /&gt;
== '''Proposed Solutions and Implementation''' ==&lt;br /&gt;
&lt;br /&gt;
Following changes will be made to let staff perform reviews as well:&lt;br /&gt;
&lt;br /&gt;
'''Step 1: Add a way for the instructors to perform a review.'''&lt;br /&gt;
&lt;br /&gt;
We are planning to implement links to ''Begin review'', ''Edit review'','' View review'' and ''Submit review'' in the assignment submissions view. &lt;br /&gt;
When the instructor/TA reviews a work for the first time, he/she is added as a participant and a review response mapping is created. &lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''View: ''' ''app/views/assignments/list_submissions.html.erb'' - To add links in the instructor view&lt;br /&gt;
* '''Controller: ''' ''app/controllers/review_mapping_controller.rb''  - Method: add_instructor_as_reviewer&lt;br /&gt;
  &lt;br /&gt;
In the second case, we can see a 'Begin review' link. This is the initial state when instructor review has not been added to the submission.&lt;br /&gt;
Once the instructor adds a review and submits it, we can see the 'View review' link. In case he just saves the review, an 'Edit review' link will appear.&lt;br /&gt;
If the review deadline of one round is passed, the 'Edit review' link becomes 'Update review' link. This follows in line with what the student sees while performing a review. Similarly, just like students instructor would not able to edit or update the review once submitted.&lt;br /&gt;
&lt;br /&gt;
'''Step 2: Add the instructor review in ''Your Scores'' table in case he has reviewed your work. Provide an icon to highlight the special nature of an instructors review.'''&lt;br /&gt;
&lt;br /&gt;
 [[File:Ins_TA_Review.png]]&lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''Assets: ''' ''app/assets/stylesheets/grades.scss'' - Icon to make an instructor's review distinct from other reviews&lt;br /&gt;
* '''View: ''' ''app/views/grades/view_team.html.erb'' - To modify the &amp;quot;Your scores&amp;quot; page to include an icon next to the peer review score indicating that the instructor's score is not included in the final peer review score.&lt;br /&gt;
* '''Models: ''' &lt;br /&gt;
** ''app/models/answer.rb'' - Method: compute_scores | Modification in logic to ensure instructor review scores are not counted in the overall score of the student.&lt;br /&gt;
** ''app/models/vm_question_response_score_cell.rb'' - Included a new variable called 'is_instructor_review' to identify an instructor review&lt;br /&gt;
** ''app/models/vm_question_response_row.rb'' - Change in average_score_for_row method to not include an instructor review score&lt;br /&gt;
** ''app/models/vm_question_response.rb'' - Modified the add_answer method to include the is_instructor_review to each row_score object&lt;br /&gt;
&lt;br /&gt;
A student should be able to make out if an instructor has reviewed his/his team's work. In case the instructor performs a review on the team's work, there will be an icon next to the instructor's review along with explicitly stating that it is an 'Instructor review'.&lt;br /&gt;
The average peer review score for the team has been modified to exclude the instructor's scores. Same has been taken into account for the average score calculated for each row.&lt;br /&gt;
&lt;br /&gt;
 [[File:Score_hover.png]]&lt;br /&gt;
&lt;br /&gt;
Possible icons :&lt;br /&gt;
 [[File:Instuctor.jpg]]  [[File:Instructor1.jpg]]&lt;br /&gt;
&lt;br /&gt;
== '''Test Plan''' ==&lt;br /&gt;
&lt;br /&gt;
'''Features testing:''' Many of our changes are reflected on views (user interface). Following is the list of tests that we will conduct with rspec/capybara.&lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs perform a review for the submission of latest finished round if instructor/TAs has not started a review for the submission yet&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs save a review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs review a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs edit a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should allow instructor/TAs perform a review after the deadline for reviewing has passed&amp;quot;&lt;br /&gt;
&lt;br /&gt;
'''More testing:''' &lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs update a review for the submission of latest finished round if instructor/TAs performed and saved a review for the previous round&amp;quot;&lt;br /&gt;
# it &amp;quot;should show &amp;quot;Instructor review&amp;quot; when a student views feedback on his/her submission if an instructor/TA has reviewed his/his team's work&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average peer review score for the team&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average score for each question in the review&amp;quot;&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
&lt;br /&gt;
Expertiza&lt;br /&gt;
* https://expertiza.ncsu.edu/ &lt;br /&gt;
&lt;br /&gt;
Pull Request&lt;br /&gt;
* https://github.com/expertiza/expertiza/pull/1304&lt;br /&gt;
&lt;br /&gt;
Expertiza Github&lt;br /&gt;
* https://github.com/expertiza/expertiza&lt;br /&gt;
&lt;br /&gt;
Expertiza Documentation&lt;br /&gt;
* http://wiki.expertiza.ncsu.edu/index.php/Expertiza_documentation&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:Ins_TA_Review.png&amp;diff=121204</id>
		<title>File:Ins TA Review.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:Ins_TA_Review.png&amp;diff=121204"/>
		<updated>2018-12-07T21:51:06Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121202</id>
		<title>CSC/ECE 517 Fall 2018/E1855 let course staff as well as students do reviews</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=121202"/>
		<updated>2018-12-07T21:50:33Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Proposed Solutions and Implementation */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
&lt;br /&gt;
The way Expertiza is set up right now is that only peers can review your work. However, there are cases when the course staff (Instructor/ TAs) would want to submit reviews as well. This project aims to implement this feature by allowing course staff to review the project on the same metrics as other students who review the project. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
The current system does not allow instructors to submit reviews of student work. We will work upon the feature which will let them review using the same review form that students use to do reviews.&lt;br /&gt;
&lt;br /&gt;
=== Current scenario ===&lt;br /&gt;
&lt;br /&gt;
This is how some of the pages we are concerned with, currently look.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== Submissions page for an assignment in Instructor View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Submissions_instr.jpeg | center]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== A typical Scores table in a Student View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Grades_view_team_current.png | center]]&lt;br /&gt;
&lt;br /&gt;
== '''Proposed Solutions and Implementation''' ==&lt;br /&gt;
&lt;br /&gt;
Following changes will be made to let staff perform reviews as well:&lt;br /&gt;
&lt;br /&gt;
'''Step 1: Add a way for the instructors to perform a review.'''&lt;br /&gt;
&lt;br /&gt;
We are planning to implement links to ''Begin review'', ''Edit review'','' View review'' and ''Submit review'' in the assignment submissions view. &lt;br /&gt;
When the instructor/TA reviews a work for the first time, he/she is added as a participant and a review response mapping is created. &lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''View: ''' ''app/views/assignments/list_submissions.html.erb'' - To add links in the instructor view&lt;br /&gt;
* '''Controller: ''' ''app/controllers/review_mapping_controller.rb''  - Method: add_instructor_as_reviewer&lt;br /&gt;
  &lt;br /&gt;
In the second case, we can see a 'Begin review' link. This is the initial state when instructor review has not been added to the submission.&lt;br /&gt;
Once the instructor adds a review and submits it, we can see the 'View review' link. In case he just saves the review, an 'Edit review' link will appear.&lt;br /&gt;
If the review deadline of one round is passed, the 'Edit review' link becomes 'Update review' link. This follows in line with what the student sees while performing a review. Similarly, just like students instructor would not able to edit or update the review once submitted.&lt;br /&gt;
&lt;br /&gt;
'''Step 2: Add the instructor review in ''Your Scores'' table in case he has reviewed your work. Provide an icon to highlight the special nature of an instructors review.'''&lt;br /&gt;
&lt;br /&gt;
 [[File:Ins_TA_Review.png]]&lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''Assets: ''' ''app/assets/stylesheets/grades.scss'' - Icon to make an instructor's review distinct from other reviews&lt;br /&gt;
* '''View: ''' ''app/views/grades/view_team.html.erb'' - To modify the &amp;quot;Your scores&amp;quot; page to include an icon next to the peer review score indicating that the instructor's score is not included in the final peer review score.&lt;br /&gt;
* '''Models: ''' &lt;br /&gt;
** ''app/models/answer.rb'' - Method: compute_scores | Modification in logic to ensure instructor review scores are not counted in the overall score of the student.&lt;br /&gt;
** ''app/models/vm_question_response_score_cell.rb'' - Included a new variable called 'is_instructor_review' to identify an instructor review&lt;br /&gt;
** ''app/models/vm_question_response_row.rb'' - Change in average_score_for_row method to not include an instructor review score&lt;br /&gt;
** ''app/models/vm_question_response.rb'' - Modified the add_answer method to include the is_instructor_review to each row_score object&lt;br /&gt;
&lt;br /&gt;
A student should be able to make out if an instructor has reviewed his/his team's work. In case the instructor performs a review on the team's work, there will be an icon next to the instructor's review along with explicitly stating that it is an 'Instructor review'.&lt;br /&gt;
The average peer review score for the team has been modified to exclude the instructor's scores. Same has been taken into account for the average score calculated for each row.&lt;br /&gt;
&lt;br /&gt;
Possible icons :&lt;br /&gt;
 [[File:Instuctor.jpg]]  [[File:Instructor1.jpg]]&lt;br /&gt;
&lt;br /&gt;
== '''Test Plan''' ==&lt;br /&gt;
&lt;br /&gt;
'''Features testing:''' Many of our changes are reflected on views (user interface). Following is the list of tests that we will conduct with rspec/capybara.&lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs perform a review for the submission of latest finished round if instructor/TAs has not started a review for the submission yet&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs save a review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs review a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs edit a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should allow instructor/TAs perform a review after the deadline for reviewing has passed&amp;quot;&lt;br /&gt;
&lt;br /&gt;
'''More testing:''' &lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs update a review for the submission of latest finished round if instructor/TAs performed and saved a review for the previous round&amp;quot;&lt;br /&gt;
# it &amp;quot;should show &amp;quot;Instructor review&amp;quot; when a student views feedback on his/her submission if an instructor/TA has reviewed his/his team's work&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average peer review score for the team&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average score for each question in the review&amp;quot;&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
&lt;br /&gt;
Expertiza&lt;br /&gt;
* https://expertiza.ncsu.edu/ &lt;br /&gt;
&lt;br /&gt;
Pull Request&lt;br /&gt;
* https://github.com/expertiza/expertiza/pull/1304&lt;br /&gt;
&lt;br /&gt;
Expertiza Github&lt;br /&gt;
* https://github.com/expertiza/expertiza&lt;br /&gt;
&lt;br /&gt;
Expertiza Documentation&lt;br /&gt;
* http://wiki.expertiza.ncsu.edu/index.php/Expertiza_documentation&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=120997</id>
		<title>CSC/ECE 517 Fall 2018/E1855 let course staff as well as students do reviews</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=120997"/>
		<updated>2018-12-05T23:35:14Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* References */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
&lt;br /&gt;
The way Expertiza is set up right now is that only peers can review your work. However, there are cases when the course staff (Instructor/ TAs) would want to submit reviews as well. This project aims to implement this feature by allowing course staff to review the project on the same metrics as other students who review the project. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
The current system does not allow instructors to submit reviews of student work. We will work upon the feature which will let them review using the same review form that students use to do reviews.&lt;br /&gt;
&lt;br /&gt;
=== Current scenario ===&lt;br /&gt;
&lt;br /&gt;
This is how some of the pages we are concerned with, currently look.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== Submissions page for an assignment in Instructor View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Submissions_instr.jpeg | center]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== A typical Scores table in a Student View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Grades_view_team_current.png | center]]&lt;br /&gt;
&lt;br /&gt;
== '''Proposed Solutions and Implementation''' ==&lt;br /&gt;
&lt;br /&gt;
Following changes will be made to let staff perform reviews as well:&lt;br /&gt;
&lt;br /&gt;
'''Step 1: Add a way for the instructors to perform a review.'''&lt;br /&gt;
&lt;br /&gt;
We are planning to implement links to ''Begin review'', ''Edit review'','' View review'' and ''Submit review'' in the assignment submissions view. &lt;br /&gt;
When the instructor/TA reviews a work for the first time, he/she is added as a participant and a review response mapping is created. &lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''View: ''' ''app/views/assignments/list_submissions.html.erb'' - To add links in the instructor view&lt;br /&gt;
* '''Controller: ''' ''app/controllers/review_mapping_controller.rb''  - Method: add_instructor_as_reviewer&lt;br /&gt;
  &lt;br /&gt;
In the second case, we can see a 'Begin review' link. This is the initial state when instructor review has not been added to the submission.&lt;br /&gt;
Once the instructor adds a review and submits it, we can see the 'View review' link. In case he just saves the review, an 'Edit review' link will appear.&lt;br /&gt;
If the review deadline of one round is passed, the 'Edit review' link becomes 'Update review' link. This follows in line with what the student sees while performing a review. Similarly, just like students instructor would not able to edit or update the review once submitted.&lt;br /&gt;
&lt;br /&gt;
'''Step 2: Add the instructor review in ''Your Scores'' table in case he has reviewed your work. Provide an icon to highlight the special nature of an instructors review.'''&lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''Assets: ''' ''app/assets/stylesheets/grades.scss'' - Icon to make an instructor's review distinct from other reviews&lt;br /&gt;
* '''View: ''' ''app/views/grades/view_team.html.erb'' - To modify the &amp;quot;Your scores&amp;quot; page to include an icon next to the peer review score indicating that the instructor's score is not included in the final peer review score.&lt;br /&gt;
* '''Models: ''' &lt;br /&gt;
** ''app/models/answer.rb'' - Method: compute_scores | Modification in logic to ensure instructor review scores are not counted in the overall score of the student.&lt;br /&gt;
** ''app/models/vm_question_response_score_cell.rb'' - Included a new variable called 'is_instructor_review' to identify an instructor review&lt;br /&gt;
** ''app/models/vm_question_response_row.rb'' - Change in average_score_for_row method to not include an instructor review score&lt;br /&gt;
** ''app/models/vm_question_response.rb'' - Modified the add_answer method to include the is_instructor_review to each row_score object&lt;br /&gt;
&lt;br /&gt;
A student should be able to make out if an instructor has reviewed his/his team's work. In case the instructor performs a review on the team's work, there will be an icon next to the instructor's review along with explicitly stating that it is an 'Instructor review'.&lt;br /&gt;
The average peer review score for the team has been modified to exclude the instructor's scores. Same has been taken into account for the average score calculated for each row.&lt;br /&gt;
&lt;br /&gt;
Possible icons :&lt;br /&gt;
 [[File:Instuctor.jpg]]  [[File:Instructor1.jpg]]&lt;br /&gt;
&lt;br /&gt;
== '''Test Plan''' ==&lt;br /&gt;
&lt;br /&gt;
'''Features testing:''' Many of our changes are reflected on views (user interface). Following is the list of tests that we will conduct with rspec/capybara.&lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs perform a review for the submission of latest finished round if instructor/TAs has not started a review for the submission yet&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs save a review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs review a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs edit a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should allow instructor/TAs perform a review after the deadline for reviewing has passed&amp;quot;&lt;br /&gt;
&lt;br /&gt;
'''More testing:''' &lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs update a review for the submission of latest finished round if instructor/TAs performed and saved a review for the previous round&amp;quot;&lt;br /&gt;
# it &amp;quot;should show &amp;quot;Instructor review&amp;quot; when a student views feedback on his/her submission if an instructor/TA has reviewed his/his team's work&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average peer review score for the team&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average score for each question in the review&amp;quot;&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
&lt;br /&gt;
Expertiza&lt;br /&gt;
* https://expertiza.ncsu.edu/ &lt;br /&gt;
&lt;br /&gt;
Pull Request&lt;br /&gt;
* https://github.com/expertiza/expertiza/pull/1304&lt;br /&gt;
&lt;br /&gt;
Expertiza Github&lt;br /&gt;
* https://github.com/expertiza/expertiza&lt;br /&gt;
&lt;br /&gt;
Expertiza Documentation&lt;br /&gt;
* http://wiki.expertiza.ncsu.edu/index.php/Expertiza_documentation&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=120732</id>
		<title>CSC/ECE 517 Fall 2018/E1855 let course staff as well as students do reviews</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=120732"/>
		<updated>2018-11-21T05:36:02Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Proposed Solutions and Implementation */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
&lt;br /&gt;
The way Expertiza is set up right now is that only peers can review your work. However, there are cases when the course staff (Instructor/ TAs) would want to submit reviews as well. This project aims to implement this feature by allowing course staff to review the project on the same metrics as other students who review the project. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
The current system does not allow instructors to submit reviews of student work. We will work upon the feature which will let them review using the same review form that students use to do reviews.&lt;br /&gt;
&lt;br /&gt;
=== Current scenario ===&lt;br /&gt;
&lt;br /&gt;
This is how some of the pages we are concerned with, currently look.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== Submissions page for an assignment in Instructor View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Submissions_instr.jpeg | center]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== A typical Scores table in a Student View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Grades_view_team_current.png | center]]&lt;br /&gt;
&lt;br /&gt;
== '''Proposed Solutions and Implementation''' ==&lt;br /&gt;
&lt;br /&gt;
Following changes will be made to let staff perform reviews as well:&lt;br /&gt;
&lt;br /&gt;
'''Step 1: Add a way for the instructors to perform a review.'''&lt;br /&gt;
&lt;br /&gt;
We are planning to implement links to ''Begin review'', ''Edit review'','' View review'' and ''Submit review'' in the assignment submissions view. &lt;br /&gt;
When the instructor/TA reviews a work for the first time, he/she is added as a participant and a review response mapping is created. &lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''View: ''' ''app/views/assignments/list_submissions.html.erb'' - To add links in the instructor view&lt;br /&gt;
* '''Controller: ''' ''app/controllers/review_mapping_controller.rb''  - Method: add_instructor_as_reviewer&lt;br /&gt;
  &lt;br /&gt;
In the second case, we can see a 'Begin review' link. This is the initial state when instructor review has not been added to the submission.&lt;br /&gt;
Once the instructor adds a review and submits it, we can see the 'View review' link. In case he just saves the review, an 'Edit review' link will appear.&lt;br /&gt;
If the review deadline of one round is passed, the 'Edit review' link becomes 'Update review' link. This follows in line with what the student sees while performing a review. Similarly, just like students instructor would not able to edit or update the review once submitted.&lt;br /&gt;
&lt;br /&gt;
'''Step 2: Add the instructor review in ''Your Scores'' table in case he has reviewed your work. Provide an icon to highlight the special nature of an instructors review.'''&lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''Assets: ''' ''app/assets/stylesheets/grades.scss'' - Icon to make an instructor's review distinct from other reviews&lt;br /&gt;
* '''View: ''' ''app/views/grades/view_team.html.erb'' - To modify the &amp;quot;Your scores&amp;quot; page to include an icon next to the peer review score indicating that the instructor's score is not included in the final peer review score.&lt;br /&gt;
* '''Models: ''' &lt;br /&gt;
** ''app/models/answer.rb'' - Method: compute_scores | Modification in logic to ensure instructor review scores are not counted in the overall score of the student.&lt;br /&gt;
** ''app/models/vm_question_response_score_cell.rb'' - Included a new variable called 'is_instructor_review' to identify an instructor review&lt;br /&gt;
** ''app/models/vm_question_response_row.rb'' - Change in average_score_for_row method to not include an instructor review score&lt;br /&gt;
** ''app/models/vm_question_response.rb'' - Modified the add_answer method to include the is_instructor_review to each row_score object&lt;br /&gt;
&lt;br /&gt;
A student should be able to make out if an instructor has reviewed his/his team's work. In case the instructor performs a review on the team's work, there will be an icon next to the instructor's review along with explicitly stating that it is an 'Instructor review'.&lt;br /&gt;
The average peer review score for the team has been modified to exclude the instructor's scores. Same has been taken into account for the average score calculated for each row.&lt;br /&gt;
&lt;br /&gt;
Possible icons :&lt;br /&gt;
 [[File:Instuctor.jpg]]  [[File:Instructor1.jpg]]&lt;br /&gt;
&lt;br /&gt;
== '''Test Plan''' ==&lt;br /&gt;
&lt;br /&gt;
'''Features testing:''' Many of our changes are reflected on views (user interface). Following is the list of tests that we will conduct with rspec/capybara.&lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs perform a review for the submission of latest finished round if instructor/TAs has not started a review for the submission yet&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs save a review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs review a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs edit a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should allow instructor/TAs perform a review after the deadline for reviewing has passed&amp;quot;&lt;br /&gt;
&lt;br /&gt;
'''More testing:''' &lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs update a review for the submission of latest finished round if instructor/TAs performed and saved a review for the previous round&amp;quot;&lt;br /&gt;
# it &amp;quot;should show &amp;quot;Instructor review&amp;quot; when a student views feedback on his/her submission if an instructor/TA has reviewed his/his team's work&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average peer review score for the team&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average score for each question in the review&amp;quot;&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
&lt;br /&gt;
Expertiza&lt;br /&gt;
* https://expertiza.ncsu.edu/ &lt;br /&gt;
&lt;br /&gt;
Expertiza Github&lt;br /&gt;
* https://github.com/expertiza/expertiza&lt;br /&gt;
&lt;br /&gt;
Expertiza Documentation&lt;br /&gt;
* http://wiki.expertiza.ncsu.edu/index.php/Expertiza_documentation&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=120731</id>
		<title>CSC/ECE 517 Fall 2018/E1855 let course staff as well as students do reviews</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=120731"/>
		<updated>2018-11-21T05:35:32Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Proposed Solutions and Implementation */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
&lt;br /&gt;
The way Expertiza is set up right now is that only peers can review your work. However, there are cases when the course staff (Instructor/ TAs) would want to submit reviews as well. This project aims to implement this feature by allowing course staff to review the project on the same metrics as other students who review the project. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
The current system does not allow instructors to submit reviews of student work. We will work upon the feature which will let them review using the same review form that students use to do reviews.&lt;br /&gt;
&lt;br /&gt;
=== Current scenario ===&lt;br /&gt;
&lt;br /&gt;
This is how some of the pages we are concerned with, currently look.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== Submissions page for an assignment in Instructor View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Submissions_instr.jpeg | center]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== A typical Scores table in a Student View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Grades_view_team_current.png | center]]&lt;br /&gt;
&lt;br /&gt;
== '''Proposed Solutions and Implementation''' ==&lt;br /&gt;
&lt;br /&gt;
Following changes will be made to let staff perform reviews as well:&lt;br /&gt;
&lt;br /&gt;
'''Step 1: Add a way for the instructors to perform a review.'''&lt;br /&gt;
&lt;br /&gt;
We are planning to implement links to ''Begin review'', ''Edit review'','' View review'' and ''Submit review'' in the assignment submissions view. &lt;br /&gt;
When the instructor/TA reviews a work for the first time, he/she is added as a participant and a review response mapping is created. &lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''View: ''' ''app/views/assignments/list_submissions.html.erb'' - To add links in the instructor view&lt;br /&gt;
* '''Controller: ''' ''app/controllers/review_mapping_controller.rb''  - Method: add_instructor_as_reviewer&lt;br /&gt;
  &lt;br /&gt;
In the second case, we can see a 'Begin review' link. This is the initial state when instructor review has not been added to the submission.&lt;br /&gt;
Once the instructor adds a review and submits it, we can see the 'View review' link. In case he just saves the review, an 'Edit review' link will appear.&lt;br /&gt;
If the review deadline of one round is passed, the 'Edit review' link becomes 'Update review' link. This follows in line with what the student sees while performing a review. Similarly, just like students instructor would not able to edit or update the review once submitted.&lt;br /&gt;
&lt;br /&gt;
'''Step 2: Add the instructor review in ''Your Scores'' table in case he has reviewed your work. Provide an icon to highlight the special nature of an instructors review.'''&lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''Assets: ''' ''app/assets/stylesheets/grades.scss'' - Icon to make an instructor's review distinct from other reviews&lt;br /&gt;
* '''View: ''' ''app/views/grades/view_team.html.erb'' - To modify the &amp;quot;Your scores&amp;quot; page to include an icon next to the peer review score indicating that the instructor's score is not included in the final peer review score.&lt;br /&gt;
* '''Models: ''' &lt;br /&gt;
** ''app/models/answer.rb'' - Method: compute_scores | Modification in logic to ensure instructor review scores are not counted in the overall score of the student.&lt;br /&gt;
** ''app/models/vm_question_response_score_cell.rb'' - Included a new variable called 'is_instructor_review' to identify an instructor review&lt;br /&gt;
** ''app/models/vm_question_response_row.rb'' - Change in average_score_for_row method to not include an instructor review score&lt;br /&gt;
** ''app/models/vm_question_response.rb'' - Modified the add_answer method to include the is_instructor_review to each row_score object&lt;br /&gt;
&lt;br /&gt;
A student should be able to make out if an instructor has reviewed his/his team's work. In case the instructor performs a review on the team's work, there will be an icon next to the instructor's review along with explicitly stating that it is an 'Instructor review'.&lt;br /&gt;
The average peer review score for the team has been modified to exclude the instructor's scores. Same has been taken into account for the average score calculated for each row.&lt;br /&gt;
&lt;br /&gt;
Possible icons:&lt;br /&gt;
 [[File:Instuctor.jpg]] [[File:Instructor1.jpg]]&lt;br /&gt;
&lt;br /&gt;
== '''Test Plan''' ==&lt;br /&gt;
&lt;br /&gt;
'''Features testing:''' Many of our changes are reflected on views (user interface). Following is the list of tests that we will conduct with rspec/capybara.&lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs perform a review for the submission of latest finished round if instructor/TAs has not started a review for the submission yet&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs save a review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs review a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs edit a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should allow instructor/TAs perform a review after the deadline for reviewing has passed&amp;quot;&lt;br /&gt;
&lt;br /&gt;
'''More testing:''' &lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs update a review for the submission of latest finished round if instructor/TAs performed and saved a review for the previous round&amp;quot;&lt;br /&gt;
# it &amp;quot;should show &amp;quot;Instructor review&amp;quot; when a student views feedback on his/her submission if an instructor/TA has reviewed his/his team's work&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average peer review score for the team&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average score for each question in the review&amp;quot;&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
&lt;br /&gt;
Expertiza&lt;br /&gt;
* https://expertiza.ncsu.edu/ &lt;br /&gt;
&lt;br /&gt;
Expertiza Github&lt;br /&gt;
* https://github.com/expertiza/expertiza&lt;br /&gt;
&lt;br /&gt;
Expertiza Documentation&lt;br /&gt;
* http://wiki.expertiza.ncsu.edu/index.php/Expertiza_documentation&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=120730</id>
		<title>CSC/ECE 517 Fall 2018/E1855 let course staff as well as students do reviews</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=120730"/>
		<updated>2018-11-21T05:35:18Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Proposed Solutions and Implementation */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
&lt;br /&gt;
The way Expertiza is set up right now is that only peers can review your work. However, there are cases when the course staff (Instructor/ TAs) would want to submit reviews as well. This project aims to implement this feature by allowing course staff to review the project on the same metrics as other students who review the project. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
The current system does not allow instructors to submit reviews of student work. We will work upon the feature which will let them review using the same review form that students use to do reviews.&lt;br /&gt;
&lt;br /&gt;
=== Current scenario ===&lt;br /&gt;
&lt;br /&gt;
This is how some of the pages we are concerned with, currently look.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== Submissions page for an assignment in Instructor View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Submissions_instr.jpeg | center]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== A typical Scores table in a Student View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Grades_view_team_current.png | center]]&lt;br /&gt;
&lt;br /&gt;
== '''Proposed Solutions and Implementation''' ==&lt;br /&gt;
&lt;br /&gt;
Following changes will be made to let staff perform reviews as well:&lt;br /&gt;
&lt;br /&gt;
'''Step 1: Add a way for the instructors to perform a review.'''&lt;br /&gt;
&lt;br /&gt;
We are planning to implement links to ''Begin review'', ''Edit review'','' View review'' and ''Submit review'' in the assignment submissions view. &lt;br /&gt;
When the instructor/TA reviews a work for the first time, he/she is added as a participant and a review response mapping is created. &lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''View: ''' ''app/views/assignments/list_submissions.html.erb'' - To add links in the instructor view&lt;br /&gt;
* '''Controller: ''' ''app/controllers/review_mapping_controller.rb''  - Method: add_instructor_as_reviewer&lt;br /&gt;
  &lt;br /&gt;
In the second case, we can see a 'Begin review' link. This is the initial state when instructor review has not been added to the submission.&lt;br /&gt;
Once the instructor adds a review and submits it, we can see the 'View review' link. In case he just saves the review, an 'Edit review' link will appear.&lt;br /&gt;
If the review deadline of one round is passed, the 'Edit review' link becomes 'Update review' link. This follows in line with what the student sees while performing a review. Similarly, just like students instructor would not able to edit or update the review once submitted.&lt;br /&gt;
&lt;br /&gt;
'''Step 2: Add the instructor review in ''Your Scores'' table in case he has reviewed your work. Provide an icon to highlight the special nature of an instructors review.'''&lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''Assets: ''' ''app/assets/stylesheets/grades.scss'' - Icon to make an instructor's review distinct from other reviews&lt;br /&gt;
* '''View: ''' ''app/views/grades/view_team.html.erb'' - To modify the &amp;quot;Your scores&amp;quot; page to include an icon next to the peer review score indicating that the instructor's score is not included in the final peer review score.&lt;br /&gt;
* '''Models: ''' &lt;br /&gt;
** ''app/models/answer.rb'' - Method: compute_scores | Modification in logic to ensure instructor review scores are not counted in the overall score of the student.&lt;br /&gt;
** ''app/models/vm_question_response_score_cell.rb'' - Included a new variable called 'is_instructor_review' to identify an instructor review&lt;br /&gt;
** ''app/models/vm_question_response_row.rb'' - Change in average_score_for_row method to not include an instructor review score&lt;br /&gt;
** ''app/models/vm_question_response.rb'' - Modified the add_answer method to include the is_instructor_review to each row_score object&lt;br /&gt;
&lt;br /&gt;
A student should be able to make out if an instructor has reviewed his/his team's work. In case the instructor performs a review on the team's work, there will be an icon next to the instructor's review along with explicitly stating that it is an 'Instructor review'.&lt;br /&gt;
The average peer review score for the team has been modified to exclude the instructor's scores. Same has been taken into account for the average score calculated for each row.&lt;br /&gt;
&lt;br /&gt;
Possible icons [[File:Instuctor.jpg]] [[File:Instructor1.jpg]]&lt;br /&gt;
&lt;br /&gt;
== '''Test Plan''' ==&lt;br /&gt;
&lt;br /&gt;
'''Features testing:''' Many of our changes are reflected on views (user interface). Following is the list of tests that we will conduct with rspec/capybara.&lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs perform a review for the submission of latest finished round if instructor/TAs has not started a review for the submission yet&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs save a review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs review a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs edit a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should allow instructor/TAs perform a review after the deadline for reviewing has passed&amp;quot;&lt;br /&gt;
&lt;br /&gt;
'''More testing:''' &lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs update a review for the submission of latest finished round if instructor/TAs performed and saved a review for the previous round&amp;quot;&lt;br /&gt;
# it &amp;quot;should show &amp;quot;Instructor review&amp;quot; when a student views feedback on his/her submission if an instructor/TA has reviewed his/his team's work&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average peer review score for the team&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average score for each question in the review&amp;quot;&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
&lt;br /&gt;
Expertiza&lt;br /&gt;
* https://expertiza.ncsu.edu/ &lt;br /&gt;
&lt;br /&gt;
Expertiza Github&lt;br /&gt;
* https://github.com/expertiza/expertiza&lt;br /&gt;
&lt;br /&gt;
Expertiza Documentation&lt;br /&gt;
* http://wiki.expertiza.ncsu.edu/index.php/Expertiza_documentation&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=120729</id>
		<title>CSC/ECE 517 Fall 2018/E1855 let course staff as well as students do reviews</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=120729"/>
		<updated>2018-11-21T05:35:03Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Proposed Solutions and Implementation */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
&lt;br /&gt;
The way Expertiza is set up right now is that only peers can review your work. However, there are cases when the course staff (Instructor/ TAs) would want to submit reviews as well. This project aims to implement this feature by allowing course staff to review the project on the same metrics as other students who review the project. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
The current system does not allow instructors to submit reviews of student work. We will work upon the feature which will let them review using the same review form that students use to do reviews.&lt;br /&gt;
&lt;br /&gt;
=== Current scenario ===&lt;br /&gt;
&lt;br /&gt;
This is how some of the pages we are concerned with, currently look.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== Submissions page for an assignment in Instructor View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Submissions_instr.jpeg | center]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== A typical Scores table in a Student View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Grades_view_team_current.png | center]]&lt;br /&gt;
&lt;br /&gt;
== '''Proposed Solutions and Implementation''' ==&lt;br /&gt;
&lt;br /&gt;
Following changes will be made to let staff perform reviews as well:&lt;br /&gt;
&lt;br /&gt;
'''Step 1: Add a way for the instructors to perform a review.'''&lt;br /&gt;
&lt;br /&gt;
We are planning to implement links to ''Begin review'', ''Edit review'','' View review'' and ''Submit review'' in the assignment submissions view. &lt;br /&gt;
When the instructor/TA reviews a work for the first time, he/she is added as a participant and a review response mapping is created. &lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''View: ''' ''app/views/assignments/list_submissions.html.erb'' - To add links in the instructor view&lt;br /&gt;
* '''Controller: ''' ''app/controllers/review_mapping_controller.rb''  - Method: add_instructor_as_reviewer&lt;br /&gt;
  &lt;br /&gt;
In the second case, we can see a 'Begin review' link. This is the initial state when instructor review has not been added to the submission.&lt;br /&gt;
Once the instructor adds a review and submits it, we can see the 'View review' link. In case he just saves the review, an 'Edit review' link will appear.&lt;br /&gt;
If the review deadline of one round is passed, the 'Edit review' link becomes 'Update review' link. This follows in line with what the student sees while performing a review. Similarly, just like students instructor would not able to edit or update the review once submitted.&lt;br /&gt;
&lt;br /&gt;
'''Step 2: Add the instructor review in ''Your Scores'' table in case he has reviewed your work. Provide an icon to highlight the special nature of an instructors review.'''&lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''Assets: ''' ''app/assets/stylesheets/grades.scss'' - Icon to make an instructor's review distinct from other reviews&lt;br /&gt;
* '''View: ''' ''app/views/grades/view_team.html.erb'' - To modify the &amp;quot;Your scores&amp;quot; page to include an icon next to the peer review score indicating that the instructor's score is not included in the final peer review score.&lt;br /&gt;
* '''Models: ''' &lt;br /&gt;
** ''app/models/answer.rb'' - Method: compute_scores | Modification in logic to ensure instructor review scores are not counted in the overall score of the student.&lt;br /&gt;
** ''app/models/vm_question_response_score_cell.rb'' - Included a new variable called 'is_instructor_review' to identify an instructor review&lt;br /&gt;
** ''app/models/vm_question_response_row.rb'' - Change in average_score_for_row method to not include an instructor review score&lt;br /&gt;
** ''app/models/vm_question_response.rb'' - Modified the add_answer method to include the is_instructor_review to each row_score object&lt;br /&gt;
&lt;br /&gt;
A student should be able to make out if an instructor has reviewed his/his team's work. In case the instructor performs a review on the team's work, there will be an icon next to the instructor's review along with explicitly stating that it is an 'Instructor review'.&lt;br /&gt;
The average peer review score for the team has been modified to exclude the instructor's scores. Same has been taken into account for the average score calculated for each row.&lt;br /&gt;
&lt;br /&gt;
Possible icons [[File:Instuctor.jpg]] [[File:Instuctor1.jpg]]&lt;br /&gt;
&lt;br /&gt;
== '''Test Plan''' ==&lt;br /&gt;
&lt;br /&gt;
'''Features testing:''' Many of our changes are reflected on views (user interface). Following is the list of tests that we will conduct with rspec/capybara.&lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs perform a review for the submission of latest finished round if instructor/TAs has not started a review for the submission yet&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs save a review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs review a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs edit a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should allow instructor/TAs perform a review after the deadline for reviewing has passed&amp;quot;&lt;br /&gt;
&lt;br /&gt;
'''More testing:''' &lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs update a review for the submission of latest finished round if instructor/TAs performed and saved a review for the previous round&amp;quot;&lt;br /&gt;
# it &amp;quot;should show &amp;quot;Instructor review&amp;quot; when a student views feedback on his/her submission if an instructor/TA has reviewed his/his team's work&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average peer review score for the team&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average score for each question in the review&amp;quot;&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
&lt;br /&gt;
Expertiza&lt;br /&gt;
* https://expertiza.ncsu.edu/ &lt;br /&gt;
&lt;br /&gt;
Expertiza Github&lt;br /&gt;
* https://github.com/expertiza/expertiza&lt;br /&gt;
&lt;br /&gt;
Expertiza Documentation&lt;br /&gt;
* http://wiki.expertiza.ncsu.edu/index.php/Expertiza_documentation&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:Instructor1.jpg&amp;diff=120728</id>
		<title>File:Instructor1.jpg</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:Instructor1.jpg&amp;diff=120728"/>
		<updated>2018-11-21T05:34:25Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:Instuctor.jpg&amp;diff=120727</id>
		<title>File:Instuctor.jpg</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:Instuctor.jpg&amp;diff=120727"/>
		<updated>2018-11-21T05:34:10Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=120726</id>
		<title>CSC/ECE 517 Fall 2018/E1855 let course staff as well as students do reviews</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018/E1855_let_course_staff_as_well_as_students_do_reviews&amp;diff=120726"/>
		<updated>2018-11-21T05:33:41Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
&lt;br /&gt;
The way Expertiza is set up right now is that only peers can review your work. However, there are cases when the course staff (Instructor/ TAs) would want to submit reviews as well. This project aims to implement this feature by allowing course staff to review the project on the same metrics as other students who review the project. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
The current system does not allow instructors to submit reviews of student work. We will work upon the feature which will let them review using the same review form that students use to do reviews.&lt;br /&gt;
&lt;br /&gt;
=== Current scenario ===&lt;br /&gt;
&lt;br /&gt;
This is how some of the pages we are concerned with, currently look.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== Submissions page for an assignment in Instructor View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Submissions_instr.jpeg | center]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==== A typical Scores table in a Student View ====&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File: Grades_view_team_current.png | center]]&lt;br /&gt;
&lt;br /&gt;
== '''Proposed Solutions and Implementation''' ==&lt;br /&gt;
&lt;br /&gt;
Following changes will be made to let staff perform reviews as well:&lt;br /&gt;
&lt;br /&gt;
'''Step 1: Add a way for the instructors to perform a review.'''&lt;br /&gt;
&lt;br /&gt;
We are planning to implement links to ''Begin review'', ''Edit review'','' View review'' and ''Submit review'' in the assignment submissions view. &lt;br /&gt;
When the instructor/TA reviews a work for the first time, he/she is added as a participant and a review response mapping is created. &lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''View: ''' ''app/views/assignments/list_submissions.html.erb'' - To add links in the instructor view&lt;br /&gt;
* '''Controller: ''' ''app/controllers/review_mapping_controller.rb''  - Method: add_instructor_as_reviewer&lt;br /&gt;
  &lt;br /&gt;
In the second case, we can see a 'Begin review' link. This is the initial state when instructor review has not been added to the submission.&lt;br /&gt;
Once the instructor adds a review and submits it, we can see the 'View review' link. In case he just saves the review, an 'Edit review' link will appear.&lt;br /&gt;
If the review deadline of one round is passed, the 'Edit review' link becomes 'Update review' link. This follows in line with what the student sees while performing a review. Similarly, just like students instructor would not able to edit or update the review once submitted.&lt;br /&gt;
&lt;br /&gt;
'''Step 2: Add the instructor review in ''Your Scores'' table in case he has reviewed your work. Provide an icon to highlight the special nature of an instructors review.'''&lt;br /&gt;
&lt;br /&gt;
Files edited:&lt;br /&gt;
* '''Assets: ''' ''app/assets/stylesheets/grades.scss'' - Icon to make an instructor's review distinct from other reviews&lt;br /&gt;
* '''View: ''' ''app/views/grades/view_team.html.erb'' - To modify the &amp;quot;Your scores&amp;quot; page to include an icon next to the peer review score indicating that the instructor's score is not included in the final peer review score.&lt;br /&gt;
* '''Models: ''' &lt;br /&gt;
** ''app/models/answer.rb'' - Method: compute_scores | Modification in logic to ensure instructor review scores are not counted in the overall score of the student.&lt;br /&gt;
** ''app/models/vm_question_response_score_cell.rb'' - Included a new variable called 'is_instructor_review' to identify an instructor review&lt;br /&gt;
** ''app/models/vm_question_response_row.rb'' - Change in average_score_for_row method to not include an instructor review score&lt;br /&gt;
** ''app/models/vm_question_response.rb'' - Modified the add_answer method to include the is_instructor_review to each row_score object&lt;br /&gt;
&lt;br /&gt;
A student should be able to make out if an instructor has reviewed his/his team's work. In case the instructor performs a review on the team's work, there will be an icon next to the instructor's review along with explicitly stating that it is an 'Instructor review'.&lt;br /&gt;
The average peer review score for the team has been modified to exclude the instructor's scores. Same has been taken into account for the average score calculated for each row.&lt;br /&gt;
&lt;br /&gt;
Possible icons [[File:instuctor.png]] [[File:instuctor1.png]]&lt;br /&gt;
&lt;br /&gt;
== '''Test Plan''' ==&lt;br /&gt;
&lt;br /&gt;
'''Features testing:''' Many of our changes are reflected on views (user interface). Following is the list of tests that we will conduct with rspec/capybara.&lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs perform a review for the submission of latest finished round if instructor/TAs has not started a review for the submission yet&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs save a review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs review a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should let instructor/TAs edit a previously saved review&amp;quot;&lt;br /&gt;
# it &amp;quot;should allow instructor/TAs perform a review after the deadline for reviewing has passed&amp;quot;&lt;br /&gt;
&lt;br /&gt;
'''More testing:''' &lt;br /&gt;
&lt;br /&gt;
# it &amp;quot;should let instructor/TAs update a review for the submission of latest finished round if instructor/TAs performed and saved a review for the previous round&amp;quot;&lt;br /&gt;
# it &amp;quot;should show &amp;quot;Instructor review&amp;quot; when a student views feedback on his/her submission if an instructor/TA has reviewed his/his team's work&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average peer review score for the team&amp;quot;&lt;br /&gt;
# it &amp;quot;should exclude the instructor's/TA's review score when calculating the average score for each question in the review&amp;quot;&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
&lt;br /&gt;
Expertiza&lt;br /&gt;
* https://expertiza.ncsu.edu/ &lt;br /&gt;
&lt;br /&gt;
Expertiza Github&lt;br /&gt;
* https://github.com/expertiza/expertiza&lt;br /&gt;
&lt;br /&gt;
Expertiza Documentation&lt;br /&gt;
* http://wiki.expertiza.ncsu.edu/index.php/Expertiza_documentation&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=119077</id>
		<title>E1830 OSS Project Juniper: Bookmark enhancements</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=119077"/>
		<updated>2018-11-09T19:45:13Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Testing Plan */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;'''Peer Review Information'''&lt;br /&gt;
&lt;br /&gt;
For users intending to view the Expertiza Bookmark enhancement associated with this assignment, the credentials are below:&lt;br /&gt;
&lt;br /&gt;
Instructor login: username -&amp;gt; instructor6, password -&amp;gt; password&lt;br /&gt;
&lt;br /&gt;
Student Accounts for Impersonation : student6340, student6341; Assignment -&amp;gt; Exercises, CSC 456, Fall 2015&lt;br /&gt;
&lt;br /&gt;
'''&lt;br /&gt;
== Introduction ==&lt;br /&gt;
'''&lt;br /&gt;
&lt;br /&gt;
'''Expertiza Background'''&lt;br /&gt;
&lt;br /&gt;
Expertiza is an open-source educational web application developed on Ruby on Rails platform. Students and Instructors (including TA's) use this application though their credentials. Instructors can add new projects, assignments etc as well edit the previous ones and at a later stage can see the student submission and grade them. They can even put a time limit (deadline) for submitting the assignment. Students can form teams for the projects, submit their work through handles (Wiki page, link to a video etc). Students can even review their teammates and other peers, as well give them any suggestions if required.&lt;br /&gt;
&lt;br /&gt;
GitHub hooks to Expertiza to encourage contributors. Expertiza project is supported by National Science Foundation.&lt;br /&gt;
&lt;br /&gt;
'''Description of the current project'''&lt;br /&gt;
&lt;br /&gt;
This project is intended to make Bookmarks more user-friendly, credible and valid. Bookmarks in expertiza are created by reviewers and can be used by authors for their work on any project. On each line of the signup sheet are two icons, one for adding a bookmark to the topic, and another for viewing bookmarks on the topic. If the instructor allows the participants to create bookmarks, then only a participant has access to create and view them. He should be able to create a new Bookmark only if he enters a valid one.&lt;br /&gt;
&lt;br /&gt;
Now a new rubric is added for reviewing the bookmarks added to a topic and this is accessible only to members belonging to the topic. Therefore ratings can be now done via a drop-down or rubric.&lt;br /&gt;
&lt;br /&gt;
== Issues ==&lt;br /&gt;
&lt;br /&gt;
'''Problem 1'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
When a user after logging into expertiza goes to 'Create New Bookmark page&amp;quot; or &amp;quot;View existing bookmarks page&amp;quot;, he's not able to go back to Sign-up sheet using &amp;quot;back&amp;quot; button.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:back.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Solution :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:fixed_back_link.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Problem 2'''&lt;br /&gt;
&lt;br /&gt;
Bookmarks had only one option while reviewing and it was to use a drop down to give a score. Also the average rating metric had a bug and hence showed wrong values even when bookmark was not reviewed. The bug was fixed and the rubric feature was adding a new controller.&lt;br /&gt;
&lt;br /&gt;
Now choosing &amp;quot;Scale&amp;quot; Option instead of &amp;quot;Dropdown&amp;quot; allows one to use a rubric instead.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:scale.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric for rating the bookmark shows up as a link that looks as follows :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:begin_review.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric looks like :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:bookmark_review_rubric.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Testing Plan ==&lt;br /&gt;
&lt;br /&gt;
'''Scope of our changes'''&lt;br /&gt;
&lt;br /&gt;
The changes made in this project affect the Bookmark Controller so tests are written for its validity.&lt;br /&gt;
 &lt;br /&gt;
Also we noticed that the Bookmark Model didn't have any testing done so we are planning to test that.&lt;br /&gt;
&lt;br /&gt;
While manually testing for correctness we came the issue of average rating present even when no rating of the bookmark was added, additionally the computation of average had a bug and was hence giving wrong average value.&lt;br /&gt;
&lt;br /&gt;
The picture below shows the the bug the previous code had :&lt;br /&gt;
&lt;br /&gt;
It shows an average rating value of 4.0 even when no review was done.&lt;br /&gt;
&lt;br /&gt;
[[File:Wrong_avg.png]]&lt;br /&gt;
&lt;br /&gt;
== Files modified in current project ==&lt;br /&gt;
&lt;br /&gt;
'''''1. Fixing Average problem and adding Rubric feature  :'''''&lt;br /&gt;
&lt;br /&gt;
The following files were modified for fixing the average rating bug and adding rubric for the same.&lt;br /&gt;
&lt;br /&gt;
app/models/bookmark_rating_response_map.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmark_rating_questionnaire_controller.rb &lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmarks_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/response_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/views/assignments/edit/_rubrics.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/bookmark_rating.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/list.html.erb&lt;br /&gt;
   &lt;br /&gt;
app/views/response/view.html.erb&lt;br /&gt;
&lt;br /&gt;
config/routes.rb  &lt;br /&gt;
&lt;br /&gt;
'''''2. Tests for Model and Controller :'''''&lt;br /&gt;
&lt;br /&gt;
spec/controllers/bookmarks_controller_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/models/bookmark_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/factories/factories.rb&lt;br /&gt;
&lt;br /&gt;
== Automated &amp;amp; UI Testing ==&lt;br /&gt;
&lt;br /&gt;
Automated RSpec tests were added to ensure the bookmarks are valid. Separate tests were written for the Bookmark Model and BookmarkRating Controller files. &lt;br /&gt;
The videos of the tests are uploaded onto YouTube and the links are provided in the references section.&lt;br /&gt;
&lt;br /&gt;
Below shown is the coverage details&lt;br /&gt;
&lt;br /&gt;
[[File:Coverage1.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:Coverage2.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''a) Back button for the page &amp;quot;View Bookmark&amp;quot; and &amp;quot;Create Bookmark&amp;quot; was resolved.'''&lt;br /&gt;
&lt;br /&gt;
1. Login with the credentials to expertiza.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'My assignments' and select OSS Project/writeup.&lt;br /&gt;
&lt;br /&gt;
3. Select 'Signup sheet'.&lt;br /&gt;
&lt;br /&gt;
4. Many titles for projects are shown. Select a title and choose either 'View Bookmark' or 'Add Bookmark' button&lt;br /&gt;
&lt;br /&gt;
5. If you  choose 'View Bookmark', after viewing, press the back button to go back to Signup sheet.&lt;br /&gt;
&lt;br /&gt;
6. You will land up in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
7. If you choose 'Add Bookmark', you can add by giving Bookmark details and save it.&lt;br /&gt;
&lt;br /&gt;
8. Now press back button.&lt;br /&gt;
&lt;br /&gt;
9. You will land in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''b) Adding Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Questionnaires'&lt;br /&gt;
&lt;br /&gt;
3. Select new public/private item under BookmarkRating&lt;br /&gt;
&lt;br /&gt;
4. Fill in with required values and create it.&lt;br /&gt;
&lt;br /&gt;
5. After this if you go to bookmark rubric option it should be visible &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Allowing Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Assignments'&lt;br /&gt;
&lt;br /&gt;
3. Select the appropriate project&lt;br /&gt;
&lt;br /&gt;
4. Now edit the project.&lt;br /&gt;
&lt;br /&gt;
5. Check the box &amp;quot;Allow participants to create bookmarks?&amp;quot; under Topics tab if not done already.&lt;br /&gt;
&lt;br /&gt;
6. Choose the appropriate rubric from the list or create one following steps from above.&lt;br /&gt;
&lt;br /&gt;
7. Now under Rubrics tab choose the &amp;quot;Scale&amp;quot; option for Scored-question display style.&lt;br /&gt;
&lt;br /&gt;
== Future Work ==&lt;br /&gt;
&lt;br /&gt;
1. A reviewer can be recognized or credited if he added useful bookmarks i.e if the author has made use of the bookmark.&lt;br /&gt;
&lt;br /&gt;
2. A function to add badges automatically if a participant had submitted more than threshold number of useful bookmarks.&lt;br /&gt;
&lt;br /&gt;
3. The UI is basic and it can be further improved.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&lt;br /&gt;
1. Expertiza on Github : https://github.com/rahuliyer95/expertiza &lt;br /&gt;
&lt;br /&gt;
2. Videos on YouTube : https://youtu.be/F95FA9Iam0s, https://youtu.be/tPpowgNRINk&lt;br /&gt;
&lt;br /&gt;
3. Pull Request : https://github.com/expertiza/expertiza/pull/1266&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:Wrong_avg.png&amp;diff=119076</id>
		<title>File:Wrong avg.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:Wrong_avg.png&amp;diff=119076"/>
		<updated>2018-11-09T19:43:48Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=119075</id>
		<title>E1830 OSS Project Juniper: Bookmark enhancements</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=119075"/>
		<updated>2018-11-09T19:43:21Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Testing Plan */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;'''Peer Review Information'''&lt;br /&gt;
&lt;br /&gt;
For users intending to view the Expertiza Bookmark enhancement associated with this assignment, the credentials are below:&lt;br /&gt;
&lt;br /&gt;
Instructor login: username -&amp;gt; instructor6, password -&amp;gt; password&lt;br /&gt;
&lt;br /&gt;
Student Accounts for Impersonation : student6340, student6341; Assignment -&amp;gt; Exercises, CSC 456, Fall 2015&lt;br /&gt;
&lt;br /&gt;
'''&lt;br /&gt;
== Introduction ==&lt;br /&gt;
'''&lt;br /&gt;
&lt;br /&gt;
'''Expertiza Background'''&lt;br /&gt;
&lt;br /&gt;
Expertiza is an open-source educational web application developed on Ruby on Rails platform. Students and Instructors (including TA's) use this application though their credentials. Instructors can add new projects, assignments etc as well edit the previous ones and at a later stage can see the student submission and grade them. They can even put a time limit (deadline) for submitting the assignment. Students can form teams for the projects, submit their work through handles (Wiki page, link to a video etc). Students can even review their teammates and other peers, as well give them any suggestions if required.&lt;br /&gt;
&lt;br /&gt;
GitHub hooks to Expertiza to encourage contributors. Expertiza project is supported by National Science Foundation.&lt;br /&gt;
&lt;br /&gt;
'''Description of the current project'''&lt;br /&gt;
&lt;br /&gt;
This project is intended to make Bookmarks more user-friendly, credible and valid. Bookmarks in expertiza are created by reviewers and can be used by authors for their work on any project. On each line of the signup sheet are two icons, one for adding a bookmark to the topic, and another for viewing bookmarks on the topic. If the instructor allows the participants to create bookmarks, then only a participant has access to create and view them. He should be able to create a new Bookmark only if he enters a valid one.&lt;br /&gt;
&lt;br /&gt;
Now a new rubric is added for reviewing the bookmarks added to a topic and this is accessible only to members belonging to the topic. Therefore ratings can be now done via a drop-down or rubric.&lt;br /&gt;
&lt;br /&gt;
== Issues ==&lt;br /&gt;
&lt;br /&gt;
'''Problem 1'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
When a user after logging into expertiza goes to 'Create New Bookmark page&amp;quot; or &amp;quot;View existing bookmarks page&amp;quot;, he's not able to go back to Sign-up sheet using &amp;quot;back&amp;quot; button.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:back.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Solution :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:fixed_back_link.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Problem 2'''&lt;br /&gt;
&lt;br /&gt;
Bookmarks had only one option while reviewing and it was to use a drop down to give a score. Also the average rating metric had a bug and hence showed wrong values even when bookmark was not reviewed. The bug was fixed and the rubric feature was adding a new controller.&lt;br /&gt;
&lt;br /&gt;
Now choosing &amp;quot;Scale&amp;quot; Option instead of &amp;quot;Dropdown&amp;quot; allows one to use a rubric instead.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:scale.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric for rating the bookmark shows up as a link that looks as follows :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:begin_review.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric looks like :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:bookmark_review_rubric.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Testing Plan ==&lt;br /&gt;
&lt;br /&gt;
'''Scope of our changes'''&lt;br /&gt;
&lt;br /&gt;
The changes made in this project affect the Bookmark Controller so tests are written for its validity.&lt;br /&gt;
 &lt;br /&gt;
Also we noticed that the Bookmark Model didn't have any testing done so we are planning to test that.&lt;br /&gt;
&lt;br /&gt;
While manually testing for correctness we came the issue of average rating present even when no rating of the bookmark was added, additionally the computation of average had a bug and was hence giving wrong average value.&lt;br /&gt;
&lt;br /&gt;
[[File:Wrong_avg.png]]&lt;br /&gt;
&lt;br /&gt;
== Files modified in current project ==&lt;br /&gt;
&lt;br /&gt;
'''''1. Fixing Average problem and adding Rubric feature  :'''''&lt;br /&gt;
&lt;br /&gt;
The following files were modified for fixing the average rating bug and adding rubric for the same.&lt;br /&gt;
&lt;br /&gt;
app/models/bookmark_rating_response_map.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmark_rating_questionnaire_controller.rb &lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmarks_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/response_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/views/assignments/edit/_rubrics.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/bookmark_rating.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/list.html.erb&lt;br /&gt;
   &lt;br /&gt;
app/views/response/view.html.erb&lt;br /&gt;
&lt;br /&gt;
config/routes.rb  &lt;br /&gt;
&lt;br /&gt;
'''''2. Tests for Model and Controller :'''''&lt;br /&gt;
&lt;br /&gt;
spec/controllers/bookmarks_controller_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/models/bookmark_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/factories/factories.rb&lt;br /&gt;
&lt;br /&gt;
== Automated &amp;amp; UI Testing ==&lt;br /&gt;
&lt;br /&gt;
Automated RSpec tests were added to ensure the bookmarks are valid. Separate tests were written for the Bookmark Model and BookmarkRating Controller files. &lt;br /&gt;
The videos of the tests are uploaded onto YouTube and the links are provided in the references section.&lt;br /&gt;
&lt;br /&gt;
Below shown is the coverage details&lt;br /&gt;
&lt;br /&gt;
[[File:Coverage1.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:Coverage2.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''a) Back button for the page &amp;quot;View Bookmark&amp;quot; and &amp;quot;Create Bookmark&amp;quot; was resolved.'''&lt;br /&gt;
&lt;br /&gt;
1. Login with the credentials to expertiza.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'My assignments' and select OSS Project/writeup.&lt;br /&gt;
&lt;br /&gt;
3. Select 'Signup sheet'.&lt;br /&gt;
&lt;br /&gt;
4. Many titles for projects are shown. Select a title and choose either 'View Bookmark' or 'Add Bookmark' button&lt;br /&gt;
&lt;br /&gt;
5. If you  choose 'View Bookmark', after viewing, press the back button to go back to Signup sheet.&lt;br /&gt;
&lt;br /&gt;
6. You will land up in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
7. If you choose 'Add Bookmark', you can add by giving Bookmark details and save it.&lt;br /&gt;
&lt;br /&gt;
8. Now press back button.&lt;br /&gt;
&lt;br /&gt;
9. You will land in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''b) Adding Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Questionnaires'&lt;br /&gt;
&lt;br /&gt;
3. Select new public/private item under BookmarkRating&lt;br /&gt;
&lt;br /&gt;
4. Fill in with required values and create it.&lt;br /&gt;
&lt;br /&gt;
5. After this if you go to bookmark rubric option it should be visible &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Allowing Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Assignments'&lt;br /&gt;
&lt;br /&gt;
3. Select the appropriate project&lt;br /&gt;
&lt;br /&gt;
4. Now edit the project.&lt;br /&gt;
&lt;br /&gt;
5. Check the box &amp;quot;Allow participants to create bookmarks?&amp;quot; under Topics tab if not done already.&lt;br /&gt;
&lt;br /&gt;
6. Choose the appropriate rubric from the list or create one following steps from above.&lt;br /&gt;
&lt;br /&gt;
7. Now under Rubrics tab choose the &amp;quot;Scale&amp;quot; option for Scored-question display style.&lt;br /&gt;
&lt;br /&gt;
== Future Work ==&lt;br /&gt;
&lt;br /&gt;
1. A reviewer can be recognized or credited if he added useful bookmarks i.e if the author has made use of the bookmark.&lt;br /&gt;
&lt;br /&gt;
2. A function to add badges automatically if a participant had submitted more than threshold number of useful bookmarks.&lt;br /&gt;
&lt;br /&gt;
3. The UI is basic and it can be further improved.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&lt;br /&gt;
1. Expertiza on Github : https://github.com/rahuliyer95/expertiza &lt;br /&gt;
&lt;br /&gt;
2. Videos on YouTube : https://youtu.be/F95FA9Iam0s, https://youtu.be/tPpowgNRINk&lt;br /&gt;
&lt;br /&gt;
3. Pull Request : https://github.com/expertiza/expertiza/pull/1266&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=119072</id>
		<title>E1830 OSS Project Juniper: Bookmark enhancements</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=119072"/>
		<updated>2018-11-09T19:17:10Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;'''Peer Review Information'''&lt;br /&gt;
&lt;br /&gt;
For users intending to view the Expertiza Bookmark enhancement associated with this assignment, the credentials are below:&lt;br /&gt;
&lt;br /&gt;
Instructor login: username -&amp;gt; instructor6, password -&amp;gt; password&lt;br /&gt;
&lt;br /&gt;
Student Accounts for Impersonation : student6340, student6341; Assignment -&amp;gt; Exercises, CSC 456, Fall 2015&lt;br /&gt;
&lt;br /&gt;
'''&lt;br /&gt;
== Introduction ==&lt;br /&gt;
'''&lt;br /&gt;
&lt;br /&gt;
'''Expertiza Background'''&lt;br /&gt;
&lt;br /&gt;
Expertiza is an open-source educational web application developed on Ruby on Rails platform. Students and Instructors (including TA's) use this application though their credentials. Instructors can add new projects, assignments etc as well edit the previous ones and at a later stage can see the student submission and grade them. They can even put a time limit (deadline) for submitting the assignment. Students can form teams for the projects, submit their work through handles (Wiki page, link to a video etc). Students can even review their teammates and other peers, as well give them any suggestions if required.&lt;br /&gt;
&lt;br /&gt;
GitHub hooks to Expertiza to encourage contributors. Expertiza project is supported by National Science Foundation.&lt;br /&gt;
&lt;br /&gt;
'''Description of the current project'''&lt;br /&gt;
&lt;br /&gt;
This project is intended to make Bookmarks more user-friendly, credible and valid. Bookmarks in expertiza are created by reviewers and can be used by authors for their work on any project. On each line of the signup sheet are two icons, one for adding a bookmark to the topic, and another for viewing bookmarks on the topic. If the instructor allows the participants to create bookmarks, then only a participant has access to create and view them. He should be able to create a new Bookmark only if he enters a valid one.&lt;br /&gt;
&lt;br /&gt;
Now a new rubric is added for reviewing the bookmarks added to a topic and this is accessible only to members belonging to the topic. Therefore ratings can be now done via a drop-down or rubric.&lt;br /&gt;
&lt;br /&gt;
== Issues ==&lt;br /&gt;
&lt;br /&gt;
'''Problem 1'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
When a user after logging into expertiza goes to 'Create New Bookmark page&amp;quot; or &amp;quot;View existing bookmarks page&amp;quot;, he's not able to go back to Sign-up sheet using &amp;quot;back&amp;quot; button.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:back.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Solution :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:fixed_back_link.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Problem 2'''&lt;br /&gt;
&lt;br /&gt;
Bookmarks had only one option while reviewing and it was to use a drop down to give a score. Also the average rating metric had a bug and hence showed wrong values even when bookmark was not reviewed. The bug was fixed and the rubric feature was adding a new controller.&lt;br /&gt;
&lt;br /&gt;
Now choosing &amp;quot;Scale&amp;quot; Option instead of &amp;quot;Dropdown&amp;quot; allows one to use a rubric instead.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:scale.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric for rating the bookmark shows up as a link that looks as follows :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:begin_review.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric looks like :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:bookmark_review_rubric.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Testing Plan ==&lt;br /&gt;
&lt;br /&gt;
'''Scope of our changes'''&lt;br /&gt;
&lt;br /&gt;
The changes made in this project affect the Bookmark Controller so tests are written for its validity.&lt;br /&gt;
 &lt;br /&gt;
Also we noticed that the Bookmark Model didn't have any testing done so we are planning to test that.&lt;br /&gt;
&lt;br /&gt;
While manually testing for correctness we came the issue of average rating present even when no rating of the bookmark was added, additionally the computation of average had a bug and was hence giving wrong average value.&lt;br /&gt;
&lt;br /&gt;
== Files modified in current project ==&lt;br /&gt;
&lt;br /&gt;
'''''1. Fixing Average problem and adding Rubric feature  :'''''&lt;br /&gt;
&lt;br /&gt;
The following files were modified for fixing the average rating bug and adding rubric for the same.&lt;br /&gt;
&lt;br /&gt;
app/models/bookmark_rating_response_map.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmark_rating_questionnaire_controller.rb &lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmarks_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/response_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/views/assignments/edit/_rubrics.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/bookmark_rating.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/list.html.erb&lt;br /&gt;
   &lt;br /&gt;
app/views/response/view.html.erb&lt;br /&gt;
&lt;br /&gt;
config/routes.rb  &lt;br /&gt;
&lt;br /&gt;
'''''2. Tests for Model and Controller :'''''&lt;br /&gt;
&lt;br /&gt;
spec/controllers/bookmarks_controller_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/models/bookmark_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/factories/factories.rb&lt;br /&gt;
&lt;br /&gt;
== Automated &amp;amp; UI Testing ==&lt;br /&gt;
&lt;br /&gt;
Automated RSpec tests were added to ensure the bookmarks are valid. Separate tests were written for the Bookmark Model and BookmarkRating Controller files. &lt;br /&gt;
The videos of the tests are uploaded onto YouTube and the links are provided in the references section.&lt;br /&gt;
&lt;br /&gt;
Below shown is the coverage details&lt;br /&gt;
&lt;br /&gt;
[[File:Coverage1.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:Coverage2.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''a) Back button for the page &amp;quot;View Bookmark&amp;quot; and &amp;quot;Create Bookmark&amp;quot; was resolved.'''&lt;br /&gt;
&lt;br /&gt;
1. Login with the credentials to expertiza.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'My assignments' and select OSS Project/writeup.&lt;br /&gt;
&lt;br /&gt;
3. Select 'Signup sheet'.&lt;br /&gt;
&lt;br /&gt;
4. Many titles for projects are shown. Select a title and choose either 'View Bookmark' or 'Add Bookmark' button&lt;br /&gt;
&lt;br /&gt;
5. If you  choose 'View Bookmark', after viewing, press the back button to go back to Signup sheet.&lt;br /&gt;
&lt;br /&gt;
6. You will land up in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
7. If you choose 'Add Bookmark', you can add by giving Bookmark details and save it.&lt;br /&gt;
&lt;br /&gt;
8. Now press back button.&lt;br /&gt;
&lt;br /&gt;
9. You will land in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''b) Adding Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Questionnaires'&lt;br /&gt;
&lt;br /&gt;
3. Select new public/private item under BookmarkRating&lt;br /&gt;
&lt;br /&gt;
4. Fill in with required values and create it.&lt;br /&gt;
&lt;br /&gt;
5. After this if you go to bookmark rubric option it should be visible &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Allowing Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Assignments'&lt;br /&gt;
&lt;br /&gt;
3. Select the appropriate project&lt;br /&gt;
&lt;br /&gt;
4. Now edit the project.&lt;br /&gt;
&lt;br /&gt;
5. Check the box &amp;quot;Allow participants to create bookmarks?&amp;quot; under Topics tab if not done already.&lt;br /&gt;
&lt;br /&gt;
6. Choose the appropriate rubric from the list or create one following steps from above.&lt;br /&gt;
&lt;br /&gt;
7. Now under Rubrics tab choose the &amp;quot;Scale&amp;quot; option for Scored-question display style.&lt;br /&gt;
&lt;br /&gt;
== Future Work ==&lt;br /&gt;
&lt;br /&gt;
1. A reviewer can be recognized or credited if he added useful bookmarks i.e if the author has made use of the bookmark.&lt;br /&gt;
&lt;br /&gt;
2. A function to add badges automatically if a participant had submitted more than threshold number of useful bookmarks.&lt;br /&gt;
&lt;br /&gt;
3. The UI is basic and it can be further improved.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&lt;br /&gt;
1. Expertiza on Github : https://github.com/rahuliyer95/expertiza &lt;br /&gt;
&lt;br /&gt;
2. Videos on YouTube : https://youtu.be/F95FA9Iam0s, https://youtu.be/tPpowgNRINk&lt;br /&gt;
&lt;br /&gt;
3. Pull Request : https://github.com/expertiza/expertiza/pull/1266&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118678</id>
		<title>E1830 OSS Project Juniper: Bookmark enhancements</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118678"/>
		<updated>2018-11-05T02:14:24Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Automated &amp;amp; UI Testing */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;'''Peer Review Information'''&lt;br /&gt;
&lt;br /&gt;
For users intending to view the Expertiza Bookmark enhancement associated with this assignment, the credentials are below:&lt;br /&gt;
&lt;br /&gt;
Instructor login: username -&amp;gt; instructor6, password -&amp;gt; password&lt;br /&gt;
&lt;br /&gt;
Student Accounts for Impersonation : student6340, student6341; Assignment -&amp;gt; Exercises, CSC 456, Fall 2015&lt;br /&gt;
&lt;br /&gt;
'''&lt;br /&gt;
== Introduction ==&lt;br /&gt;
'''&lt;br /&gt;
&lt;br /&gt;
'''Expertiza Background'''&lt;br /&gt;
&lt;br /&gt;
Expertiza is an open-source educational web application developed on Ruby on Rails platform. Students and Instructors (including TA's) use this application though their credentials. Instructors can add new projects, assignments etc as well edit the previous ones and at a later stage can see the student submission and grade them. They can even put a time limit (deadline) for submitting the assignment. Students can form teams for the projects, submit their work through handles (Wiki page, link to a video etc). Students can even review their teammates and other peers, as well give them any suggestions if required.&lt;br /&gt;
&lt;br /&gt;
GitHub hooks to Expertiza to encourage contributors. Expertiza project is supported by National Science Foundation.&lt;br /&gt;
&lt;br /&gt;
'''Description of the current project'''&lt;br /&gt;
&lt;br /&gt;
This project is intended to make Bookmarks more user-friendly, credible and valid. Bookmarks in expertiza are created by reviewers and can be used by authors for their work on any project. On each line of the signup sheet are two icons, one for adding a bookmark to the topic, and another for viewing bookmarks on the topic. If the instructor allows the participants to create bookmarks, then only a participant has access to create and view them. He should be able to create a new Bookmark only if he enters a valid one.&lt;br /&gt;
&lt;br /&gt;
Now a new rubric is added for reviewing the bookmarks added to a topic and this is accessible only to members belonging to the topic. Therefore ratings can be now done via a drop-down or rubric.&lt;br /&gt;
&lt;br /&gt;
== Issues ==&lt;br /&gt;
&lt;br /&gt;
'''Problem 1'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
When a user after logging into expertiza goes to 'Create New Bookmark page&amp;quot; or &amp;quot;View existing bookmarks page&amp;quot;, he's not able to go back to Sign-up sheet using &amp;quot;back&amp;quot; button.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:back.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Solution :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:fixed_back_link.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Problem 2'''&lt;br /&gt;
&lt;br /&gt;
Bookmarks had only one option while reviewing and it was to use a drop down to give a score. Also the average rating metric had a bug and hence showed wrong values even when bookmark was not reviewed. The bug was fixed and the rubric feature was adding a new controller.&lt;br /&gt;
&lt;br /&gt;
Now choosing &amp;quot;Scale&amp;quot; Option instead of &amp;quot;Dropdown&amp;quot; allows one to use a rubric instead.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:scale.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric for rating the bookmark shows up as a link that looks as follows :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:begin_review.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric looks like :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:bookmark_review_rubric.png]]&lt;br /&gt;
&lt;br /&gt;
== Files modified in current project ==&lt;br /&gt;
&lt;br /&gt;
'''''1. Fixing Average problem and adding Rubric feature  :'''''&lt;br /&gt;
&lt;br /&gt;
The following files were modified for fixing the average rating bug and adding rubric for the same.&lt;br /&gt;
&lt;br /&gt;
app/models/bookmark_rating_response_map.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmark_rating_questionnaire_controller.rb &lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmarks_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/response_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/views/assignments/edit/_rubrics.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/bookmark_rating.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/list.html.erb&lt;br /&gt;
   &lt;br /&gt;
app/views/response/view.html.erb&lt;br /&gt;
&lt;br /&gt;
config/routes.rb  &lt;br /&gt;
&lt;br /&gt;
'''''2. Tests for Model and Controller :'''''&lt;br /&gt;
&lt;br /&gt;
spec/controllers/bookmarks_controller_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/models/bookmark_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/factories/factories.rb&lt;br /&gt;
&lt;br /&gt;
== Automated &amp;amp; UI Testing ==&lt;br /&gt;
&lt;br /&gt;
Automated RSpec tests were added to ensure the bookmarks are valid. Separate tests were written for the Bookmark Model and BookmarkRating Controller files. &lt;br /&gt;
The videos of the tests are uploaded onto YouTube and the links are provided in the references section.&lt;br /&gt;
&lt;br /&gt;
Below shown is the coverage details&lt;br /&gt;
&lt;br /&gt;
[[File:Coverage1.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:Coverage2.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''a) Back button for the page &amp;quot;View Bookmark&amp;quot; and &amp;quot;Create Bookmark&amp;quot; was resolved.'''&lt;br /&gt;
&lt;br /&gt;
1. Login with the credentials to expertiza.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'My assignments' and select OSS Project/writeup.&lt;br /&gt;
&lt;br /&gt;
3. Select 'Signup sheet'.&lt;br /&gt;
&lt;br /&gt;
4. Many titles for projects are shown. Select a title and choose either 'View Bookmark' or 'Add Bookmark' button&lt;br /&gt;
&lt;br /&gt;
5. If you  choose 'View Bookmark', after viewing, press the back button to go back to Signup sheet.&lt;br /&gt;
&lt;br /&gt;
6. You will land up in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
7. If you choose 'Add Bookmark', you can add by giving Bookmark details and save it.&lt;br /&gt;
&lt;br /&gt;
8. Now press back button.&lt;br /&gt;
&lt;br /&gt;
9. You will land in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''b) Adding Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Questionnaires'&lt;br /&gt;
&lt;br /&gt;
3. Select new public/private item under BookmarkRating&lt;br /&gt;
&lt;br /&gt;
4. Fill in with required values and create it.&lt;br /&gt;
&lt;br /&gt;
5. After this if you go to bookmark rubric option it should be visible &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Allowing Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Assignments'&lt;br /&gt;
&lt;br /&gt;
3. Select the appropriate project&lt;br /&gt;
&lt;br /&gt;
4. Now edit the project.&lt;br /&gt;
&lt;br /&gt;
5. Check the box &amp;quot;Allow participants to create bookmarks?&amp;quot; under Topics tab if not done already.&lt;br /&gt;
&lt;br /&gt;
6. Choose the appropriate rubric from the list or create one following steps from above.&lt;br /&gt;
&lt;br /&gt;
7. Now under Rubrics tab choose the &amp;quot;Scale&amp;quot; option for Scored-question display style.&lt;br /&gt;
&lt;br /&gt;
== Future Work ==&lt;br /&gt;
&lt;br /&gt;
1. A reviewer can be recognized or credited if he added useful bookmarks i.e if the author has made use of the bookmark.&lt;br /&gt;
&lt;br /&gt;
2. A function to add badges automatically if a participant had submitted more than threshold number of useful bookmarks.&lt;br /&gt;
&lt;br /&gt;
3. The UI is basic and it can be further improved.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&lt;br /&gt;
1. Expertiza on Github : https://github.com/rahuliyer95/expertiza &lt;br /&gt;
&lt;br /&gt;
2. Videos on YouTube : https://youtu.be/F95FA9Iam0s, https://youtu.be/tPpowgNRINk&lt;br /&gt;
&lt;br /&gt;
3. Pull Request : https://github.com/expertiza/expertiza/pull/1266&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:Coverage2.png&amp;diff=118677</id>
		<title>File:Coverage2.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:Coverage2.png&amp;diff=118677"/>
		<updated>2018-11-05T02:13:09Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:Coverage1.png&amp;diff=118676</id>
		<title>File:Coverage1.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:Coverage1.png&amp;diff=118676"/>
		<updated>2018-11-05T02:12:11Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118675</id>
		<title>E1830 OSS Project Juniper: Bookmark enhancements</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118675"/>
		<updated>2018-11-05T02:11:34Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Automated &amp;amp; UI Testing */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;'''Peer Review Information'''&lt;br /&gt;
&lt;br /&gt;
For users intending to view the Expertiza Bookmark enhancement associated with this assignment, the credentials are below:&lt;br /&gt;
&lt;br /&gt;
Instructor login: username -&amp;gt; instructor6, password -&amp;gt; password&lt;br /&gt;
&lt;br /&gt;
Student Accounts for Impersonation : student6340, student6341; Assignment -&amp;gt; Exercises, CSC 456, Fall 2015&lt;br /&gt;
&lt;br /&gt;
'''&lt;br /&gt;
== Introduction ==&lt;br /&gt;
'''&lt;br /&gt;
&lt;br /&gt;
'''Expertiza Background'''&lt;br /&gt;
&lt;br /&gt;
Expertiza is an open-source educational web application developed on Ruby on Rails platform. Students and Instructors (including TA's) use this application though their credentials. Instructors can add new projects, assignments etc as well edit the previous ones and at a later stage can see the student submission and grade them. They can even put a time limit (deadline) for submitting the assignment. Students can form teams for the projects, submit their work through handles (Wiki page, link to a video etc). Students can even review their teammates and other peers, as well give them any suggestions if required.&lt;br /&gt;
&lt;br /&gt;
GitHub hooks to Expertiza to encourage contributors. Expertiza project is supported by National Science Foundation.&lt;br /&gt;
&lt;br /&gt;
'''Description of the current project'''&lt;br /&gt;
&lt;br /&gt;
This project is intended to make Bookmarks more user-friendly, credible and valid. Bookmarks in expertiza are created by reviewers and can be used by authors for their work on any project. On each line of the signup sheet are two icons, one for adding a bookmark to the topic, and another for viewing bookmarks on the topic. If the instructor allows the participants to create bookmarks, then only a participant has access to create and view them. He should be able to create a new Bookmark only if he enters a valid one.&lt;br /&gt;
&lt;br /&gt;
Now a new rubric is added for reviewing the bookmarks added to a topic and this is accessible only to members belonging to the topic. Therefore ratings can be now done via a drop-down or rubric.&lt;br /&gt;
&lt;br /&gt;
== Issues ==&lt;br /&gt;
&lt;br /&gt;
'''Problem 1'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
When a user after logging into expertiza goes to 'Create New Bookmark page&amp;quot; or &amp;quot;View existing bookmarks page&amp;quot;, he's not able to go back to Sign-up sheet using &amp;quot;back&amp;quot; button.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:back.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Solution :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:fixed_back_link.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Problem 2'''&lt;br /&gt;
&lt;br /&gt;
Bookmarks had only one option while reviewing and it was to use a drop down to give a score. Also the average rating metric had a bug and hence showed wrong values even when bookmark was not reviewed. The bug was fixed and the rubric feature was adding a new controller.&lt;br /&gt;
&lt;br /&gt;
Now choosing &amp;quot;Scale&amp;quot; Option instead of &amp;quot;Dropdown&amp;quot; allows one to use a rubric instead.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:scale.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric for rating the bookmark shows up as a link that looks as follows :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:begin_review.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric looks like :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:bookmark_review_rubric.png]]&lt;br /&gt;
&lt;br /&gt;
== Files modified in current project ==&lt;br /&gt;
&lt;br /&gt;
'''''1. Fixing Average problem and adding Rubric feature  :'''''&lt;br /&gt;
&lt;br /&gt;
The following files were modified for fixing the average rating bug and adding rubric for the same.&lt;br /&gt;
&lt;br /&gt;
app/models/bookmark_rating_response_map.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmark_rating_questionnaire_controller.rb &lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmarks_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/response_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/views/assignments/edit/_rubrics.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/bookmark_rating.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/list.html.erb&lt;br /&gt;
   &lt;br /&gt;
app/views/response/view.html.erb&lt;br /&gt;
&lt;br /&gt;
config/routes.rb  &lt;br /&gt;
&lt;br /&gt;
'''''2. Tests for Model and Controller :'''''&lt;br /&gt;
&lt;br /&gt;
spec/controllers/bookmarks_controller_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/models/bookmark_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/factories/factories.rb&lt;br /&gt;
&lt;br /&gt;
== Automated &amp;amp; UI Testing ==&lt;br /&gt;
&lt;br /&gt;
Automated RSpec tests were added to ensure the bookmarks are valid. Separate tests were written for the Bookmark Model and BookmarkRating Controller files. &lt;br /&gt;
The videos of the tests are uploaded onto YouTube and the links are provided in the references section.&lt;br /&gt;
&lt;br /&gt;
Below shown is the coverage details&lt;br /&gt;
&lt;br /&gt;
[[File:Coverage1.png]]&lt;br /&gt;
&lt;br /&gt;
[[File:Coverage2.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''a) Back button for the page &amp;quot;View Bookmark&amp;quot; and &amp;quot;Create Bookmark&amp;quot; was resolved.'''&lt;br /&gt;
&lt;br /&gt;
1. Login with the credentials to expertiza.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'My assignments' and select OSS Project/writeup.&lt;br /&gt;
&lt;br /&gt;
3. Select 'Signup sheet'.&lt;br /&gt;
&lt;br /&gt;
4. Many titles for projects are shown. Select a title and choose either 'View Bookmark' or 'Add Bookmark' button&lt;br /&gt;
&lt;br /&gt;
5. If you  choose 'View Bookmark', after viewing, press the back button to go back to Signup sheet.&lt;br /&gt;
&lt;br /&gt;
6. You will land up in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
7. If you choose 'Add Bookmark', you can add by giving Bookmark details and save it.&lt;br /&gt;
&lt;br /&gt;
8. Now press back button.&lt;br /&gt;
&lt;br /&gt;
9. You will land in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''b) Adding Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Questionnaires'&lt;br /&gt;
&lt;br /&gt;
3. Select new public/private item under BookmarkRating&lt;br /&gt;
&lt;br /&gt;
4. Fill in with required values and create it.&lt;br /&gt;
&lt;br /&gt;
5. After this if you go to bookmark rubric option it should be visible &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Allowing Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Assignments'&lt;br /&gt;
&lt;br /&gt;
3. Select the appropriate project&lt;br /&gt;
&lt;br /&gt;
4. Now edit the project.&lt;br /&gt;
&lt;br /&gt;
5. Check the box &amp;quot;Allow participants to create bookmarks?&amp;quot; under Topics tab if not done already.&lt;br /&gt;
&lt;br /&gt;
6. Choose the appropriate rubric from the list or create one following steps from above.&lt;br /&gt;
&lt;br /&gt;
7. Now under Rubrics tab choose the &amp;quot;Scale&amp;quot; option for Scored-question display style.&lt;br /&gt;
&lt;br /&gt;
== Future Work ==&lt;br /&gt;
&lt;br /&gt;
1. A reviewer can be recognized or credited if he added useful bookmarks i.e if the author has made use of the bookmark.&lt;br /&gt;
&lt;br /&gt;
2. A function to add badges automatically if a participant had submitted more than threshold number of useful bookmarks.&lt;br /&gt;
&lt;br /&gt;
3. The UI is basic and it can be further improved.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&lt;br /&gt;
1. Expertiza on Github : https://github.com/rahuliyer95/expertiza &lt;br /&gt;
&lt;br /&gt;
2. Videos on YouTube : https://youtu.be/F95FA9Iam0s, https://youtu.be/tPpowgNRINk&lt;br /&gt;
&lt;br /&gt;
3. Pull Request : https://github.com/expertiza/expertiza/pull/1266&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118311</id>
		<title>E1830 OSS Project Juniper: Bookmark enhancements</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118311"/>
		<updated>2018-11-02T23:07:12Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Automated &amp;amp; UI Testing */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;'''Peer Review Information'''&lt;br /&gt;
&lt;br /&gt;
For users intending to view the Expertiza Bookmark enhancement associated with this assignment, the credentials are below:&lt;br /&gt;
&lt;br /&gt;
Instructor login: username -&amp;gt; instructor6, password -&amp;gt; password&lt;br /&gt;
&lt;br /&gt;
Student Accounts for Impersonation : student6340, student6341; Assignment -&amp;gt; Exercises, CSC 456, Fall 2015&lt;br /&gt;
&lt;br /&gt;
'''&lt;br /&gt;
== Introduction ==&lt;br /&gt;
'''&lt;br /&gt;
&lt;br /&gt;
'''Expertiza Background'''&lt;br /&gt;
&lt;br /&gt;
Expertiza is an open-source educational web application developed on Ruby on Rails platform. Students and Instructors (including TA's) use this application though their credentials. Instructors can add new projects, assignments etc as well edit the previous ones and at a later stage can see the student submission and grade them. They can even put a time limit (deadline) for submitting the assignment. Students can form teams for the projects, submit their work through handles (Wiki page, link to a video etc). Students can even review their teammates and other peers, as well give them any suggestions if required.&lt;br /&gt;
&lt;br /&gt;
GitHub hooks to Expertiza to encourage contributors. Expertiza project is supported by National Science Foundation.&lt;br /&gt;
&lt;br /&gt;
'''Description of the current project'''&lt;br /&gt;
&lt;br /&gt;
This project is intended to make Bookmarks more user-friendly, credible and valid. Bookmarks in expertiza are created by reviewers and can be used by authors for their work on any project. On each line of the signup sheet are two icons, one for adding a bookmark to the topic, and another for viewing bookmarks on the topic. If the instructor allows the participants to create bookmarks, then only a participant has access to create and view them. He should be able to create a new Bookmark only if he enters a valid one.&lt;br /&gt;
&lt;br /&gt;
Now a new rubric is added for reviewing the bookmarks added to a topic and this is accessible only to members belonging to the topic. Therefore ratings can be now done via a drop-down or rubric.&lt;br /&gt;
&lt;br /&gt;
== Issues ==&lt;br /&gt;
&lt;br /&gt;
'''Problem 1'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
When a user after logging into expertiza goes to 'Create New Bookmark page&amp;quot; or &amp;quot;View existing bookmarks page&amp;quot;, he's not able to go back to Sign-up sheet using &amp;quot;back&amp;quot; button.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:back.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Solution :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:fixed_back_link.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Problem 2'''&lt;br /&gt;
&lt;br /&gt;
Bookmarks had only one option while reviewing and it was to use a drop down to give a score. Also the average rating metric had a bug and hence showed wrong values even when bookmark was not reviewed. The bug was fixed and the rubric feature was adding a new controller.&lt;br /&gt;
&lt;br /&gt;
Now choosing &amp;quot;Scale&amp;quot; Option instead of &amp;quot;Dropdown&amp;quot; allows one to use a rubric instead.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:scale.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric for rating the bookmark shows up as a link that looks as follows :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:begin_review.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric looks like :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:bookmark_review_rubric.png]]&lt;br /&gt;
&lt;br /&gt;
== Files modified in current project ==&lt;br /&gt;
&lt;br /&gt;
'''''1. Fixing Average problem and adding Rubric feature  :'''''&lt;br /&gt;
&lt;br /&gt;
The following files were modified for fixing the average rating bug and adding rubric for the same.&lt;br /&gt;
&lt;br /&gt;
app/models/bookmark_rating_response_map.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmark_rating_questionnaire_controller.rb &lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmarks_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/response_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/views/assignments/edit/_rubrics.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/bookmark_rating.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/list.html.erb&lt;br /&gt;
   &lt;br /&gt;
app/views/response/view.html.erb&lt;br /&gt;
&lt;br /&gt;
config/routes.rb  &lt;br /&gt;
&lt;br /&gt;
'''''2. Tests for Model and Controller :'''''&lt;br /&gt;
&lt;br /&gt;
spec/controllers/bookmarks_controller_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/models/bookmark_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/factories/factories.rb&lt;br /&gt;
&lt;br /&gt;
== Automated &amp;amp; UI Testing ==&lt;br /&gt;
&lt;br /&gt;
Automated RSpec tests were added to ensure the bookmarks are valid. Separate tests were written for the Bookmark Model and BookmarkRating Controller files. &lt;br /&gt;
The videos of the tests are uploaded onto YouTube and the links are provided in the references section.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''a) Back button for the page &amp;quot;View Bookmark&amp;quot; and &amp;quot;Create Bookmark&amp;quot; was resolved.'''&lt;br /&gt;
&lt;br /&gt;
1. Login with the credentials to expertiza.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'My assignments' and select OSS Project/writeup.&lt;br /&gt;
&lt;br /&gt;
3. Select 'Signup sheet'.&lt;br /&gt;
&lt;br /&gt;
4. Many titles for projects are shown. Select a title and choose either 'View Bookmark' or 'Add Bookmark' button&lt;br /&gt;
&lt;br /&gt;
5. If you  choose 'View Bookmark', after viewing, press the back button to go back to Signup sheet.&lt;br /&gt;
&lt;br /&gt;
6. You will land up in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
7. If you choose 'Add Bookmark', you can add by giving Bookmark details and save it.&lt;br /&gt;
&lt;br /&gt;
8. Now press back button.&lt;br /&gt;
&lt;br /&gt;
9. You will land in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''b) Adding Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Questionnaires'&lt;br /&gt;
&lt;br /&gt;
3. Select new public/private item under BookmarkRating&lt;br /&gt;
&lt;br /&gt;
4. Fill in with required values and create it.&lt;br /&gt;
&lt;br /&gt;
5. After this if you go to bookmark rubric option it should be visible &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Allowing Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Assignments'&lt;br /&gt;
&lt;br /&gt;
3. Select the appropriate project&lt;br /&gt;
&lt;br /&gt;
4. Now edit the project.&lt;br /&gt;
&lt;br /&gt;
5. Check the box &amp;quot;Allow participants to create bookmarks?&amp;quot; under Topics tab if not done already.&lt;br /&gt;
&lt;br /&gt;
6. Choose the appropriate rubric from the list or create one following steps from above.&lt;br /&gt;
&lt;br /&gt;
7. Now under Rubrics tab choose the &amp;quot;Scale&amp;quot; option for Scored-question display style.&lt;br /&gt;
&lt;br /&gt;
== Future Work ==&lt;br /&gt;
&lt;br /&gt;
1. A reviewer can be recognized or credited if he added useful bookmarks i.e if the author has made use of the bookmark.&lt;br /&gt;
&lt;br /&gt;
2. A function to add badges automatically if a participant had submitted more than threshold number of useful bookmarks.&lt;br /&gt;
&lt;br /&gt;
3. The UI is basic and it can be further improved.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&lt;br /&gt;
1. Expertiza on Github : https://github.com/rahuliyer95/expertiza &lt;br /&gt;
&lt;br /&gt;
2. Videos on YouTube : https://youtu.be/F95FA9Iam0s, https://youtu.be/tPpowgNRINk&lt;br /&gt;
&lt;br /&gt;
3. Pull Request : https://github.com/expertiza/expertiza/pull/1266&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118310</id>
		<title>E1830 OSS Project Juniper: Bookmark enhancements</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118310"/>
		<updated>2018-11-02T23:06:30Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;'''Peer Review Information'''&lt;br /&gt;
&lt;br /&gt;
For users intending to view the Expertiza Bookmark enhancement associated with this assignment, the credentials are below:&lt;br /&gt;
&lt;br /&gt;
Instructor login: username -&amp;gt; instructor6, password -&amp;gt; password&lt;br /&gt;
&lt;br /&gt;
Student Accounts for Impersonation : student6340, student6341; Assignment -&amp;gt; Exercises, CSC 456, Fall 2015&lt;br /&gt;
&lt;br /&gt;
'''&lt;br /&gt;
== Introduction ==&lt;br /&gt;
'''&lt;br /&gt;
&lt;br /&gt;
'''Expertiza Background'''&lt;br /&gt;
&lt;br /&gt;
Expertiza is an open-source educational web application developed on Ruby on Rails platform. Students and Instructors (including TA's) use this application though their credentials. Instructors can add new projects, assignments etc as well edit the previous ones and at a later stage can see the student submission and grade them. They can even put a time limit (deadline) for submitting the assignment. Students can form teams for the projects, submit their work through handles (Wiki page, link to a video etc). Students can even review their teammates and other peers, as well give them any suggestions if required.&lt;br /&gt;
&lt;br /&gt;
GitHub hooks to Expertiza to encourage contributors. Expertiza project is supported by National Science Foundation.&lt;br /&gt;
&lt;br /&gt;
'''Description of the current project'''&lt;br /&gt;
&lt;br /&gt;
This project is intended to make Bookmarks more user-friendly, credible and valid. Bookmarks in expertiza are created by reviewers and can be used by authors for their work on any project. On each line of the signup sheet are two icons, one for adding a bookmark to the topic, and another for viewing bookmarks on the topic. If the instructor allows the participants to create bookmarks, then only a participant has access to create and view them. He should be able to create a new Bookmark only if he enters a valid one.&lt;br /&gt;
&lt;br /&gt;
Now a new rubric is added for reviewing the bookmarks added to a topic and this is accessible only to members belonging to the topic. Therefore ratings can be now done via a drop-down or rubric.&lt;br /&gt;
&lt;br /&gt;
== Issues ==&lt;br /&gt;
&lt;br /&gt;
'''Problem 1'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
When a user after logging into expertiza goes to 'Create New Bookmark page&amp;quot; or &amp;quot;View existing bookmarks page&amp;quot;, he's not able to go back to Sign-up sheet using &amp;quot;back&amp;quot; button.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:back.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Solution :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:fixed_back_link.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Problem 2'''&lt;br /&gt;
&lt;br /&gt;
Bookmarks had only one option while reviewing and it was to use a drop down to give a score. Also the average rating metric had a bug and hence showed wrong values even when bookmark was not reviewed. The bug was fixed and the rubric feature was adding a new controller.&lt;br /&gt;
&lt;br /&gt;
Now choosing &amp;quot;Scale&amp;quot; Option instead of &amp;quot;Dropdown&amp;quot; allows one to use a rubric instead.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:scale.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric for rating the bookmark shows up as a link that looks as follows :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:begin_review.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric looks like :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:bookmark_review_rubric.png]]&lt;br /&gt;
&lt;br /&gt;
== Files modified in current project ==&lt;br /&gt;
&lt;br /&gt;
'''''1. Fixing Average problem and adding Rubric feature  :'''''&lt;br /&gt;
&lt;br /&gt;
The following files were modified for fixing the average rating bug and adding rubric for the same.&lt;br /&gt;
&lt;br /&gt;
app/models/bookmark_rating_response_map.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmark_rating_questionnaire_controller.rb &lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmarks_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/response_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/views/assignments/edit/_rubrics.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/bookmark_rating.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/list.html.erb&lt;br /&gt;
   &lt;br /&gt;
app/views/response/view.html.erb&lt;br /&gt;
&lt;br /&gt;
config/routes.rb  &lt;br /&gt;
&lt;br /&gt;
'''''2. Tests for Model and Controller :'''''&lt;br /&gt;
&lt;br /&gt;
spec/controllers/bookmarks_controller_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/models/bookmark_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/factories/factories.rb&lt;br /&gt;
&lt;br /&gt;
== Automated &amp;amp; UI Testing ==&lt;br /&gt;
&lt;br /&gt;
Automated RSpec tests were added to ensure the bookmarks are valid. Separate tests were written for the Bookmark Model and BookmarkRating Controller files. &lt;br /&gt;
The videos of the tests are uploaded onto YouTube and the links are provided in the references section.&lt;br /&gt;
&lt;br /&gt;
'''a) Back button for the page &amp;quot;View Bookmark&amp;quot; and &amp;quot;Create Bookmark&amp;quot; was resolved.'''&lt;br /&gt;
&lt;br /&gt;
1. Login with the credentials to expertiza.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'My assignments' and select OSS Project/writeup.&lt;br /&gt;
&lt;br /&gt;
3. Select 'Signup sheet'.&lt;br /&gt;
&lt;br /&gt;
4. Many titles for projects are shown. Select a title and choose either 'View Bookmark' or 'Add Bookmark' button&lt;br /&gt;
&lt;br /&gt;
5. If you  choose 'View Bookmark', after viewing, press the back button to go back to Signup sheet.&lt;br /&gt;
&lt;br /&gt;
6. You will land up in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
7. If you choose 'Add Bookmark', you can add by giving Bookmark details and save it.&lt;br /&gt;
&lt;br /&gt;
8. Now press back button.&lt;br /&gt;
&lt;br /&gt;
9. You will land in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''b) Adding Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Questionnaires'&lt;br /&gt;
&lt;br /&gt;
3. Select new public/private item under BookmarkRating&lt;br /&gt;
&lt;br /&gt;
4. Fill in with required values and create it.&lt;br /&gt;
&lt;br /&gt;
5. After this if you go to bookmark rubric option it should be visible &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Allowing Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Assignments'&lt;br /&gt;
&lt;br /&gt;
3. Select the appropriate project&lt;br /&gt;
&lt;br /&gt;
4. Now edit the project.&lt;br /&gt;
&lt;br /&gt;
5. Check the box &amp;quot;Allow participants to create bookmarks?&amp;quot; under Topics tab if not done already.&lt;br /&gt;
&lt;br /&gt;
6. Choose the appropriate rubric from the list or create one following steps from above.&lt;br /&gt;
&lt;br /&gt;
7. Now under Rubrics tab choose the &amp;quot;Scale&amp;quot; option for Scored-question display style.&lt;br /&gt;
&lt;br /&gt;
== Future Work ==&lt;br /&gt;
&lt;br /&gt;
1. A reviewer can be recognized or credited if he added useful bookmarks i.e if the author has made use of the bookmark.&lt;br /&gt;
&lt;br /&gt;
2. A function to add badges automatically if a participant had submitted more than threshold number of useful bookmarks.&lt;br /&gt;
&lt;br /&gt;
3. The UI is basic and it can be further improved.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&lt;br /&gt;
1. Expertiza on Github : https://github.com/rahuliyer95/expertiza &lt;br /&gt;
&lt;br /&gt;
2. Videos on YouTube : https://youtu.be/F95FA9Iam0s, https://youtu.be/tPpowgNRINk&lt;br /&gt;
&lt;br /&gt;
3. Pull Request : https://github.com/expertiza/expertiza/pull/1266&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:Bookmark_review_rubric.png&amp;diff=118306</id>
		<title>File:Bookmark review rubric.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:Bookmark_review_rubric.png&amp;diff=118306"/>
		<updated>2018-11-02T23:02:06Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118305</id>
		<title>E1830 OSS Project Juniper: Bookmark enhancements</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118305"/>
		<updated>2018-11-02T23:01:43Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Issues */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;'''Peer Review Information'''&lt;br /&gt;
&lt;br /&gt;
For users intending to view the Expertiza Bookmark enhancement associated with this assignment, the credentials are below:&lt;br /&gt;
&lt;br /&gt;
Instructor login: username -&amp;gt; instructor6, password -&amp;gt; password&lt;br /&gt;
&lt;br /&gt;
'''&lt;br /&gt;
== Introduction ==&lt;br /&gt;
'''&lt;br /&gt;
&lt;br /&gt;
'''Expertiza Background'''&lt;br /&gt;
&lt;br /&gt;
Expertiza is an open-source educational web application developed on Ruby on Rails platform. Students and Instructors (including TA's) use this application though their credentials. Instructors can add new projects, assignments etc as well edit the previous ones and at a later stage can see the student submission and grade them. They can even put a time limit (deadline) for submitting the assignment. Students can form teams for the projects, submit their work through handles (Wiki page, link to a video etc). Students can even review their teammates and other peers, as well give them any suggestions if required.&lt;br /&gt;
&lt;br /&gt;
GitHub hooks to Expertiza to encourage contributors. Expertiza project is supported by National Science Foundation.&lt;br /&gt;
&lt;br /&gt;
'''Description of the current project'''&lt;br /&gt;
&lt;br /&gt;
This project is intended to make Bookmarks more user-friendly, credible and valid. Bookmarks in expertiza are created by reviewers and can be used by authors for their work on any project. On each line of the signup sheet are two icons, one for adding a bookmark to the topic, and another for viewing bookmarks on the topic. If the instructor allows the participants to create bookmarks, then only a participant has access to create and view them. He should be able to create a new Bookmark only if he enters a valid one.&lt;br /&gt;
&lt;br /&gt;
Now a new rubric is added for reviewing the bookmarks added to a topic and this is accessible only to members belonging to the topic. Therefore ratings can be now done via a drop-down or rubric.&lt;br /&gt;
&lt;br /&gt;
== Issues ==&lt;br /&gt;
&lt;br /&gt;
'''Problem 1'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
When a user after logging into expertiza goes to 'Create New Bookmark page&amp;quot; or &amp;quot;View existing bookmarks page&amp;quot;, he's not able to go back to Sign-up sheet using &amp;quot;back&amp;quot; button.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:back.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Solution :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:fixed_back_link.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Problem 2'''&lt;br /&gt;
&lt;br /&gt;
Bookmarks had only one option while reviewing and it was to use a drop down to give a score. Also the average rating metric had a bug and hence showed wrong values even when bookmark was not reviewed. The bug was fixed and the rubric feature was adding a new controller.&lt;br /&gt;
&lt;br /&gt;
Now choosing &amp;quot;Scale&amp;quot; Option instead of &amp;quot;Dropdown&amp;quot; allows one to use a rubric instead.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:scale.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric for rating the bookmark shows up as a link that looks as follows :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:begin_review.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric looks like :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:bookmark_review_rubric.png]]&lt;br /&gt;
&lt;br /&gt;
== Files modified in current project ==&lt;br /&gt;
&lt;br /&gt;
'''''1. Fixing Average problem and adding Rubric feature  :'''''&lt;br /&gt;
&lt;br /&gt;
The following files were modified for fixing the average rating bug and adding rubric for the same.&lt;br /&gt;
&lt;br /&gt;
app/models/bookmark_rating_response_map.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmark_rating_questionnaire_controller.rb &lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmarks_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/response_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/views/assignments/edit/_rubrics.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/bookmark_rating.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/list.html.erb&lt;br /&gt;
   &lt;br /&gt;
app/views/response/view.html.erb&lt;br /&gt;
&lt;br /&gt;
config/routes.rb  &lt;br /&gt;
&lt;br /&gt;
'''''2. Tests for Model and Controller :'''''&lt;br /&gt;
&lt;br /&gt;
spec/controllers/bookmarks_controller_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/models/bookmark_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/factories/factories.rb&lt;br /&gt;
&lt;br /&gt;
== Automated &amp;amp; UI Testing ==&lt;br /&gt;
&lt;br /&gt;
Automated RSpec tests were added to ensure the bookmarks are valid. Separate tests were written for the Bookmark Model and BookmarkRating Controller files. &lt;br /&gt;
The videos of the tests are uploaded onto YouTube and the links are provided in the references section.&lt;br /&gt;
&lt;br /&gt;
'''a) Back button for the page &amp;quot;View Bookmark&amp;quot; and &amp;quot;Create Bookmark&amp;quot; was resolved.'''&lt;br /&gt;
&lt;br /&gt;
1. Login with the credentials to expertiza.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'My assignments' and select OSS Project/writeup.&lt;br /&gt;
&lt;br /&gt;
3. Select 'Signup sheet'.&lt;br /&gt;
&lt;br /&gt;
4. Many titles for projects are shown. Select a title and choose either 'View Bookmark' or 'Add Bookmark' button&lt;br /&gt;
&lt;br /&gt;
5. If you  choose 'View Bookmark', after viewing, press the back button to go back to Signup sheet.&lt;br /&gt;
&lt;br /&gt;
6. You will land up in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
7. If you choose 'Add Bookmark', you can add by giving Bookmark details and save it.&lt;br /&gt;
&lt;br /&gt;
8. Now press back button.&lt;br /&gt;
&lt;br /&gt;
9. You will land in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''b) Adding Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Questionnaires'&lt;br /&gt;
&lt;br /&gt;
3. Select new public/private item under BookmarkRating&lt;br /&gt;
&lt;br /&gt;
4. Fill in with required values and create it.&lt;br /&gt;
&lt;br /&gt;
5. After this if you go to bookmark rubric option it should be visible &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Allowing Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Assignments'&lt;br /&gt;
&lt;br /&gt;
3. Select the appropriate project&lt;br /&gt;
&lt;br /&gt;
4. Now edit the project.&lt;br /&gt;
&lt;br /&gt;
5. Check the box &amp;quot;Allow participants to create bookmarks?&amp;quot; under Topics tab if not done already.&lt;br /&gt;
&lt;br /&gt;
6. Choose the appropriate rubric from the list or create one following steps from above.&lt;br /&gt;
&lt;br /&gt;
7. Now under Rubrics tab choose the &amp;quot;Scale&amp;quot; option for Scored-question display style.&lt;br /&gt;
&lt;br /&gt;
== Future Work ==&lt;br /&gt;
&lt;br /&gt;
1. A reviewer can be recognized or credited if he added useful bookmarks i.e if the author has made use of the bookmark.&lt;br /&gt;
&lt;br /&gt;
2. A function to add badges automatically if a participant had submitted more than threshold number of useful bookmarks.&lt;br /&gt;
&lt;br /&gt;
3. The UI is basic and it can be further improved.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&lt;br /&gt;
1. Expertiza on Github : https://github.com/rahuliyer95/expertiza &lt;br /&gt;
&lt;br /&gt;
2. Videos on YouTube : https://youtu.be/F95FA9Iam0s, https://youtu.be/tPpowgNRINk&lt;br /&gt;
&lt;br /&gt;
3. Pull Request : https://github.com/expertiza/expertiza/pull/1266&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118304</id>
		<title>E1830 OSS Project Juniper: Bookmark enhancements</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118304"/>
		<updated>2018-11-02T22:59:38Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Introduction */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;'''Peer Review Information'''&lt;br /&gt;
&lt;br /&gt;
For users intending to view the Expertiza Bookmark enhancement associated with this assignment, the credentials are below:&lt;br /&gt;
&lt;br /&gt;
Instructor login: username -&amp;gt; instructor6, password -&amp;gt; password&lt;br /&gt;
&lt;br /&gt;
'''&lt;br /&gt;
== Introduction ==&lt;br /&gt;
'''&lt;br /&gt;
&lt;br /&gt;
'''Expertiza Background'''&lt;br /&gt;
&lt;br /&gt;
Expertiza is an open-source educational web application developed on Ruby on Rails platform. Students and Instructors (including TA's) use this application though their credentials. Instructors can add new projects, assignments etc as well edit the previous ones and at a later stage can see the student submission and grade them. They can even put a time limit (deadline) for submitting the assignment. Students can form teams for the projects, submit their work through handles (Wiki page, link to a video etc). Students can even review their teammates and other peers, as well give them any suggestions if required.&lt;br /&gt;
&lt;br /&gt;
GitHub hooks to Expertiza to encourage contributors. Expertiza project is supported by National Science Foundation.&lt;br /&gt;
&lt;br /&gt;
'''Description of the current project'''&lt;br /&gt;
&lt;br /&gt;
This project is intended to make Bookmarks more user-friendly, credible and valid. Bookmarks in expertiza are created by reviewers and can be used by authors for their work on any project. On each line of the signup sheet are two icons, one for adding a bookmark to the topic, and another for viewing bookmarks on the topic. If the instructor allows the participants to create bookmarks, then only a participant has access to create and view them. He should be able to create a new Bookmark only if he enters a valid one.&lt;br /&gt;
&lt;br /&gt;
Now a new rubric is added for reviewing the bookmarks added to a topic and this is accessible only to members belonging to the topic. Therefore ratings can be now done via a drop-down or rubric.&lt;br /&gt;
&lt;br /&gt;
== Issues ==&lt;br /&gt;
&lt;br /&gt;
'''Problem 1'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
When a user after logging into expertiza goes to 'Create New Bookmark page&amp;quot; or &amp;quot;View existing bookmarks page&amp;quot;, he's not able to go back to Sign-up sheet using &amp;quot;back&amp;quot; button.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:back.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Solution :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:fixed_back_link.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Problem 2'''&lt;br /&gt;
&lt;br /&gt;
Bookmarks had only one option while reviewing and it was to use a drop down to give a score. Also the average rating metric had a bug and hence showed wrong values even when bookmark was not reviewed. The bug was fixed and the rubric feature was adding a new controller.&lt;br /&gt;
&lt;br /&gt;
Now choosing &amp;quot;Scale&amp;quot; Option instead of &amp;quot;Dropdown&amp;quot; allows one to use a rubric instead.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:scale.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric for rating the bookmark looks as follows :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:begin_review.png]]&lt;br /&gt;
&lt;br /&gt;
== Files modified in current project ==&lt;br /&gt;
&lt;br /&gt;
'''''1. Fixing Average problem and adding Rubric feature  :'''''&lt;br /&gt;
&lt;br /&gt;
The following files were modified for fixing the average rating bug and adding rubric for the same.&lt;br /&gt;
&lt;br /&gt;
app/models/bookmark_rating_response_map.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmark_rating_questionnaire_controller.rb &lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmarks_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/response_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/views/assignments/edit/_rubrics.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/bookmark_rating.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/list.html.erb&lt;br /&gt;
   &lt;br /&gt;
app/views/response/view.html.erb&lt;br /&gt;
&lt;br /&gt;
config/routes.rb  &lt;br /&gt;
&lt;br /&gt;
'''''2. Tests for Model and Controller :'''''&lt;br /&gt;
&lt;br /&gt;
spec/controllers/bookmarks_controller_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/models/bookmark_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/factories/factories.rb&lt;br /&gt;
&lt;br /&gt;
== Automated &amp;amp; UI Testing ==&lt;br /&gt;
&lt;br /&gt;
Automated RSpec tests were added to ensure the bookmarks are valid. Separate tests were written for the Bookmark Model and BookmarkRating Controller files. &lt;br /&gt;
The videos of the tests are uploaded onto YouTube and the links are provided in the references section.&lt;br /&gt;
&lt;br /&gt;
'''a) Back button for the page &amp;quot;View Bookmark&amp;quot; and &amp;quot;Create Bookmark&amp;quot; was resolved.'''&lt;br /&gt;
&lt;br /&gt;
1. Login with the credentials to expertiza.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'My assignments' and select OSS Project/writeup.&lt;br /&gt;
&lt;br /&gt;
3. Select 'Signup sheet'.&lt;br /&gt;
&lt;br /&gt;
4. Many titles for projects are shown. Select a title and choose either 'View Bookmark' or 'Add Bookmark' button&lt;br /&gt;
&lt;br /&gt;
5. If you  choose 'View Bookmark', after viewing, press the back button to go back to Signup sheet.&lt;br /&gt;
&lt;br /&gt;
6. You will land up in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
7. If you choose 'Add Bookmark', you can add by giving Bookmark details and save it.&lt;br /&gt;
&lt;br /&gt;
8. Now press back button.&lt;br /&gt;
&lt;br /&gt;
9. You will land in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''b) Adding Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Questionnaires'&lt;br /&gt;
&lt;br /&gt;
3. Select new public/private item under BookmarkRating&lt;br /&gt;
&lt;br /&gt;
4. Fill in with required values and create it.&lt;br /&gt;
&lt;br /&gt;
5. After this if you go to bookmark rubric option it should be visible &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Allowing Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Assignments'&lt;br /&gt;
&lt;br /&gt;
3. Select the appropriate project&lt;br /&gt;
&lt;br /&gt;
4. Now edit the project.&lt;br /&gt;
&lt;br /&gt;
5. Check the box &amp;quot;Allow participants to create bookmarks?&amp;quot; under Topics tab if not done already.&lt;br /&gt;
&lt;br /&gt;
6. Choose the appropriate rubric from the list or create one following steps from above.&lt;br /&gt;
&lt;br /&gt;
7. Now under Rubrics tab choose the &amp;quot;Scale&amp;quot; option for Scored-question display style.&lt;br /&gt;
&lt;br /&gt;
== Future Work ==&lt;br /&gt;
&lt;br /&gt;
1. A reviewer can be recognized or credited if he added useful bookmarks i.e if the author has made use of the bookmark.&lt;br /&gt;
&lt;br /&gt;
2. A function to add badges automatically if a participant had submitted more than threshold number of useful bookmarks.&lt;br /&gt;
&lt;br /&gt;
3. The UI is basic and it can be further improved.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&lt;br /&gt;
1. Expertiza on Github : https://github.com/rahuliyer95/expertiza &lt;br /&gt;
&lt;br /&gt;
2. Videos on YouTube : https://youtu.be/F95FA9Iam0s, https://youtu.be/tPpowgNRINk&lt;br /&gt;
&lt;br /&gt;
3. Pull Request : https://github.com/expertiza/expertiza/pull/1266&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118300</id>
		<title>E1830 OSS Project Juniper: Bookmark enhancements</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118300"/>
		<updated>2018-11-02T22:55:45Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Automated &amp;amp; UI Testing */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;'''Peer Review Information'''&lt;br /&gt;
&lt;br /&gt;
For users intending to view the Expertiza Bookmark enhancement associated with this assignment, the credentials are below:&lt;br /&gt;
&lt;br /&gt;
Instructor login: username -&amp;gt; instructor6, password -&amp;gt; password&lt;br /&gt;
&lt;br /&gt;
'''&lt;br /&gt;
== Introduction ==&lt;br /&gt;
'''&lt;br /&gt;
&lt;br /&gt;
'''Expertiza Background'''&lt;br /&gt;
&lt;br /&gt;
Expertiza is an open-source educational web application developed on Ruby on Rails platform. Students and Instructors (including TA's) use this application though their credentials. Instructors can add new projects, assignments etc as well edit the previous ones and at a later stage can see the student submission and grade them. They can even put a time limit (deadline) for submitting the assignment. Students can form teams for the projects, submit their work through handles (Wiki page, link to a video etc). Students can even review their teammates and other peers, as well give them any suggestions if required.&lt;br /&gt;
&lt;br /&gt;
GitHub hooks to Expertiza to encourage contributors. Expertiza project is supported by National Science Foundation.&lt;br /&gt;
&lt;br /&gt;
'''Description of the current project'''&lt;br /&gt;
&lt;br /&gt;
This project is intended to make Bookmarks more user-friendly, credible and valid. Bookmarks in expertiza are created by reviewers and can be used by authors for their work on any project. On each line of the signup sheet are two icons, one for adding a bookmark to the topic, and another for viewing bookmarks on the topic. If the instructor allows the participants to create bookmarks, then only a participant has access to create and view them. He should be able to create a new Bookmark only if he enters a valid one.&lt;br /&gt;
&lt;br /&gt;
Now a new rubric is added for reviewing the bookmarks added to a topic and is accessible only to members belonging to the topic. &lt;br /&gt;
Tests are written to ensure validity of the bookmark feature.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Issues ==&lt;br /&gt;
&lt;br /&gt;
'''Problem 1'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
When a user after logging into expertiza goes to 'Create New Bookmark page&amp;quot; or &amp;quot;View existing bookmarks page&amp;quot;, he's not able to go back to Sign-up sheet using &amp;quot;back&amp;quot; button.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:back.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Solution :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:fixed_back_link.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Problem 2'''&lt;br /&gt;
&lt;br /&gt;
Bookmarks had only one option while reviewing and it was to use a drop down to give a score. Also the average rating metric had a bug and hence showed wrong values even when bookmark was not reviewed. The bug was fixed and the rubric feature was adding a new controller.&lt;br /&gt;
&lt;br /&gt;
Now choosing &amp;quot;Scale&amp;quot; Option instead of &amp;quot;Dropdown&amp;quot; allows one to use a rubric instead.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:scale.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric for rating the bookmark looks as follows :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:begin_review.png]]&lt;br /&gt;
&lt;br /&gt;
== Files modified in current project ==&lt;br /&gt;
&lt;br /&gt;
'''''1. Fixing Average problem and adding Rubric feature  :'''''&lt;br /&gt;
&lt;br /&gt;
The following files were modified for fixing the average rating bug and adding rubric for the same.&lt;br /&gt;
&lt;br /&gt;
app/models/bookmark_rating_response_map.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmark_rating_questionnaire_controller.rb &lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmarks_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/response_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/views/assignments/edit/_rubrics.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/bookmark_rating.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/list.html.erb&lt;br /&gt;
   &lt;br /&gt;
app/views/response/view.html.erb&lt;br /&gt;
&lt;br /&gt;
config/routes.rb  &lt;br /&gt;
&lt;br /&gt;
'''''2. Tests for Model and Controller :'''''&lt;br /&gt;
&lt;br /&gt;
spec/controllers/bookmarks_controller_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/models/bookmark_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/factories/factories.rb&lt;br /&gt;
&lt;br /&gt;
== Automated &amp;amp; UI Testing ==&lt;br /&gt;
&lt;br /&gt;
Automated RSpec tests were added to ensure the bookmarks are valid. Separate tests were written for the Bookmark Model and BookmarkRating Controller files. &lt;br /&gt;
The videos of the tests are uploaded onto YouTube and the links are provided in the references section.&lt;br /&gt;
&lt;br /&gt;
'''a) Back button for the page &amp;quot;View Bookmark&amp;quot; and &amp;quot;Create Bookmark&amp;quot; was resolved.'''&lt;br /&gt;
&lt;br /&gt;
1. Login with the credentials to expertiza.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'My assignments' and select OSS Project/writeup.&lt;br /&gt;
&lt;br /&gt;
3. Select 'Signup sheet'.&lt;br /&gt;
&lt;br /&gt;
4. Many titles for projects are shown. Select a title and choose either 'View Bookmark' or 'Add Bookmark' button&lt;br /&gt;
&lt;br /&gt;
5. If you  choose 'View Bookmark', after viewing, press the back button to go back to Signup sheet.&lt;br /&gt;
&lt;br /&gt;
6. You will land up in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
7. If you choose 'Add Bookmark', you can add by giving Bookmark details and save it.&lt;br /&gt;
&lt;br /&gt;
8. Now press back button.&lt;br /&gt;
&lt;br /&gt;
9. You will land in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''b) Adding Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Questionnaires'&lt;br /&gt;
&lt;br /&gt;
3. Select new public/private item under BookmarkRating&lt;br /&gt;
&lt;br /&gt;
4. Fill in with required values and create it.&lt;br /&gt;
&lt;br /&gt;
5. After this if you go to bookmark rubric option it should be visible &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Allowing Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Assignments'&lt;br /&gt;
&lt;br /&gt;
3. Select the appropriate project&lt;br /&gt;
&lt;br /&gt;
4. Now edit the project.&lt;br /&gt;
&lt;br /&gt;
5. Check the box &amp;quot;Allow participants to create bookmarks?&amp;quot; under Topics tab if not done already.&lt;br /&gt;
&lt;br /&gt;
6. Choose the appropriate rubric from the list or create one following steps from above.&lt;br /&gt;
&lt;br /&gt;
7. Now under Rubrics tab choose the &amp;quot;Scale&amp;quot; option for Scored-question display style.&lt;br /&gt;
&lt;br /&gt;
== Future Work ==&lt;br /&gt;
&lt;br /&gt;
1. A reviewer can be recognized or credited if he added useful bookmarks i.e if the author has made use of the bookmark.&lt;br /&gt;
&lt;br /&gt;
2. A function to add badges automatically if a participant had submitted more than threshold number of useful bookmarks.&lt;br /&gt;
&lt;br /&gt;
3. The UI is basic and it can be further improved.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&lt;br /&gt;
1. Expertiza on Github : https://github.com/rahuliyer95/expertiza &lt;br /&gt;
&lt;br /&gt;
2. Videos on YouTube : https://youtu.be/F95FA9Iam0s, https://youtu.be/tPpowgNRINk&lt;br /&gt;
&lt;br /&gt;
3. Pull Request : https://github.com/expertiza/expertiza/pull/1266&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118299</id>
		<title>E1830 OSS Project Juniper: Bookmark enhancements</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118299"/>
		<updated>2018-11-02T22:55:00Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* References */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;'''Peer Review Information'''&lt;br /&gt;
&lt;br /&gt;
For users intending to view the Expertiza Bookmark enhancement associated with this assignment, the credentials are below:&lt;br /&gt;
&lt;br /&gt;
Instructor login: username -&amp;gt; instructor6, password -&amp;gt; password&lt;br /&gt;
&lt;br /&gt;
'''&lt;br /&gt;
== Introduction ==&lt;br /&gt;
'''&lt;br /&gt;
&lt;br /&gt;
'''Expertiza Background'''&lt;br /&gt;
&lt;br /&gt;
Expertiza is an open-source educational web application developed on Ruby on Rails platform. Students and Instructors (including TA's) use this application though their credentials. Instructors can add new projects, assignments etc as well edit the previous ones and at a later stage can see the student submission and grade them. They can even put a time limit (deadline) for submitting the assignment. Students can form teams for the projects, submit their work through handles (Wiki page, link to a video etc). Students can even review their teammates and other peers, as well give them any suggestions if required.&lt;br /&gt;
&lt;br /&gt;
GitHub hooks to Expertiza to encourage contributors. Expertiza project is supported by National Science Foundation.&lt;br /&gt;
&lt;br /&gt;
'''Description of the current project'''&lt;br /&gt;
&lt;br /&gt;
This project is intended to make Bookmarks more user-friendly, credible and valid. Bookmarks in expertiza are created by reviewers and can be used by authors for their work on any project. On each line of the signup sheet are two icons, one for adding a bookmark to the topic, and another for viewing bookmarks on the topic. If the instructor allows the participants to create bookmarks, then only a participant has access to create and view them. He should be able to create a new Bookmark only if he enters a valid one.&lt;br /&gt;
&lt;br /&gt;
Now a new rubric is added for reviewing the bookmarks added to a topic and is accessible only to members belonging to the topic. &lt;br /&gt;
Tests are written to ensure validity of the bookmark feature.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Issues ==&lt;br /&gt;
&lt;br /&gt;
'''Problem 1'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
When a user after logging into expertiza goes to 'Create New Bookmark page&amp;quot; or &amp;quot;View existing bookmarks page&amp;quot;, he's not able to go back to Sign-up sheet using &amp;quot;back&amp;quot; button.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:back.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Solution :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:fixed_back_link.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Problem 2'''&lt;br /&gt;
&lt;br /&gt;
Bookmarks had only one option while reviewing and it was to use a drop down to give a score. Also the average rating metric had a bug and hence showed wrong values even when bookmark was not reviewed. The bug was fixed and the rubric feature was adding a new controller.&lt;br /&gt;
&lt;br /&gt;
Now choosing &amp;quot;Scale&amp;quot; Option instead of &amp;quot;Dropdown&amp;quot; allows one to use a rubric instead.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:scale.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric for rating the bookmark looks as follows :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:begin_review.png]]&lt;br /&gt;
&lt;br /&gt;
== Files modified in current project ==&lt;br /&gt;
&lt;br /&gt;
'''''1. Fixing Average problem and adding Rubric feature  :'''''&lt;br /&gt;
&lt;br /&gt;
The following files were modified for fixing the average rating bug and adding rubric for the same.&lt;br /&gt;
&lt;br /&gt;
app/models/bookmark_rating_response_map.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmark_rating_questionnaire_controller.rb &lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmarks_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/response_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/views/assignments/edit/_rubrics.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/bookmark_rating.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/list.html.erb&lt;br /&gt;
   &lt;br /&gt;
app/views/response/view.html.erb&lt;br /&gt;
&lt;br /&gt;
config/routes.rb  &lt;br /&gt;
&lt;br /&gt;
'''''2. Tests for Model and Controller :'''''&lt;br /&gt;
&lt;br /&gt;
spec/controllers/bookmarks_controller_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/models/bookmark_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/factories/factories.rb&lt;br /&gt;
&lt;br /&gt;
== Automated &amp;amp; UI Testing ==&lt;br /&gt;
&lt;br /&gt;
Automated RSpec tests were added to ensure the bookmarks are valid. Separate tests were written for the Bookmark Model and BookmarkRating Controller files. &lt;br /&gt;
The videos of the tests are uploaded onto YouTube and the links are provided in the references section.&lt;br /&gt;
&lt;br /&gt;
'''a) Back button for the page &amp;quot;View Bookmark&amp;quot; and &amp;quot;Create Bookmark&amp;quot; was resolved.'''&lt;br /&gt;
&lt;br /&gt;
1. Login with the credentials to expertiza.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'My assignments' and select OSS Project/writeup.&lt;br /&gt;
&lt;br /&gt;
3. Select 'Signup sheet'.&lt;br /&gt;
&lt;br /&gt;
4. Many titles for projects are shown. Select a title and choose either 'View Bookmark' or 'Add Bookmark' button&lt;br /&gt;
&lt;br /&gt;
5. If you  choose 'View Bookmark', after viewing, press the back button to go back to Signup sheet.&lt;br /&gt;
&lt;br /&gt;
6. You will land up in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
7. If you choose 'Add Bookmark', you can add by giving Bookmark details and save it.&lt;br /&gt;
&lt;br /&gt;
8. Now press back button.&lt;br /&gt;
&lt;br /&gt;
9. You will land in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Adding Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Questionnaires'&lt;br /&gt;
&lt;br /&gt;
3. Select new public/private item under BookmarkRating&lt;br /&gt;
&lt;br /&gt;
4. Fill in with required values and create it.&lt;br /&gt;
&lt;br /&gt;
5. After this if you go to bookmark rubric option it should be visible &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Allowing Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Assignments'&lt;br /&gt;
&lt;br /&gt;
3. Select the appropriate project&lt;br /&gt;
&lt;br /&gt;
4. Now edit the project.&lt;br /&gt;
&lt;br /&gt;
5. Check the box &amp;quot;Allow participants to create bookmarks?&amp;quot; under Topics tab if not done already.&lt;br /&gt;
&lt;br /&gt;
6. Choose the appropriate rubric from the list or create one following steps from above.&lt;br /&gt;
&lt;br /&gt;
7. Now under Rubrics tab choose the &amp;quot;Scale&amp;quot; option for Scored-question display style.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Future Work ==&lt;br /&gt;
&lt;br /&gt;
1. A reviewer can be recognized or credited if he added useful bookmarks i.e if the author has made use of the bookmark.&lt;br /&gt;
&lt;br /&gt;
2. A function to add badges automatically if a participant had submitted more than threshold number of useful bookmarks.&lt;br /&gt;
&lt;br /&gt;
3. The UI is basic and it can be further improved.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&lt;br /&gt;
1. Expertiza on Github : https://github.com/rahuliyer95/expertiza &lt;br /&gt;
&lt;br /&gt;
2. Videos on YouTube : https://youtu.be/F95FA9Iam0s, https://youtu.be/tPpowgNRINk&lt;br /&gt;
&lt;br /&gt;
3. Pull Request : https://github.com/expertiza/expertiza/pull/1266&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118296</id>
		<title>E1830 OSS Project Juniper: Bookmark enhancements</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118296"/>
		<updated>2018-11-02T22:54:17Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Files modified in current project */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;'''Peer Review Information'''&lt;br /&gt;
&lt;br /&gt;
For users intending to view the Expertiza Bookmark enhancement associated with this assignment, the credentials are below:&lt;br /&gt;
&lt;br /&gt;
Instructor login: username -&amp;gt; instructor6, password -&amp;gt; password&lt;br /&gt;
&lt;br /&gt;
'''&lt;br /&gt;
== Introduction ==&lt;br /&gt;
'''&lt;br /&gt;
&lt;br /&gt;
'''Expertiza Background'''&lt;br /&gt;
&lt;br /&gt;
Expertiza is an open-source educational web application developed on Ruby on Rails platform. Students and Instructors (including TA's) use this application though their credentials. Instructors can add new projects, assignments etc as well edit the previous ones and at a later stage can see the student submission and grade them. They can even put a time limit (deadline) for submitting the assignment. Students can form teams for the projects, submit their work through handles (Wiki page, link to a video etc). Students can even review their teammates and other peers, as well give them any suggestions if required.&lt;br /&gt;
&lt;br /&gt;
GitHub hooks to Expertiza to encourage contributors. Expertiza project is supported by National Science Foundation.&lt;br /&gt;
&lt;br /&gt;
'''Description of the current project'''&lt;br /&gt;
&lt;br /&gt;
This project is intended to make Bookmarks more user-friendly, credible and valid. Bookmarks in expertiza are created by reviewers and can be used by authors for their work on any project. On each line of the signup sheet are two icons, one for adding a bookmark to the topic, and another for viewing bookmarks on the topic. If the instructor allows the participants to create bookmarks, then only a participant has access to create and view them. He should be able to create a new Bookmark only if he enters a valid one.&lt;br /&gt;
&lt;br /&gt;
Now a new rubric is added for reviewing the bookmarks added to a topic and is accessible only to members belonging to the topic. &lt;br /&gt;
Tests are written to ensure validity of the bookmark feature.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Issues ==&lt;br /&gt;
&lt;br /&gt;
'''Problem 1'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
When a user after logging into expertiza goes to 'Create New Bookmark page&amp;quot; or &amp;quot;View existing bookmarks page&amp;quot;, he's not able to go back to Sign-up sheet using &amp;quot;back&amp;quot; button.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:back.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Solution :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:fixed_back_link.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Problem 2'''&lt;br /&gt;
&lt;br /&gt;
Bookmarks had only one option while reviewing and it was to use a drop down to give a score. Also the average rating metric had a bug and hence showed wrong values even when bookmark was not reviewed. The bug was fixed and the rubric feature was adding a new controller.&lt;br /&gt;
&lt;br /&gt;
Now choosing &amp;quot;Scale&amp;quot; Option instead of &amp;quot;Dropdown&amp;quot; allows one to use a rubric instead.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:scale.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric for rating the bookmark looks as follows :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:begin_review.png]]&lt;br /&gt;
&lt;br /&gt;
== Files modified in current project ==&lt;br /&gt;
&lt;br /&gt;
'''''1. Fixing Average problem and adding Rubric feature  :'''''&lt;br /&gt;
&lt;br /&gt;
The following files were modified for fixing the average rating bug and adding rubric for the same.&lt;br /&gt;
&lt;br /&gt;
app/models/bookmark_rating_response_map.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmark_rating_questionnaire_controller.rb &lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmarks_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/response_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/views/assignments/edit/_rubrics.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/bookmark_rating.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/list.html.erb&lt;br /&gt;
   &lt;br /&gt;
app/views/response/view.html.erb&lt;br /&gt;
&lt;br /&gt;
config/routes.rb  &lt;br /&gt;
&lt;br /&gt;
'''''2. Tests for Model and Controller :'''''&lt;br /&gt;
&lt;br /&gt;
spec/controllers/bookmarks_controller_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/models/bookmark_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/factories/factories.rb&lt;br /&gt;
&lt;br /&gt;
== Automated &amp;amp; UI Testing ==&lt;br /&gt;
&lt;br /&gt;
Automated RSpec tests were added to ensure the bookmarks are valid. Separate tests were written for the Bookmark Model and BookmarkRating Controller files. &lt;br /&gt;
The videos of the tests are uploaded onto YouTube and the links are provided in the references section.&lt;br /&gt;
&lt;br /&gt;
'''a) Back button for the page &amp;quot;View Bookmark&amp;quot; and &amp;quot;Create Bookmark&amp;quot; was resolved.'''&lt;br /&gt;
&lt;br /&gt;
1. Login with the credentials to expertiza.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'My assignments' and select OSS Project/writeup.&lt;br /&gt;
&lt;br /&gt;
3. Select 'Signup sheet'.&lt;br /&gt;
&lt;br /&gt;
4. Many titles for projects are shown. Select a title and choose either 'View Bookmark' or 'Add Bookmark' button&lt;br /&gt;
&lt;br /&gt;
5. If you  choose 'View Bookmark', after viewing, press the back button to go back to Signup sheet.&lt;br /&gt;
&lt;br /&gt;
6. You will land up in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
7. If you choose 'Add Bookmark', you can add by giving Bookmark details and save it.&lt;br /&gt;
&lt;br /&gt;
8. Now press back button.&lt;br /&gt;
&lt;br /&gt;
9. You will land in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Adding Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Questionnaires'&lt;br /&gt;
&lt;br /&gt;
3. Select new public/private item under BookmarkRating&lt;br /&gt;
&lt;br /&gt;
4. Fill in with required values and create it.&lt;br /&gt;
&lt;br /&gt;
5. After this if you go to bookmark rubric option it should be visible &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Allowing Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Assignments'&lt;br /&gt;
&lt;br /&gt;
3. Select the appropriate project&lt;br /&gt;
&lt;br /&gt;
4. Now edit the project.&lt;br /&gt;
&lt;br /&gt;
5. Check the box &amp;quot;Allow participants to create bookmarks?&amp;quot; under Topics tab if not done already.&lt;br /&gt;
&lt;br /&gt;
6. Choose the appropriate rubric from the list or create one following steps from above.&lt;br /&gt;
&lt;br /&gt;
7. Now under Rubrics tab choose the &amp;quot;Scale&amp;quot; option for Scored-question display style.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Future Work ==&lt;br /&gt;
&lt;br /&gt;
1. A reviewer can be recognized or credited if he added useful bookmarks i.e if the author has made use of the bookmark.&lt;br /&gt;
&lt;br /&gt;
2. A function to add badges automatically if a participant had submitted more than threshold number of useful bookmarks.&lt;br /&gt;
&lt;br /&gt;
3. The UI is basic and it can be further improved.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&lt;br /&gt;
1. Expertiza on Github : https://github.com/rahuliyer95/expertiza &lt;br /&gt;
&lt;br /&gt;
2. Videos on youtube : https://youtu.be/F95FA9Iam0s, https://youtu.be/tPpowgNRINk&lt;br /&gt;
&lt;br /&gt;
2. Pull Request : https://github.com/expertiza/expertiza/pull/1266&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118295</id>
		<title>E1830 OSS Project Juniper: Bookmark enhancements</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118295"/>
		<updated>2018-11-02T22:54:01Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Files modified in current project */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;'''Peer Review Information'''&lt;br /&gt;
&lt;br /&gt;
For users intending to view the Expertiza Bookmark enhancement associated with this assignment, the credentials are below:&lt;br /&gt;
&lt;br /&gt;
Instructor login: username -&amp;gt; instructor6, password -&amp;gt; password&lt;br /&gt;
&lt;br /&gt;
'''&lt;br /&gt;
== Introduction ==&lt;br /&gt;
'''&lt;br /&gt;
&lt;br /&gt;
'''Expertiza Background'''&lt;br /&gt;
&lt;br /&gt;
Expertiza is an open-source educational web application developed on Ruby on Rails platform. Students and Instructors (including TA's) use this application though their credentials. Instructors can add new projects, assignments etc as well edit the previous ones and at a later stage can see the student submission and grade them. They can even put a time limit (deadline) for submitting the assignment. Students can form teams for the projects, submit their work through handles (Wiki page, link to a video etc). Students can even review their teammates and other peers, as well give them any suggestions if required.&lt;br /&gt;
&lt;br /&gt;
GitHub hooks to Expertiza to encourage contributors. Expertiza project is supported by National Science Foundation.&lt;br /&gt;
&lt;br /&gt;
'''Description of the current project'''&lt;br /&gt;
&lt;br /&gt;
This project is intended to make Bookmarks more user-friendly, credible and valid. Bookmarks in expertiza are created by reviewers and can be used by authors for their work on any project. On each line of the signup sheet are two icons, one for adding a bookmark to the topic, and another for viewing bookmarks on the topic. If the instructor allows the participants to create bookmarks, then only a participant has access to create and view them. He should be able to create a new Bookmark only if he enters a valid one.&lt;br /&gt;
&lt;br /&gt;
Now a new rubric is added for reviewing the bookmarks added to a topic and is accessible only to members belonging to the topic. &lt;br /&gt;
Tests are written to ensure validity of the bookmark feature.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Issues ==&lt;br /&gt;
&lt;br /&gt;
'''Problem 1'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
When a user after logging into expertiza goes to 'Create New Bookmark page&amp;quot; or &amp;quot;View existing bookmarks page&amp;quot;, he's not able to go back to Sign-up sheet using &amp;quot;back&amp;quot; button.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:back.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Solution :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:fixed_back_link.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Problem 2'''&lt;br /&gt;
&lt;br /&gt;
Bookmarks had only one option while reviewing and it was to use a drop down to give a score. Also the average rating metric had a bug and hence showed wrong values even when bookmark was not reviewed. The bug was fixed and the rubric feature was adding a new controller.&lt;br /&gt;
&lt;br /&gt;
Now choosing &amp;quot;Scale&amp;quot; Option instead of &amp;quot;Dropdown&amp;quot; allows one to use a rubric instead.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:scale.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric for rating the bookmark looks as follows :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:begin_review.png]]&lt;br /&gt;
&lt;br /&gt;
== Files modified in current project ==&lt;br /&gt;
&lt;br /&gt;
'''''1. Fixing Average problem and adding Rubric feature  :'''''&lt;br /&gt;
&lt;br /&gt;
The following files were modified for fixing the average rating bug and adding rubric for the same.&lt;br /&gt;
&lt;br /&gt;
app/models/bookmark_rating_response_map.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmark_rating_questionnaire_controller.rb &lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmarks_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/response_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/views/assignments/edit/_rubrics.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/bookmark_rating.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/list.html.erb&lt;br /&gt;
   &lt;br /&gt;
app/views/response/view.html.erb&lt;br /&gt;
&lt;br /&gt;
config/routes.rb  &lt;br /&gt;
&lt;br /&gt;
''2. Tests for Model and Controller :''&lt;br /&gt;
&lt;br /&gt;
spec/controllers/bookmarks_controller_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/models/bookmark_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/factories/factories.rb&lt;br /&gt;
&lt;br /&gt;
== Automated &amp;amp; UI Testing ==&lt;br /&gt;
&lt;br /&gt;
Automated RSpec tests were added to ensure the bookmarks are valid. Separate tests were written for the Bookmark Model and BookmarkRating Controller files. &lt;br /&gt;
The videos of the tests are uploaded onto YouTube and the links are provided in the references section.&lt;br /&gt;
&lt;br /&gt;
'''a) Back button for the page &amp;quot;View Bookmark&amp;quot; and &amp;quot;Create Bookmark&amp;quot; was resolved.'''&lt;br /&gt;
&lt;br /&gt;
1. Login with the credentials to expertiza.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'My assignments' and select OSS Project/writeup.&lt;br /&gt;
&lt;br /&gt;
3. Select 'Signup sheet'.&lt;br /&gt;
&lt;br /&gt;
4. Many titles for projects are shown. Select a title and choose either 'View Bookmark' or 'Add Bookmark' button&lt;br /&gt;
&lt;br /&gt;
5. If you  choose 'View Bookmark', after viewing, press the back button to go back to Signup sheet.&lt;br /&gt;
&lt;br /&gt;
6. You will land up in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
7. If you choose 'Add Bookmark', you can add by giving Bookmark details and save it.&lt;br /&gt;
&lt;br /&gt;
8. Now press back button.&lt;br /&gt;
&lt;br /&gt;
9. You will land in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Adding Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Questionnaires'&lt;br /&gt;
&lt;br /&gt;
3. Select new public/private item under BookmarkRating&lt;br /&gt;
&lt;br /&gt;
4. Fill in with required values and create it.&lt;br /&gt;
&lt;br /&gt;
5. After this if you go to bookmark rubric option it should be visible &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Allowing Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Assignments'&lt;br /&gt;
&lt;br /&gt;
3. Select the appropriate project&lt;br /&gt;
&lt;br /&gt;
4. Now edit the project.&lt;br /&gt;
&lt;br /&gt;
5. Check the box &amp;quot;Allow participants to create bookmarks?&amp;quot; under Topics tab if not done already.&lt;br /&gt;
&lt;br /&gt;
6. Choose the appropriate rubric from the list or create one following steps from above.&lt;br /&gt;
&lt;br /&gt;
7. Now under Rubrics tab choose the &amp;quot;Scale&amp;quot; option for Scored-question display style.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Future Work ==&lt;br /&gt;
&lt;br /&gt;
1. A reviewer can be recognized or credited if he added useful bookmarks i.e if the author has made use of the bookmark.&lt;br /&gt;
&lt;br /&gt;
2. A function to add badges automatically if a participant had submitted more than threshold number of useful bookmarks.&lt;br /&gt;
&lt;br /&gt;
3. The UI is basic and it can be further improved.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&lt;br /&gt;
1. Expertiza on Github : https://github.com/rahuliyer95/expertiza &lt;br /&gt;
&lt;br /&gt;
2. Videos on youtube : https://youtu.be/F95FA9Iam0s, https://youtu.be/tPpowgNRINk&lt;br /&gt;
&lt;br /&gt;
2. Pull Request : https://github.com/expertiza/expertiza/pull/1266&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118294</id>
		<title>E1830 OSS Project Juniper: Bookmark enhancements</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118294"/>
		<updated>2018-11-02T22:53:13Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Issues */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;'''Peer Review Information'''&lt;br /&gt;
&lt;br /&gt;
For users intending to view the Expertiza Bookmark enhancement associated with this assignment, the credentials are below:&lt;br /&gt;
&lt;br /&gt;
Instructor login: username -&amp;gt; instructor6, password -&amp;gt; password&lt;br /&gt;
&lt;br /&gt;
'''&lt;br /&gt;
== Introduction ==&lt;br /&gt;
'''&lt;br /&gt;
&lt;br /&gt;
'''Expertiza Background'''&lt;br /&gt;
&lt;br /&gt;
Expertiza is an open-source educational web application developed on Ruby on Rails platform. Students and Instructors (including TA's) use this application though their credentials. Instructors can add new projects, assignments etc as well edit the previous ones and at a later stage can see the student submission and grade them. They can even put a time limit (deadline) for submitting the assignment. Students can form teams for the projects, submit their work through handles (Wiki page, link to a video etc). Students can even review their teammates and other peers, as well give them any suggestions if required.&lt;br /&gt;
&lt;br /&gt;
GitHub hooks to Expertiza to encourage contributors. Expertiza project is supported by National Science Foundation.&lt;br /&gt;
&lt;br /&gt;
'''Description of the current project'''&lt;br /&gt;
&lt;br /&gt;
This project is intended to make Bookmarks more user-friendly, credible and valid. Bookmarks in expertiza are created by reviewers and can be used by authors for their work on any project. On each line of the signup sheet are two icons, one for adding a bookmark to the topic, and another for viewing bookmarks on the topic. If the instructor allows the participants to create bookmarks, then only a participant has access to create and view them. He should be able to create a new Bookmark only if he enters a valid one.&lt;br /&gt;
&lt;br /&gt;
Now a new rubric is added for reviewing the bookmarks added to a topic and is accessible only to members belonging to the topic. &lt;br /&gt;
Tests are written to ensure validity of the bookmark feature.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Issues ==&lt;br /&gt;
&lt;br /&gt;
'''Problem 1'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
When a user after logging into expertiza goes to 'Create New Bookmark page&amp;quot; or &amp;quot;View existing bookmarks page&amp;quot;, he's not able to go back to Sign-up sheet using &amp;quot;back&amp;quot; button.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:back.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Solution :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:fixed_back_link.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Problem 2'''&lt;br /&gt;
&lt;br /&gt;
Bookmarks had only one option while reviewing and it was to use a drop down to give a score. Also the average rating metric had a bug and hence showed wrong values even when bookmark was not reviewed. The bug was fixed and the rubric feature was adding a new controller.&lt;br /&gt;
&lt;br /&gt;
Now choosing &amp;quot;Scale&amp;quot; Option instead of &amp;quot;Dropdown&amp;quot; allows one to use a rubric instead.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:scale.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric for rating the bookmark looks as follows :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:begin_review.png]]&lt;br /&gt;
&lt;br /&gt;
== Files modified in current project ==&lt;br /&gt;
&lt;br /&gt;
''1. Fixing Average problem and adding Rubric feature  :''&lt;br /&gt;
&lt;br /&gt;
The following files were modified for fixing the average rating bug and adding rubric for the same.&lt;br /&gt;
&lt;br /&gt;
app/models/bookmark_rating_response_map.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmark_rating_questionnaire_controller.rb &lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmarks_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/response_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/views/assignments/edit/_rubrics.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/bookmark_rating.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/list.html.erb&lt;br /&gt;
   &lt;br /&gt;
app/views/response/view.html.erb&lt;br /&gt;
&lt;br /&gt;
config/routes.rb  &lt;br /&gt;
&lt;br /&gt;
''2. Tests for Model and Controller :''&lt;br /&gt;
&lt;br /&gt;
spec/controllers/bookmarks_controller_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/models/bookmark_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/factories/factories.rb&lt;br /&gt;
&lt;br /&gt;
== Automated &amp;amp; UI Testing ==&lt;br /&gt;
&lt;br /&gt;
Automated RSpec tests were added to ensure the bookmarks are valid. Separate tests were written for the Bookmark Model and BookmarkRating Controller files. &lt;br /&gt;
The videos of the tests are uploaded onto YouTube and the links are provided in the references section.&lt;br /&gt;
&lt;br /&gt;
'''a) Back button for the page &amp;quot;View Bookmark&amp;quot; and &amp;quot;Create Bookmark&amp;quot; was resolved.'''&lt;br /&gt;
&lt;br /&gt;
1. Login with the credentials to expertiza.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'My assignments' and select OSS Project/writeup.&lt;br /&gt;
&lt;br /&gt;
3. Select 'Signup sheet'.&lt;br /&gt;
&lt;br /&gt;
4. Many titles for projects are shown. Select a title and choose either 'View Bookmark' or 'Add Bookmark' button&lt;br /&gt;
&lt;br /&gt;
5. If you  choose 'View Bookmark', after viewing, press the back button to go back to Signup sheet.&lt;br /&gt;
&lt;br /&gt;
6. You will land up in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
7. If you choose 'Add Bookmark', you can add by giving Bookmark details and save it.&lt;br /&gt;
&lt;br /&gt;
8. Now press back button.&lt;br /&gt;
&lt;br /&gt;
9. You will land in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Adding Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Questionnaires'&lt;br /&gt;
&lt;br /&gt;
3. Select new public/private item under BookmarkRating&lt;br /&gt;
&lt;br /&gt;
4. Fill in with required values and create it.&lt;br /&gt;
&lt;br /&gt;
5. After this if you go to bookmark rubric option it should be visible &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Allowing Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Assignments'&lt;br /&gt;
&lt;br /&gt;
3. Select the appropriate project&lt;br /&gt;
&lt;br /&gt;
4. Now edit the project.&lt;br /&gt;
&lt;br /&gt;
5. Check the box &amp;quot;Allow participants to create bookmarks?&amp;quot; under Topics tab if not done already.&lt;br /&gt;
&lt;br /&gt;
6. Choose the appropriate rubric from the list or create one following steps from above.&lt;br /&gt;
&lt;br /&gt;
7. Now under Rubrics tab choose the &amp;quot;Scale&amp;quot; option for Scored-question display style.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Future Work ==&lt;br /&gt;
&lt;br /&gt;
1. A reviewer can be recognized or credited if he added useful bookmarks i.e if the author has made use of the bookmark.&lt;br /&gt;
&lt;br /&gt;
2. A function to add badges automatically if a participant had submitted more than threshold number of useful bookmarks.&lt;br /&gt;
&lt;br /&gt;
3. The UI is basic and it can be further improved.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&lt;br /&gt;
1. Expertiza on Github : https://github.com/rahuliyer95/expertiza &lt;br /&gt;
&lt;br /&gt;
2. Videos on youtube : https://youtu.be/F95FA9Iam0s, https://youtu.be/tPpowgNRINk&lt;br /&gt;
&lt;br /&gt;
2. Pull Request : https://github.com/expertiza/expertiza/pull/1266&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118292</id>
		<title>E1830 OSS Project Juniper: Bookmark enhancements</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118292"/>
		<updated>2018-11-02T22:52:42Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Issues */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;'''Peer Review Information'''&lt;br /&gt;
&lt;br /&gt;
For users intending to view the Expertiza Bookmark enhancement associated with this assignment, the credentials are below:&lt;br /&gt;
&lt;br /&gt;
Instructor login: username -&amp;gt; instructor6, password -&amp;gt; password&lt;br /&gt;
&lt;br /&gt;
'''&lt;br /&gt;
== Introduction ==&lt;br /&gt;
'''&lt;br /&gt;
&lt;br /&gt;
'''Expertiza Background'''&lt;br /&gt;
&lt;br /&gt;
Expertiza is an open-source educational web application developed on Ruby on Rails platform. Students and Instructors (including TA's) use this application though their credentials. Instructors can add new projects, assignments etc as well edit the previous ones and at a later stage can see the student submission and grade them. They can even put a time limit (deadline) for submitting the assignment. Students can form teams for the projects, submit their work through handles (Wiki page, link to a video etc). Students can even review their teammates and other peers, as well give them any suggestions if required.&lt;br /&gt;
&lt;br /&gt;
GitHub hooks to Expertiza to encourage contributors. Expertiza project is supported by National Science Foundation.&lt;br /&gt;
&lt;br /&gt;
'''Description of the current project'''&lt;br /&gt;
&lt;br /&gt;
This project is intended to make Bookmarks more user-friendly, credible and valid. Bookmarks in expertiza are created by reviewers and can be used by authors for their work on any project. On each line of the signup sheet are two icons, one for adding a bookmark to the topic, and another for viewing bookmarks on the topic. If the instructor allows the participants to create bookmarks, then only a participant has access to create and view them. He should be able to create a new Bookmark only if he enters a valid one.&lt;br /&gt;
&lt;br /&gt;
Now a new rubric is added for reviewing the bookmarks added to a topic and is accessible only to members belonging to the topic. &lt;br /&gt;
Tests are written to ensure validity of the bookmark feature.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Issues ==&lt;br /&gt;
&lt;br /&gt;
'''Problem 1'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
When a user after logging into expertiza goes to 'Create New Bookmark page&amp;quot; or &amp;quot;View existing bookmarks page&amp;quot;, he's not able to go back to Sign-up sheet using &amp;quot;back&amp;quot; button.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:back.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Solution :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:fixed_back_link.png]]&lt;br /&gt;
&lt;br /&gt;
[[File:back_fixed.png|200px]]&lt;br /&gt;
&lt;br /&gt;
'''Problem 2'''&lt;br /&gt;
&lt;br /&gt;
Bookmarks had only one option while reviewing and it was to use a drop down to give a score. Also the average rating metric had a bug and hence showed wrong values even when bookmark was not reviewed. The bug was fixed and the rubric feature was adding a new controller.&lt;br /&gt;
&lt;br /&gt;
Now choosing &amp;quot;Scale&amp;quot; Option instead of &amp;quot;Dropdown&amp;quot; allows one to use a rubric instead.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:scale.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The rubric for rating the bookmark looks as follows :&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:begin_review.png]]&lt;br /&gt;
&lt;br /&gt;
== Files modified in current project ==&lt;br /&gt;
&lt;br /&gt;
''1. Fixing Average problem and adding Rubric feature  :''&lt;br /&gt;
&lt;br /&gt;
The following files were modified for fixing the average rating bug and adding rubric for the same.&lt;br /&gt;
&lt;br /&gt;
app/models/bookmark_rating_response_map.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmark_rating_questionnaire_controller.rb &lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmarks_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/response_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/views/assignments/edit/_rubrics.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/bookmark_rating.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/list.html.erb&lt;br /&gt;
   &lt;br /&gt;
app/views/response/view.html.erb&lt;br /&gt;
&lt;br /&gt;
config/routes.rb  &lt;br /&gt;
&lt;br /&gt;
''2. Tests for Model and Controller :''&lt;br /&gt;
&lt;br /&gt;
spec/controllers/bookmarks_controller_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/models/bookmark_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/factories/factories.rb&lt;br /&gt;
&lt;br /&gt;
== Automated &amp;amp; UI Testing ==&lt;br /&gt;
&lt;br /&gt;
Automated RSpec tests were added to ensure the bookmarks are valid. Separate tests were written for the Bookmark Model and BookmarkRating Controller files. &lt;br /&gt;
The videos of the tests are uploaded onto YouTube and the links are provided in the references section.&lt;br /&gt;
&lt;br /&gt;
'''a) Back button for the page &amp;quot;View Bookmark&amp;quot; and &amp;quot;Create Bookmark&amp;quot; was resolved.'''&lt;br /&gt;
&lt;br /&gt;
1. Login with the credentials to expertiza.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'My assignments' and select OSS Project/writeup.&lt;br /&gt;
&lt;br /&gt;
3. Select 'Signup sheet'.&lt;br /&gt;
&lt;br /&gt;
4. Many titles for projects are shown. Select a title and choose either 'View Bookmark' or 'Add Bookmark' button&lt;br /&gt;
&lt;br /&gt;
5. If you  choose 'View Bookmark', after viewing, press the back button to go back to Signup sheet.&lt;br /&gt;
&lt;br /&gt;
6. You will land up in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
7. If you choose 'Add Bookmark', you can add by giving Bookmark details and save it.&lt;br /&gt;
&lt;br /&gt;
8. Now press back button.&lt;br /&gt;
&lt;br /&gt;
9. You will land in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Adding Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Questionnaires'&lt;br /&gt;
&lt;br /&gt;
3. Select new public/private item under BookmarkRating&lt;br /&gt;
&lt;br /&gt;
4. Fill in with required values and create it.&lt;br /&gt;
&lt;br /&gt;
5. After this if you go to bookmark rubric option it should be visible &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Allowing Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Assignments'&lt;br /&gt;
&lt;br /&gt;
3. Select the appropriate project&lt;br /&gt;
&lt;br /&gt;
4. Now edit the project.&lt;br /&gt;
&lt;br /&gt;
5. Check the box &amp;quot;Allow participants to create bookmarks?&amp;quot; under Topics tab if not done already.&lt;br /&gt;
&lt;br /&gt;
6. Choose the appropriate rubric from the list or create one following steps from above.&lt;br /&gt;
&lt;br /&gt;
7. Now under Rubrics tab choose the &amp;quot;Scale&amp;quot; option for Scored-question display style.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Future Work ==&lt;br /&gt;
&lt;br /&gt;
1. A reviewer can be recognized or credited if he added useful bookmarks i.e if the author has made use of the bookmark.&lt;br /&gt;
&lt;br /&gt;
2. A function to add badges automatically if a participant had submitted more than threshold number of useful bookmarks.&lt;br /&gt;
&lt;br /&gt;
3. The UI is basic and it can be further improved.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&lt;br /&gt;
1. Expertiza on Github : https://github.com/rahuliyer95/expertiza &lt;br /&gt;
&lt;br /&gt;
2. Videos on youtube : https://youtu.be/F95FA9Iam0s, https://youtu.be/tPpowgNRINk&lt;br /&gt;
&lt;br /&gt;
2. Pull Request : https://github.com/expertiza/expertiza/pull/1266&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:Begin_review.png&amp;diff=118291</id>
		<title>File:Begin review.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:Begin_review.png&amp;diff=118291"/>
		<updated>2018-11-02T22:52:02Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:Scale.png&amp;diff=118289</id>
		<title>File:Scale.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:Scale.png&amp;diff=118289"/>
		<updated>2018-11-02T22:51:12Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118288</id>
		<title>E1830 OSS Project Juniper: Bookmark enhancements</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118288"/>
		<updated>2018-11-02T22:50:49Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Issues */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;'''Peer Review Information'''&lt;br /&gt;
&lt;br /&gt;
For users intending to view the Expertiza Bookmark enhancement associated with this assignment, the credentials are below:&lt;br /&gt;
&lt;br /&gt;
Instructor login: username -&amp;gt; instructor6, password -&amp;gt; password&lt;br /&gt;
&lt;br /&gt;
'''&lt;br /&gt;
== Introduction ==&lt;br /&gt;
'''&lt;br /&gt;
&lt;br /&gt;
'''Expertiza Background'''&lt;br /&gt;
&lt;br /&gt;
Expertiza is an open-source educational web application developed on Ruby on Rails platform. Students and Instructors (including TA's) use this application though their credentials. Instructors can add new projects, assignments etc as well edit the previous ones and at a later stage can see the student submission and grade them. They can even put a time limit (deadline) for submitting the assignment. Students can form teams for the projects, submit their work through handles (Wiki page, link to a video etc). Students can even review their teammates and other peers, as well give them any suggestions if required.&lt;br /&gt;
&lt;br /&gt;
GitHub hooks to Expertiza to encourage contributors. Expertiza project is supported by National Science Foundation.&lt;br /&gt;
&lt;br /&gt;
'''Description of the current project'''&lt;br /&gt;
&lt;br /&gt;
This project is intended to make Bookmarks more user-friendly, credible and valid. Bookmarks in expertiza are created by reviewers and can be used by authors for their work on any project. On each line of the signup sheet are two icons, one for adding a bookmark to the topic, and another for viewing bookmarks on the topic. If the instructor allows the participants to create bookmarks, then only a participant has access to create and view them. He should be able to create a new Bookmark only if he enters a valid one.&lt;br /&gt;
&lt;br /&gt;
Now a new rubric is added for reviewing the bookmarks added to a topic and is accessible only to members belonging to the topic. &lt;br /&gt;
Tests are written to ensure validity of the bookmark feature.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Issues ==&lt;br /&gt;
&lt;br /&gt;
'''Problem 1'''&lt;br /&gt;
&lt;br /&gt;
When a user after logging into expertiza goes to 'Create New Bookmark page&amp;quot; or &amp;quot;View existing bookmarks page&amp;quot;, he's not able to go back to Sign-up sheet using &amp;quot;back&amp;quot; button.&lt;br /&gt;
&lt;br /&gt;
[[File:back.png]]&lt;br /&gt;
&lt;br /&gt;
Solution :&lt;br /&gt;
&lt;br /&gt;
[[File:fixed_back_link.png]]&lt;br /&gt;
&lt;br /&gt;
[[File:back_fixed.png|200px]]&lt;br /&gt;
&lt;br /&gt;
'''Problem 2'''&lt;br /&gt;
&lt;br /&gt;
Bookmarks had only one option while reviewing and it was to use a drop down to give a score. Also the average rating metric had a bug and hence showed wrong values even when bookmark was not reviewed. The bug was fixed and the rubric feature was adding a new controller.&lt;br /&gt;
&lt;br /&gt;
Now choosing &amp;quot;Scale&amp;quot; Option instead of &amp;quot;Dropdown&amp;quot; allows one to use a rubric instead.&lt;br /&gt;
&lt;br /&gt;
[[File:scale.png]]&lt;br /&gt;
&lt;br /&gt;
The rubric for rating the bookmark looks as follows :&lt;br /&gt;
&lt;br /&gt;
[[File:begin_review.png]]&lt;br /&gt;
&lt;br /&gt;
== Files modified in current project ==&lt;br /&gt;
&lt;br /&gt;
''1. Fixing Average problem and adding Rubric feature  :''&lt;br /&gt;
&lt;br /&gt;
The following files were modified for fixing the average rating bug and adding rubric for the same.&lt;br /&gt;
&lt;br /&gt;
app/models/bookmark_rating_response_map.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmark_rating_questionnaire_controller.rb &lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmarks_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/response_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/views/assignments/edit/_rubrics.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/bookmark_rating.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/list.html.erb&lt;br /&gt;
   &lt;br /&gt;
app/views/response/view.html.erb&lt;br /&gt;
&lt;br /&gt;
config/routes.rb  &lt;br /&gt;
&lt;br /&gt;
''2. Tests for Model and Controller :''&lt;br /&gt;
&lt;br /&gt;
spec/controllers/bookmarks_controller_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/models/bookmark_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/factories/factories.rb&lt;br /&gt;
&lt;br /&gt;
== Automated &amp;amp; UI Testing ==&lt;br /&gt;
&lt;br /&gt;
Automated RSpec tests were added to ensure the bookmarks are valid. Separate tests were written for the Bookmark Model and BookmarkRating Controller files. &lt;br /&gt;
The videos of the tests are uploaded onto YouTube and the links are provided in the references section.&lt;br /&gt;
&lt;br /&gt;
'''a) Back button for the page &amp;quot;View Bookmark&amp;quot; and &amp;quot;Create Bookmark&amp;quot; was resolved.'''&lt;br /&gt;
&lt;br /&gt;
1. Login with the credentials to expertiza.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'My assignments' and select OSS Project/writeup.&lt;br /&gt;
&lt;br /&gt;
3. Select 'Signup sheet'.&lt;br /&gt;
&lt;br /&gt;
4. Many titles for projects are shown. Select a title and choose either 'View Bookmark' or 'Add Bookmark' button&lt;br /&gt;
&lt;br /&gt;
5. If you  choose 'View Bookmark', after viewing, press the back button to go back to Signup sheet.&lt;br /&gt;
&lt;br /&gt;
6. You will land up in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
7. If you choose 'Add Bookmark', you can add by giving Bookmark details and save it.&lt;br /&gt;
&lt;br /&gt;
8. Now press back button.&lt;br /&gt;
&lt;br /&gt;
9. You will land in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Adding Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Questionnaires'&lt;br /&gt;
&lt;br /&gt;
3. Select new public/private item under BookmarkRating&lt;br /&gt;
&lt;br /&gt;
4. Fill in with required values and create it.&lt;br /&gt;
&lt;br /&gt;
5. After this if you go to bookmark rubric option it should be visible &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Allowing Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Assignments'&lt;br /&gt;
&lt;br /&gt;
3. Select the appropriate project&lt;br /&gt;
&lt;br /&gt;
4. Now edit the project.&lt;br /&gt;
&lt;br /&gt;
5. Check the box &amp;quot;Allow participants to create bookmarks?&amp;quot; under Topics tab if not done already.&lt;br /&gt;
&lt;br /&gt;
6. Choose the appropriate rubric from the list or create one following steps from above.&lt;br /&gt;
&lt;br /&gt;
7. Now under Rubrics tab choose the &amp;quot;Scale&amp;quot; option for Scored-question display style.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Future Work ==&lt;br /&gt;
&lt;br /&gt;
1. A reviewer can be recognized or credited if he added useful bookmarks i.e if the author has made use of the bookmark.&lt;br /&gt;
&lt;br /&gt;
2. A function to add badges automatically if a participant had submitted more than threshold number of useful bookmarks.&lt;br /&gt;
&lt;br /&gt;
3. The UI is basic and it can be further improved.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&lt;br /&gt;
1. Expertiza on Github : https://github.com/rahuliyer95/expertiza &lt;br /&gt;
&lt;br /&gt;
2. Videos on youtube : https://youtu.be/F95FA9Iam0s, https://youtu.be/tPpowgNRINk&lt;br /&gt;
&lt;br /&gt;
2. Pull Request : https://github.com/expertiza/expertiza/pull/1266&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118286</id>
		<title>E1830 OSS Project Juniper: Bookmark enhancements</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118286"/>
		<updated>2018-11-02T22:48:34Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Issues */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;'''Peer Review Information'''&lt;br /&gt;
&lt;br /&gt;
For users intending to view the Expertiza Bookmark enhancement associated with this assignment, the credentials are below:&lt;br /&gt;
&lt;br /&gt;
Instructor login: username -&amp;gt; instructor6, password -&amp;gt; password&lt;br /&gt;
&lt;br /&gt;
'''&lt;br /&gt;
== Introduction ==&lt;br /&gt;
'''&lt;br /&gt;
&lt;br /&gt;
'''Expertiza Background'''&lt;br /&gt;
&lt;br /&gt;
Expertiza is an open-source educational web application developed on Ruby on Rails platform. Students and Instructors (including TA's) use this application though their credentials. Instructors can add new projects, assignments etc as well edit the previous ones and at a later stage can see the student submission and grade them. They can even put a time limit (deadline) for submitting the assignment. Students can form teams for the projects, submit their work through handles (Wiki page, link to a video etc). Students can even review their teammates and other peers, as well give them any suggestions if required.&lt;br /&gt;
&lt;br /&gt;
GitHub hooks to Expertiza to encourage contributors. Expertiza project is supported by National Science Foundation.&lt;br /&gt;
&lt;br /&gt;
'''Description of the current project'''&lt;br /&gt;
&lt;br /&gt;
This project is intended to make Bookmarks more user-friendly, credible and valid. Bookmarks in expertiza are created by reviewers and can be used by authors for their work on any project. On each line of the signup sheet are two icons, one for adding a bookmark to the topic, and another for viewing bookmarks on the topic. If the instructor allows the participants to create bookmarks, then only a participant has access to create and view them. He should be able to create a new Bookmark only if he enters a valid one.&lt;br /&gt;
&lt;br /&gt;
Now a new rubric is added for reviewing the bookmarks added to a topic and is accessible only to members belonging to the topic. &lt;br /&gt;
Tests are written to ensure validity of the bookmark feature.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Issues ==&lt;br /&gt;
&lt;br /&gt;
'''Problem 1'''&lt;br /&gt;
&lt;br /&gt;
When a user after logging into expertiza goes to 'Create New Bookmark page&amp;quot; or &amp;quot;View existing bookmarks page&amp;quot;, he's not able to go back to Sign-up sheet using &amp;quot;back&amp;quot; button.&lt;br /&gt;
&lt;br /&gt;
[[File:back.png]]&lt;br /&gt;
&lt;br /&gt;
Solution :&lt;br /&gt;
&lt;br /&gt;
[[File:fixed_back_link.png|200px]]&lt;br /&gt;
&lt;br /&gt;
[[File:back_fixed.png|200px]]&lt;br /&gt;
&lt;br /&gt;
'''Problem 2'''&lt;br /&gt;
&lt;br /&gt;
Bookmarks had only one option while reviewing and it was to use a drop down to give a score. Also the average rating metric had a bug and hence showed wrong values even when bookmark was not reviewed. The bug was fixed and the rubric feature was adding a new controller.&lt;br /&gt;
&lt;br /&gt;
Now choosing &amp;quot;Scale&amp;quot; Option instead of &amp;quot;Dropdown&amp;quot; allows one to use a rubric instead.&lt;br /&gt;
&lt;br /&gt;
[[File:scale.png]]&lt;br /&gt;
&lt;br /&gt;
The rubric for rating the bookmark looks as follows :&lt;br /&gt;
&lt;br /&gt;
[[File:begin_review.png]]&lt;br /&gt;
&lt;br /&gt;
== Files modified in current project ==&lt;br /&gt;
&lt;br /&gt;
''1. Fixing Average problem and adding Rubric feature  :''&lt;br /&gt;
&lt;br /&gt;
The following files were modified for fixing the average rating bug and adding rubric for the same.&lt;br /&gt;
&lt;br /&gt;
app/models/bookmark_rating_response_map.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmark_rating_questionnaire_controller.rb &lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmarks_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/response_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/views/assignments/edit/_rubrics.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/bookmark_rating.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/list.html.erb&lt;br /&gt;
   &lt;br /&gt;
app/views/response/view.html.erb&lt;br /&gt;
&lt;br /&gt;
config/routes.rb  &lt;br /&gt;
&lt;br /&gt;
''2. Tests for Model and Controller :''&lt;br /&gt;
&lt;br /&gt;
spec/controllers/bookmarks_controller_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/models/bookmark_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/factories/factories.rb&lt;br /&gt;
&lt;br /&gt;
== Automated &amp;amp; UI Testing ==&lt;br /&gt;
&lt;br /&gt;
Automated RSpec tests were added to ensure the bookmarks are valid. Separate tests were written for the Bookmark Model and BookmarkRating Controller files. &lt;br /&gt;
The videos of the tests are uploaded onto YouTube and the links are provided in the references section.&lt;br /&gt;
&lt;br /&gt;
'''a) Back button for the page &amp;quot;View Bookmark&amp;quot; and &amp;quot;Create Bookmark&amp;quot; was resolved.'''&lt;br /&gt;
&lt;br /&gt;
1. Login with the credentials to expertiza.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'My assignments' and select OSS Project/writeup.&lt;br /&gt;
&lt;br /&gt;
3. Select 'Signup sheet'.&lt;br /&gt;
&lt;br /&gt;
4. Many titles for projects are shown. Select a title and choose either 'View Bookmark' or 'Add Bookmark' button&lt;br /&gt;
&lt;br /&gt;
5. If you  choose 'View Bookmark', after viewing, press the back button to go back to Signup sheet.&lt;br /&gt;
&lt;br /&gt;
6. You will land up in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
7. If you choose 'Add Bookmark', you can add by giving Bookmark details and save it.&lt;br /&gt;
&lt;br /&gt;
8. Now press back button.&lt;br /&gt;
&lt;br /&gt;
9. You will land in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Adding Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Questionnaires'&lt;br /&gt;
&lt;br /&gt;
3. Select new public/private item under BookmarkRating&lt;br /&gt;
&lt;br /&gt;
4. Fill in with required values and create it.&lt;br /&gt;
&lt;br /&gt;
5. After this if you go to bookmark rubric option it should be visible &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Allowing Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Assignments'&lt;br /&gt;
&lt;br /&gt;
3. Select the appropriate project&lt;br /&gt;
&lt;br /&gt;
4. Now edit the project.&lt;br /&gt;
&lt;br /&gt;
5. Check the box &amp;quot;Allow participants to create bookmarks?&amp;quot; under Topics tab if not done already.&lt;br /&gt;
&lt;br /&gt;
6. Choose the appropriate rubric from the list or create one following steps from above.&lt;br /&gt;
&lt;br /&gt;
7. Now under Rubrics tab choose the &amp;quot;Scale&amp;quot; option for Scored-question display style.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Future Work ==&lt;br /&gt;
&lt;br /&gt;
1. A reviewer can be recognized or credited if he added useful bookmarks i.e if the author has made use of the bookmark.&lt;br /&gt;
&lt;br /&gt;
2. A function to add badges automatically if a participant had submitted more than threshold number of useful bookmarks.&lt;br /&gt;
&lt;br /&gt;
3. The UI is basic and it can be further improved.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&lt;br /&gt;
1. Expertiza on Github : https://github.com/rahuliyer95/expertiza &lt;br /&gt;
&lt;br /&gt;
2. Videos on youtube : https://youtu.be/F95FA9Iam0s, https://youtu.be/tPpowgNRINk&lt;br /&gt;
&lt;br /&gt;
2. Pull Request : https://github.com/expertiza/expertiza/pull/1266&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:Fixed_back_link.png&amp;diff=118285</id>
		<title>File:Fixed back link.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:Fixed_back_link.png&amp;diff=118285"/>
		<updated>2018-11-02T22:47:57Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:Back_fixed.png&amp;diff=118284</id>
		<title>File:Back fixed.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:Back_fixed.png&amp;diff=118284"/>
		<updated>2018-11-02T22:47:03Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: uploaded a new version of &amp;amp;quot;File:Back fixed.png&amp;amp;quot;&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118253</id>
		<title>E1830 OSS Project Juniper: Bookmark enhancements</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118253"/>
		<updated>2018-11-02T22:05:24Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Issues */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;'''Peer Review Information'''&lt;br /&gt;
&lt;br /&gt;
For users intending to view the Expertiza Bookmark enhancement associated with this assignment, the credentials are below:&lt;br /&gt;
&lt;br /&gt;
Instructor login: username -&amp;gt; instructor6, password -&amp;gt; password&lt;br /&gt;
&lt;br /&gt;
'''&lt;br /&gt;
== Introduction ==&lt;br /&gt;
'''&lt;br /&gt;
&lt;br /&gt;
'''Expertiza Background'''&lt;br /&gt;
&lt;br /&gt;
Expertiza is an open-source educational web application developed on Ruby on Rails platform. Students and Instructors (including TA's) use this application though their credentials. Instructors can add new projects, assignments etc as well edit the previous ones and at a later stage can see the student submission and grade them. They can even put a time limit (deadline) for submitting the assignment. Students can form teams for the projects, submit their work through handles (Wiki page, link to a video etc). Students can even review their teammates and other peers, as well give them any suggestions if required.&lt;br /&gt;
&lt;br /&gt;
GitHub hooks to Expertiza to encourage contributors. Expertiza project is supported by National Science Foundation.&lt;br /&gt;
&lt;br /&gt;
'''Description of the current project'''&lt;br /&gt;
&lt;br /&gt;
This project is intended to make Bookmarks more user-friendly, credible and valid. Bookmarks in expertiza are created by reviewers and can be used by authors for their work on any project. On each line of the signup sheet are two icons, one for adding a bookmark to the topic, and another for viewing bookmarks on the topic. If the instructor allows the participants to create bookmarks, then only a participant has access to create and view them. He should be able to create a new Bookmark only if he enters a valid one.&lt;br /&gt;
&lt;br /&gt;
Now a new rubric is added for reviewing the bookmarks added to a topic and is accessible only to members belonging to the topic. &lt;br /&gt;
Tests are written to ensure validity of the bookmark feature.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Issues ==&lt;br /&gt;
&lt;br /&gt;
'''Problem 1'''&lt;br /&gt;
&lt;br /&gt;
When a user after logging into expertiza goes to 'Create New Bookmark page&amp;quot; or &amp;quot;View existing bookmarks page&amp;quot;, he's not able to go back to Sign-up sheet using &amp;quot;back&amp;quot; button.&lt;br /&gt;
&lt;br /&gt;
[[File:back.png]]&lt;br /&gt;
&lt;br /&gt;
Solution :&lt;br /&gt;
&lt;br /&gt;
[[File:fixed_back_link.png]]&lt;br /&gt;
&lt;br /&gt;
[[File:back_fixed.png|200px]]&lt;br /&gt;
&lt;br /&gt;
'''Problem 2'''&lt;br /&gt;
&lt;br /&gt;
Bookmarks had only one option while reviewing and it was to use a drop down to give a score. Also the average rating metric had a bug and hence showed wrong values even when bookmark was not reviewed. The bug was fixed and the rubric feature was adding a new controller.&lt;br /&gt;
&lt;br /&gt;
Now choosing &amp;quot;Scale&amp;quot; Option instead of &amp;quot;Dropdown&amp;quot; allows one to use a rubric instead.&lt;br /&gt;
&lt;br /&gt;
[[File:scale.png]]&lt;br /&gt;
&lt;br /&gt;
The rubric for rating the bookmark looks as follows :&lt;br /&gt;
&lt;br /&gt;
[[File:begin_review.png]]&lt;br /&gt;
&lt;br /&gt;
== Files modified in current project ==&lt;br /&gt;
&lt;br /&gt;
''1. Fixing Average problem and adding Rubric feature  :''&lt;br /&gt;
&lt;br /&gt;
The following files were modified for fixing the average rating bug and adding rubric for the same.&lt;br /&gt;
&lt;br /&gt;
app/models/bookmark_rating_response_map.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmark_rating_questionnaire_controller.rb &lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmarks_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/response_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/views/assignments/edit/_rubrics.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/bookmark_rating.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/list.html.erb&lt;br /&gt;
   &lt;br /&gt;
app/views/response/view.html.erb&lt;br /&gt;
&lt;br /&gt;
config/routes.rb  &lt;br /&gt;
&lt;br /&gt;
''2. Tests for Model and Controller :''&lt;br /&gt;
&lt;br /&gt;
spec/controllers/bookmarks_controller_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/models/bookmark_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/factories/factories.rb&lt;br /&gt;
&lt;br /&gt;
== Automated &amp;amp; UI Testing ==&lt;br /&gt;
&lt;br /&gt;
Automated RSpec tests were added to ensure the bookmarks are valid. Separate tests were written for the Bookmark Model and BookmarkRating Controller files. &lt;br /&gt;
The videos of the tests are uploaded onto YouTube and the links are provided in the references section.&lt;br /&gt;
&lt;br /&gt;
'''a) Back button for the page &amp;quot;View Bookmark&amp;quot; and &amp;quot;Create Bookmark&amp;quot; was resolved.'''&lt;br /&gt;
&lt;br /&gt;
1. Login with the credentials to expertiza.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'My assignments' and select OSS Project/writeup.&lt;br /&gt;
&lt;br /&gt;
3. Select 'Signup sheet'.&lt;br /&gt;
&lt;br /&gt;
4. Many titles for projects are shown. Select a title and choose either 'View Bookmark' or 'Add Bookmark' button&lt;br /&gt;
&lt;br /&gt;
5. If you  choose 'View Bookmark', after viewing, press the back button to go back to Signup sheet.&lt;br /&gt;
&lt;br /&gt;
6. You will land up in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
7. If you choose 'Add Bookmark', you can add by giving Bookmark details and save it.&lt;br /&gt;
&lt;br /&gt;
8. Now press back button.&lt;br /&gt;
&lt;br /&gt;
9. You will land in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Adding Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Questionnaires'&lt;br /&gt;
&lt;br /&gt;
3. Select new public/private item under BookmarkRating&lt;br /&gt;
&lt;br /&gt;
4. Fill in with required values and create it.&lt;br /&gt;
&lt;br /&gt;
5. After this if you go to bookmark rubric option it should be visible &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Allowing Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Assignments'&lt;br /&gt;
&lt;br /&gt;
3. Select the appropriate project&lt;br /&gt;
&lt;br /&gt;
4. Now edit the project.&lt;br /&gt;
&lt;br /&gt;
5. Check the box &amp;quot;Allow participants to create bookmarks?&amp;quot; under Topics tab if not done already.&lt;br /&gt;
&lt;br /&gt;
6. Choose the appropriate rubric from the list or create one following steps from above.&lt;br /&gt;
&lt;br /&gt;
7. Now under Rubrics tab choose the &amp;quot;Scale&amp;quot; option for Scored-question display style.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Future Work ==&lt;br /&gt;
&lt;br /&gt;
1. A reviewer can be recognized or credited if he added useful bookmarks i.e if the author has made use of the bookmark.&lt;br /&gt;
&lt;br /&gt;
2. A function to add badges automatically if a participant had submitted more than threshold number of useful bookmarks.&lt;br /&gt;
&lt;br /&gt;
3. The UI is basic and it can be further improved.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&lt;br /&gt;
1. Expertiza on Github : https://github.com/rahuliyer95/expertiza &lt;br /&gt;
&lt;br /&gt;
2. Videos on youtube : https://youtu.be/F95FA9Iam0s, https://youtu.be/tPpowgNRINk&lt;br /&gt;
&lt;br /&gt;
2. Pull Request : https://github.com/expertiza/expertiza/pull/1266&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:Back_fixed.png&amp;diff=118251</id>
		<title>File:Back fixed.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:Back_fixed.png&amp;diff=118251"/>
		<updated>2018-11-02T22:03:56Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: uploaded a new version of &amp;amp;quot;File:Back fixed.png&amp;amp;quot;&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:Back_fixed.png&amp;diff=118250</id>
		<title>File:Back fixed.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:Back_fixed.png&amp;diff=118250"/>
		<updated>2018-11-02T22:03:13Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:Back.png&amp;diff=118248</id>
		<title>File:Back.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:Back.png&amp;diff=118248"/>
		<updated>2018-11-02T22:02:35Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118246</id>
		<title>E1830 OSS Project Juniper: Bookmark enhancements</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=E1830_OSS_Project_Juniper:_Bookmark_enhancements&amp;diff=118246"/>
		<updated>2018-11-02T22:01:27Z</updated>

		<summary type="html">&lt;p&gt;Rkovilk: /* Introduction */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;'''Peer Review Information'''&lt;br /&gt;
&lt;br /&gt;
For users intending to view the Expertiza Bookmark enhancement associated with this assignment, the credentials are below:&lt;br /&gt;
&lt;br /&gt;
Instructor login: username -&amp;gt; instructor6, password -&amp;gt; password&lt;br /&gt;
&lt;br /&gt;
'''&lt;br /&gt;
== Introduction ==&lt;br /&gt;
'''&lt;br /&gt;
&lt;br /&gt;
'''Expertiza Background'''&lt;br /&gt;
&lt;br /&gt;
Expertiza is an open-source educational web application developed on Ruby on Rails platform. Students and Instructors (including TA's) use this application though their credentials. Instructors can add new projects, assignments etc as well edit the previous ones and at a later stage can see the student submission and grade them. They can even put a time limit (deadline) for submitting the assignment. Students can form teams for the projects, submit their work through handles (Wiki page, link to a video etc). Students can even review their teammates and other peers, as well give them any suggestions if required.&lt;br /&gt;
&lt;br /&gt;
GitHub hooks to Expertiza to encourage contributors. Expertiza project is supported by National Science Foundation.&lt;br /&gt;
&lt;br /&gt;
'''Description of the current project'''&lt;br /&gt;
&lt;br /&gt;
This project is intended to make Bookmarks more user-friendly, credible and valid. Bookmarks in expertiza are created by reviewers and can be used by authors for their work on any project. On each line of the signup sheet are two icons, one for adding a bookmark to the topic, and another for viewing bookmarks on the topic. If the instructor allows the participants to create bookmarks, then only a participant has access to create and view them. He should be able to create a new Bookmark only if he enters a valid one.&lt;br /&gt;
&lt;br /&gt;
Now a new rubric is added for reviewing the bookmarks added to a topic and is accessible only to members belonging to the topic. &lt;br /&gt;
Tests are written to ensure validity of the bookmark feature.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Issues ==&lt;br /&gt;
&lt;br /&gt;
'''Problem 1'''&lt;br /&gt;
&lt;br /&gt;
When a user after logging into expertiza goes to 'Create New Bookmark page&amp;quot; or &amp;quot;View existing bookmarks page&amp;quot;, he's not able to go back to Sign-up sheet using &amp;quot;back&amp;quot; button.&lt;br /&gt;
&lt;br /&gt;
[[File:back.png]]&lt;br /&gt;
&lt;br /&gt;
Solution :&lt;br /&gt;
&lt;br /&gt;
[[File:fixed_back_link.png]]&lt;br /&gt;
&lt;br /&gt;
[[File:back_fixed.png]]&lt;br /&gt;
&lt;br /&gt;
'''Problem 2'''&lt;br /&gt;
&lt;br /&gt;
Bookmarks had only one option while reviewing and it was to use a drop down to give a score. Also the average rating metric had a bug and hence showed wrong values even when bookmark was not reviewed. The bug was fixed and the rubric feature was adding a new controller.&lt;br /&gt;
&lt;br /&gt;
Now choosing &amp;quot;Scale&amp;quot; Option instead of &amp;quot;Dropdown&amp;quot; allows one to use a rubric instead.&lt;br /&gt;
&lt;br /&gt;
[[File:scale.png]]&lt;br /&gt;
&lt;br /&gt;
The rubric for rating the bookmark looks as follows :&lt;br /&gt;
&lt;br /&gt;
[[File:begin_review.png]]&lt;br /&gt;
&lt;br /&gt;
== Files modified in current project ==&lt;br /&gt;
&lt;br /&gt;
''1. Fixing Average problem and adding Rubric feature  :''&lt;br /&gt;
&lt;br /&gt;
The following files were modified for fixing the average rating bug and adding rubric for the same.&lt;br /&gt;
&lt;br /&gt;
app/models/bookmark_rating_response_map.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmark_rating_questionnaire_controller.rb &lt;br /&gt;
&lt;br /&gt;
app/controllers/bookmarks_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/controllers/response_controller.rb&lt;br /&gt;
&lt;br /&gt;
app/views/assignments/edit/_rubrics.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/bookmark_rating.html.erb &lt;br /&gt;
&lt;br /&gt;
app/views/bookmarks/list.html.erb&lt;br /&gt;
   &lt;br /&gt;
app/views/response/view.html.erb&lt;br /&gt;
&lt;br /&gt;
config/routes.rb  &lt;br /&gt;
&lt;br /&gt;
''2. Tests for Model and Controller :''&lt;br /&gt;
&lt;br /&gt;
spec/controllers/bookmarks_controller_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/models/bookmark_spec.rb &lt;br /&gt;
&lt;br /&gt;
spec/factories/factories.rb&lt;br /&gt;
&lt;br /&gt;
== Automated &amp;amp; UI Testing ==&lt;br /&gt;
&lt;br /&gt;
Automated RSpec tests were added to ensure the bookmarks are valid. Separate tests were written for the Bookmark Model and BookmarkRating Controller files. &lt;br /&gt;
The videos of the tests are uploaded onto YouTube and the links are provided in the references section.&lt;br /&gt;
&lt;br /&gt;
'''a) Back button for the page &amp;quot;View Bookmark&amp;quot; and &amp;quot;Create Bookmark&amp;quot; was resolved.'''&lt;br /&gt;
&lt;br /&gt;
1. Login with the credentials to expertiza.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'My assignments' and select OSS Project/writeup.&lt;br /&gt;
&lt;br /&gt;
3. Select 'Signup sheet'.&lt;br /&gt;
&lt;br /&gt;
4. Many titles for projects are shown. Select a title and choose either 'View Bookmark' or 'Add Bookmark' button&lt;br /&gt;
&lt;br /&gt;
5. If you  choose 'View Bookmark', after viewing, press the back button to go back to Signup sheet.&lt;br /&gt;
&lt;br /&gt;
6. You will land up in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
7. If you choose 'Add Bookmark', you can add by giving Bookmark details and save it.&lt;br /&gt;
&lt;br /&gt;
8. Now press back button.&lt;br /&gt;
&lt;br /&gt;
9. You will land in Sign-up sheet page.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Adding Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Questionnaires'&lt;br /&gt;
&lt;br /&gt;
3. Select new public/private item under BookmarkRating&lt;br /&gt;
&lt;br /&gt;
4. Fill in with required values and create it.&lt;br /&gt;
&lt;br /&gt;
5. After this if you go to bookmark rubric option it should be visible &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''c) Allowing Bookmark Rubric.'''&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
1. Login into the expertiza with the Instructor/TA credentials.&lt;br /&gt;
&lt;br /&gt;
2. Go to 'Manage Content -&amp;gt; Assignments'&lt;br /&gt;
&lt;br /&gt;
3. Select the appropriate project&lt;br /&gt;
&lt;br /&gt;
4. Now edit the project.&lt;br /&gt;
&lt;br /&gt;
5. Check the box &amp;quot;Allow participants to create bookmarks?&amp;quot; under Topics tab if not done already.&lt;br /&gt;
&lt;br /&gt;
6. Choose the appropriate rubric from the list or create one following steps from above.&lt;br /&gt;
&lt;br /&gt;
7. Now under Rubrics tab choose the &amp;quot;Scale&amp;quot; option for Scored-question display style.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Future Work ==&lt;br /&gt;
&lt;br /&gt;
1. A reviewer can be recognized or credited if he added useful bookmarks i.e if the author has made use of the bookmark.&lt;br /&gt;
&lt;br /&gt;
2. A function to add badges automatically if a participant had submitted more than threshold number of useful bookmarks.&lt;br /&gt;
&lt;br /&gt;
3. The UI is basic and it can be further improved.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
&lt;br /&gt;
1. Expertiza on Github : https://github.com/rahuliyer95/expertiza &lt;br /&gt;
&lt;br /&gt;
2. Videos on youtube : https://youtu.be/F95FA9Iam0s, https://youtu.be/tPpowgNRINk&lt;br /&gt;
&lt;br /&gt;
2. Pull Request : https://github.com/expertiza/expertiza/pull/1266&lt;/div&gt;</summary>
		<author><name>Rkovilk</name></author>
	</entry>
</feed>