<?xml version="1.0"?>
<feed xmlns="http://www.w3.org/2005/Atom" xml:lang="en">
	<id>https://wiki.expertiza.ncsu.edu/api.php?action=feedcontributions&amp;feedformat=atom&amp;user=Rrajan3</id>
	<title>Expertiza_Wiki - User contributions [en]</title>
	<link rel="self" type="application/atom+xml" href="https://wiki.expertiza.ncsu.edu/api.php?action=feedcontributions&amp;feedformat=atom&amp;user=Rrajan3"/>
	<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=Special:Contributions/Rrajan3"/>
	<updated>2026-10-04T03:44:31Z</updated>
	<subtitle>User contributions</subtitle>
	<generator>MediaWiki 1.41.0</generator>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120962</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120962"/>
		<updated>2018-12-05T17:41:24Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* References &amp;amp; Related Links */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Project Introduction &amp;amp; Motivation''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
Expertiza Project : E1864 ‘Issues Related to Reviewing' is intended to fix five known issues in the current Expertiza Version related to reviewing student work. Issues are centered around peer reviewing and assignment feature calibration. The motivation behind this project is to identify and resolve each bug in an attempt to improve the current system version. The project has been divided into required fixes. Four of the five problems are presented in ''Figure 1 - Application Flow Diagram'' below. This image is a general representation describing when each of the issues is encountered during a user session. Problem 5 (Issue # 1142) is not present in this figure as the problem is simply associated with the coding of a view file and not directly connected to the flow of students and reviews. Additional discussion on proposed approaches to meet the requirements are explained in subsequent sections.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:FlowDiagram.PNG]]&lt;br /&gt;
::::::'''Figure 1 - Application Flow Diagram'''&lt;br /&gt;
::::::-----------------------------------------------&lt;br /&gt;
&lt;br /&gt;
== '''UML diagram for reviw''' ==&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig2_uml.PNG]]&lt;br /&gt;
'''Actors''':&lt;br /&gt;
&lt;br /&gt;
:*Instructor - This actor is responsible for creating assignments and adding students to the assignment.&lt;br /&gt;
:*Student - This actor is responsible for submitting, reviewing other students work.&lt;br /&gt;
&lt;br /&gt;
'''Database''':&lt;br /&gt;
&lt;br /&gt;
:*The database where all the data of Expertiza is getting stored.&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statements &amp;amp; Descriptions''' ==&lt;br /&gt;
&lt;br /&gt;
For this project, we have been asked to fix the follow bugs that have been found in the current Expertiza system :&lt;br /&gt;
=== Problem 1 : Issue #1093 ===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
:*Example : The project name for which the review was performed earlier should not appear for the next list of reviews when a student requests a review to perform. This could lead to students reviewing the same project more than once and the requirement is to review different projects each time. &lt;br /&gt;
 &lt;br /&gt;
&lt;br /&gt;
:::::[[File:Fig_3.PNG]]&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1093:'''&lt;br /&gt;
Figure 1 gives the holistic view on stages in which we see the issues. In this part, we will discuss the exact steps that need to be followed to reproduce the bugs.&lt;br /&gt;
:* Login as Instructor Create new assignment and associate to the course as shown in Figure 4&lt;br /&gt;
:* Add a participant to the assignment. there are two ways to do this in bulk first way is importing all the course participants to assignment . second approach is creating a file containing student details and import them to expertiza &lt;br /&gt;
:* Create topics and teams in expertiza either entering them one by one or from the file &lt;br /&gt;
:* In actual implementation topic association to the teams involves bidding process but for ease of use, we let instructor assign the topic (Figure 5). set min and max number of reviews allowed as shown in &lt;br /&gt;
:* Set the rubrics and number of review rounds (min one round is needed) (Figure 6)&lt;br /&gt;
:* Review assignment should be automatic not instructor controlled(scope of the stated issue is here) as shown in Figure 7&lt;br /&gt;
:* Set the deadlines for submission and review (shown in Figure 8)&lt;br /&gt;
:* Login as a student and submit work(this needs to be done for each team), request for review&lt;br /&gt;
:* If the issue persist system assign the same topic to review multiple times(as shown in Figure2).difficulty with this problem is that its reproducibility factor which is very low.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:p1_p1.PNG]]&lt;br /&gt;
:::::[[File:p1_p2.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
:*Example : When the reviewer submits a review for a project, the reviewer cannot edit/ update his review again. Before submitting it says &amp;quot;Once submitted, the review cannot be changed again&amp;quot;. After clicking yes the reviewer is only able to view his reviews and not update even before the deadline.  &lt;br /&gt;
This situation can occur in the following scenario. When a reviewer submits the review-1 a few minutes after the deadline, the rubric for review 2 occurs. So the review done for the first round actually becomes review for round 2. Hence the reviewer would not be able to update this review. In situations like these, updating the submitted review becomes useful.&lt;br /&gt;
&lt;br /&gt;
Steps to reproduce the issue:&lt;br /&gt;
*Initial steps to reproduce this problem is same as the issue #1093&lt;br /&gt;
*Change the deadlines for the review to a few days after the present date and check if you are able to update the review. The picture shows deadline to submit is after 14 days. But the reviews are only able to be viewed. &lt;br /&gt;
:::::[[File:p2_p1_redo.PNG]]&lt;br /&gt;
:::::[[File:p2_p2_redo.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
:*Example : An author of a project has submitted his/her assignment to Expertiza. When a reviewer tries to review the work, sometimes it happens that the system shows the reviewer that the work has not been submitted yet. The reviewer should have been shown the work of the author to review.&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1029:'''&lt;br /&gt;
:* steps to reproduce this issue is similar to issue #1093, only the difference is once reviewer requests the assignment to review system throws a message saying there is no work has been submitted even though there is actually submitted work. This issue is not always reproducible&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
:*Example : An instructor attempts to edit an existing assignment and change the number of review rounds. The reassignment causes an error in the system and this prevents the project update to occur.&lt;br /&gt;
'''Steps to reproduce the Issue #972 :'''&lt;br /&gt;
:*The [https://github.com/expertiza/expertiza/issues/972 Github Bug Report] states that ''&amp;quot;You can change the # of rounds from 1 to 2. You can then change the # of rounds back to 1, and the assignment will appear to be saved with one round of review. But if you edit it again, the 2 rounds will still be present.&amp;quot;'' Several attempts to reproduce this issue were made. Below are two of such test cases.&lt;br /&gt;
::- '''Test Case 1''' : Increment beyond current number of rounds then decrements back to the original assigned number of rounds for an existing assignment.&lt;br /&gt;
:::*Step 1 - Log in as ''instructor6''&lt;br /&gt;
:::*Step 2 - Go to the ''Manage Courses'' page and select - ''CSC 517 Spring 2015''&lt;br /&gt;
:::*Step 3 - Select the ''Edit'' option for - ''Final projects''&lt;br /&gt;
:::*Step 4 - Select the ''due dates'' tab as seen in figure 12&lt;br /&gt;
:::*Step 5a - Change the number of rounds from 2 to 3&lt;br /&gt;
:::*Step 6 - Press the ''Set'' option&lt;br /&gt;
:::*Step 7a - Select ''Save''&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig12_p4_redo.PNG]]&lt;br /&gt;
:::::[[File:fig13_p4.PNG]]&lt;br /&gt;
&lt;br /&gt;
:::- One can see from Figure 13 that the change in round number is successfully updated and reflected in the tab. To ensure that the assignment was saved correctly, logging out of the user session, steps 1 - 4 were repeated and the previous changes were found to persist.&lt;br /&gt;
&lt;br /&gt;
:::*Step 5b - Change the number of rounds from 3 back to 2&lt;br /&gt;
:::*Step 6 - Press the ''Set'' option&lt;br /&gt;
:::*Step 7b - Select ''Save''&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig14_p4.PNG]]&lt;br /&gt;
&lt;br /&gt;
:::- One can see from Figure 14 that the change in round number is successfully updated and reflected in the tab. To ensure that the assignment was saved correctly, logging out of the user session, steps 1 - 4 were repeated and the previous changes were found to persist.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
::- '''Test Case 2''' : Decrement below current number of rounds an existing assignment with submissions.&lt;br /&gt;
:::*Step 1 - Log in as ''instructor6''&lt;br /&gt;
:::*Step 2 - Go to the ''Manage Courses'' page and select - ''CSC 517 Spring 2016''&lt;br /&gt;
:::*Step 3 - Select the ''Edit'' option for - ''Program 1: Class portal''&lt;br /&gt;
:::*Step 4 - Select the ''due dates'' tab as seen in figure 12&lt;br /&gt;
:::*Step 5a - Change the number of rounds from 2 to 1&lt;br /&gt;
:::*Step 6 - Press the ''Set'' option&lt;br /&gt;
:::*Step 7 - Confirm the reduction below the current number of rounds&lt;br /&gt;
:::*Step 8 - Press ''OK'' to exit the notification popup&lt;br /&gt;
::::''Addition steps 6-8 can be seen in Figure 15 below.''&lt;br /&gt;
:::*Step 7a - Select ''Save''&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig15_p4.PNG]]&lt;br /&gt;
:::::[[File:fig16_p4.PNG]]&lt;br /&gt;
&lt;br /&gt;
:::- One can see from Figure 16 that the change in round number is successfully updated and reflected in the tab. To ensure that the assignment was saved correctly, logging out of the user session, steps 1 - 4 were repeated and the previous changes were found to persist.&lt;br /&gt;
&lt;br /&gt;
:*Several similar tests were conducted in an attempt to reproduce this issue; however, none were successful.&lt;br /&gt;
:*'''Unstated Issue''': there is an issue that arises from the reduction of rounds for assignments that currently contain submissions. After the udpate, When an current student attempts to go and review his/her scores, this causes a ''NoMethodError in Grades#view_team''. A bug should be created for this issue for another round of project issues.&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:*''“Summary Result Assignment” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
:*Example : As seen in Figure 17 below, the result of hovering over a review result displays the message in raw HTML. The intended result is for review comment to be rendered properly while displaying.&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig_17_p5.PNG]]&lt;br /&gt;
::::::''Figure 17 was taken from the actual deployed version of Expertiza through a person student account.''&lt;br /&gt;
&lt;br /&gt;
::-'''Test Case 1''' :  Hover for Reviewer Comment&lt;br /&gt;
:::*Step 1 - Log in as instructor6&lt;br /&gt;
:::*Step 2 - Select ''Manage'' and ''Impersonate User''&lt;br /&gt;
:::*Step 3 - Impersonate ''student6370''&lt;br /&gt;
:::*Step 4 - Selec ''OSS project/Writing assignment 2'' &lt;br /&gt;
:::*Step 5 - Hover over any underlined review score&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig_18_p5.PNG]]&lt;br /&gt;
::::::''Figure 18 was taken from the development version of Expertiza through the test case steps mentioned above.''&lt;br /&gt;
&lt;br /&gt;
:*After testing and research into this issue, it has been determined that the issue has been adjusted in the development image and has not yet been merged with the deployed version.&lt;br /&gt;
&lt;br /&gt;
== '''Files to be Modified''' ==&lt;br /&gt;
&lt;br /&gt;
:*''app/views/student_review/_responses.html.erb''&lt;br /&gt;
:*''app/views/response/response.html.erb''&lt;br /&gt;
:*''app/controllers/response_controller.rb''&lt;br /&gt;
:*''spec/controllers/response_controller_spec.rb''&lt;br /&gt;
:*''spec/features/assignment_round_adjustment.rb''&lt;br /&gt;
&lt;br /&gt;
== '''Solution Design''' ==&lt;br /&gt;
=== Problem 1 : Issue # 1093 ===&lt;br /&gt;
:* Several attempts have been made to reproduce this problem. We tested with both old and latest database but the issue did not reproduce.&lt;br /&gt;
:* We also tried with creating a new assignment, adding participants to the assignment, assign reviews to the student then logging in as student and request for a topic to review even with this issue did not reproduce &lt;br /&gt;
:* After discussing with mentor and Dr.Gehringer we are marking this issue as not reproducible&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*To solve this problem we will edit code in ''app/views/student_review/_responses.html.erb'', ''app/views/response/response.html.erb'', and ''app/controllers/response_controller.rb'' to enable a reviewer to update the review until the round deadline. We will also remove the confirmation message &amp;quot;Once submitted, it cannot be changed again&amp;quot; before the deadline to appropriate reflect this edit. &lt;br /&gt;
:*Once these changes have been made, the new view will be reflected as seen in the figure below.&lt;br /&gt;
&lt;br /&gt;
:::::[[File: P2 sol.PNG]]&lt;br /&gt;
:::::-The reviewer now has the option to both view and update their submitted reviews multiple times before the round deadline This is in contrast to the previous build where the reviewer could only 'view' their submission.&lt;br /&gt;
&lt;br /&gt;
:'''1)''' ''app/views/student_review/_responses.html.erb'' - added a condition such that a user is allowed to update a review even after submission.&lt;br /&gt;
&amp;lt;pre&amp;gt;&lt;br /&gt;
&amp;lt;% if (last_response_round == current_round)%&amp;gt;&lt;br /&gt;
  &amp;lt;td&amp;gt;&lt;br /&gt;
  &amp;lt;% if (!@latest_response.is_submitted) %&amp;gt;&lt;br /&gt;
    &amp;lt;%= link_to &amp;quot;Edit&amp;quot;, {:controller =&amp;gt; 'response', :action =&amp;gt; 'edit', :id =&amp;gt; @latest_response.id} %&amp;gt;&lt;br /&gt;
  &amp;lt;%end%&amp;gt;&lt;br /&gt;
  &amp;lt;/td&amp;gt;&lt;br /&gt;
&amp;lt;% else %&amp;gt;&lt;br /&gt;
  &amp;lt;td&amp;gt;&lt;br /&gt;
  &amp;lt;%= link_to &amp;quot;Update&amp;quot;, {:controller =&amp;gt; 'response', :action =&amp;gt; 'new', :id =&amp;gt; map.map_id} %&amp;gt;&lt;br /&gt;
  &amp;lt;/td&amp;gt;&lt;br /&gt;
&amp;lt;% end %&amp;gt;&lt;br /&gt;
&amp;lt;/pre&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;pre&amp;gt;&lt;br /&gt;
&amp;lt;% if (last_response_round == current_round)%&amp;gt;&lt;br /&gt;
  &amp;lt;td&amp;gt;&lt;br /&gt;
  &amp;lt;% if (!@latest_response.is_submitted) %&amp;gt;&lt;br /&gt;
    &amp;lt;%= link_to &amp;quot;Edit&amp;quot;, {:controller =&amp;gt; 'response', :action =&amp;gt; 'edit', :id =&amp;gt; @latest_response.id} %&amp;gt;&lt;br /&gt;
  &amp;lt;% else %&amp;gt;&lt;br /&gt;
    &amp;lt;%= link_to &amp;quot;Update&amp;quot;, {:controller =&amp;gt; 'response', :action =&amp;gt; 'edit', :id =&amp;gt; @latest_response.id} %&amp;gt;&lt;br /&gt;
  &amp;lt;%end%&amp;gt;&lt;br /&gt;
  &amp;lt;/td&amp;gt;&lt;br /&gt;
&amp;lt;% else %&amp;gt;&lt;br /&gt;
  &amp;lt;td&amp;gt;&lt;br /&gt;
  &amp;lt;%= link_to &amp;quot;Update&amp;quot;, {:controller =&amp;gt; 'response', :action =&amp;gt; 'new', :id =&amp;gt; map.map_id} %&amp;gt;&lt;br /&gt;
  &amp;lt;/td&amp;gt;&lt;br /&gt;
&amp;lt;% end %&amp;gt;&lt;br /&gt;
&amp;lt;/pre&amp;gt;&lt;br /&gt;
&lt;br /&gt;
:'''2)''' ''app/views/response/response.html.erb'' - update confirmation message&lt;br /&gt;
&lt;br /&gt;
&amp;lt;pre&amp;gt; &lt;br /&gt;
if(!confirm('Once a review has been submitted, you cannot edit it again')){&lt;br /&gt;
  e.preventDefault();&lt;br /&gt;
  e.stopPropagation();&lt;br /&gt;
  return;&lt;br /&gt;
}else{&lt;br /&gt;
  jQuery('#isSubmit').val('Yes');&lt;br /&gt;
  window.location.href= &amp;quot;../../../student_review/list?id=&amp;lt;%= @map.reviewer.id %&amp;gt;&amp;quot;;&lt;br /&gt;
}&lt;br /&gt;
&amp;lt;/pre&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;pre&amp;gt;&lt;br /&gt;
if(!confirm('Are you sure you would like to Submit?')){&lt;br /&gt;
  e.preventDefault();&lt;br /&gt;
  e.stopPropagation();&lt;br /&gt;
  return;&lt;br /&gt;
}else{&lt;br /&gt;
  jQuery('#isSubmit').val('Yes');&lt;br /&gt;
  window.location.href= &amp;quot;../../../student_review/list?id=&amp;lt;%= @map.reviewer.id %&amp;gt;&amp;quot;;&lt;br /&gt;
}&lt;br /&gt;
&amp;lt;/pre&amp;gt;&lt;br /&gt;
&lt;br /&gt;
:'''3)''' ''app/controllers/response_controller.rb'' - commented out line 14 that returned false if the response was submitted because we no longer need the value of this attribute&lt;br /&gt;
&amp;lt;pre&amp;gt;&lt;br /&gt;
when 'edit' # If response has been submitted, no further editing allowed&lt;br /&gt;
  return false if response.is_submitted&lt;br /&gt;
  return current_user_id?(user_id)&lt;br /&gt;
  # Deny access to anyone except reviewer &amp;amp; author's team&lt;br /&gt;
&amp;lt;/pre&amp;gt;&lt;br /&gt;
&amp;lt;pre&amp;gt; &lt;br /&gt;
when 'edit' # If response has been submitted, no further editing allowed&lt;br /&gt;
  #return false if response.is_submitted&lt;br /&gt;
  return current_user_id?(user_id)&lt;br /&gt;
  # Deny access to anyone except reviewer &amp;amp; author's team&lt;br /&gt;
&amp;lt;/pre&amp;gt;&lt;br /&gt;
&lt;br /&gt;
:*Required Updates to ''spec/controllers/response_controller_spec.rb''&lt;br /&gt;
::- The test to verify the restricted nature of editing a submitted review was removed as this restriction no longer applies. This testcase can be found on line 33 of the rspec test file.&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*As no attempt to reproduce this issue were not successful, After discussing with Dr.Gehringer we realized that issue is not reproducible. Hence marking this issue as not reproducible&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:* As no attempts to reproduce the stated issue were successful, no solution to this problem can be proposed. In the [https://github.com/expertiza/expertiza/issues/972 Github Bug Report] there is a reference to a similar [https://github.com/expertiza/expertiza/pull/1033 Github Bug Report] that encompasses this same issue that has been marked ''closed''. For the purposed of this project, testing of this believed fix in the ''update_feedback_assignment_form_attributes'' function of assignments_controller.rb will be tested to ensure correctness. This test has been added to the ''features'' spec folder of Expertiza as ''expertiza/spec/features/assignment_round_adjustment_spec.rb''. A video capture of this feature test has been included in the ''References &amp;amp; Related Links'' section of this wiki.&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:* As no attempts to reproduce the stated issue were successful, no solution to this problem can be proposed. Upon further exploration of the view file ''view_team.html.erb'', it was found that a [https://github.com/expertiza/expertiza/commit/bc09d3d6e2e4572614549a6b35161b65b9850df6#diff-4206b1581c5808c1e3148c42f7ef46f8 patch] was introduced to fix this bug by assuring that the html was rendered safely.Because this bug was already fixed prior to the distribution of our project, no further action is needed to address the issue. This action has been confirmed by Dr. Gehringer on Novemebr 27,2018. A video capture of this manual test has been included in the ''References &amp;amp; Related Links'' section of this wiki.&lt;br /&gt;
&lt;br /&gt;
== '''Testing Plan''' ==&lt;br /&gt;
''Testing Plan will be implemented upon the discovery of fixed bugs described in the project document as a means of verifying the fix.''&lt;br /&gt;
&lt;br /&gt;
To ensure correctness of bug fixes following test plan was implemented:&lt;br /&gt;
:* Problem 1 : Issue #1093&lt;br /&gt;
::- ''No Testing Required - Bug not Reproducible''&lt;br /&gt;
:* Problem 2 : Issue #1097 &lt;br /&gt;
::- Verify that upon submission of the review, the reviewer maintains an option to &amp;quot;update&amp;quot; the review until review deadline ends&lt;br /&gt;
:* Problem 3 : Issue #1029&lt;br /&gt;
::- ''No Testing Required - Bug not Reproducible''&lt;br /&gt;
:* Problem 4 : Issue #927&lt;br /&gt;
::- Verify assignment holds the number of review rounds value &lt;br /&gt;
::- Verify that the increasing number of review rounds after creating the assignment saves successfully and the new value is retained &lt;br /&gt;
::- Verify that the decreasing number of review rounds after creating the assignment saves successfully and the new value is retained &lt;br /&gt;
:* Problem 5 : Issue #1142&lt;br /&gt;
::- Verify that when user views score review comments rendered as processed HTML only(there should not be any rendered HTML tags)&lt;br /&gt;
:&lt;br /&gt;
:* The setup for testing both problems 2 &amp;amp; 5 is complex as there are many necessary associations and procedures that are required to achieve the appropriate testing state. Assuming that a sufficient setup is achieved, a feature test for Issue 2 would simulate logging in as a student, visiting the ''Others Work'' page and submitting a review submission which would allow for the verification that an option to update his or her review is available, upon returning to the student assignment page. Further, a feature test for Issue 5 would simulate logging in as a student, visiting the ''Your Scores'' page, where he or she would be able to hover over a response link to validate the comment rendering.&lt;br /&gt;
:* The follow is a list of several suitable models and possible relationships:&lt;br /&gt;
::- Models:&lt;br /&gt;
:::* Course&lt;br /&gt;
:::* Assignment&lt;br /&gt;
:::* Assignment_Mapping&lt;br /&gt;
:::* Response Questionnaire&lt;br /&gt;
:::* Review_Mapping&lt;br /&gt;
:::* Response&lt;br /&gt;
:::* Team&lt;br /&gt;
:::* Topic&lt;br /&gt;
:::* Participants - reviewer &amp;amp; reviewee&lt;br /&gt;
:::* Submission&lt;br /&gt;
::- Relationships:&lt;br /&gt;
:::* A course must contain participants and assignments&lt;br /&gt;
:::* An assignment must be associated with participants and response questionnaires&lt;br /&gt;
:::* A response questionnaire must be associated with participants and responses&lt;br /&gt;
:::* It is also required that a reviewee submit an assignment to then be reviewed by a reviewer.&lt;br /&gt;
&lt;br /&gt;
== '''References &amp;amp; Related Links''' ==&lt;br /&gt;
&lt;br /&gt;
:*Accompanying Videos for Issues and Testing:&lt;br /&gt;
::-[Problem 1 : Issue #1093]: Replication Attempts &amp;lt;-- insert video link here&lt;br /&gt;
::-[https://youtu.be/9G1KWT5ohOM Problem 2 : Issue #1097]: Run of Manual Test&lt;br /&gt;
::-[Problem 3 : Issue #1029]: Replication Attempts &amp;lt;-- insert video link here&lt;br /&gt;
::-[https://drive.google.com/file/d/1wfurtDj8UuyjSyutFJmLptlyoz56p7jv/view?usp=sharing Problem 4 : Issue #927]: Run of Feature Test&lt;br /&gt;
::-[https://drive.google.com/file/d/1laFnMFBoTznsQ2QSh5TJfp7R5KQd6kuf/view?usp=sharing Problem 5 : Issue #1142]: Run of Manual Test&lt;br /&gt;
:*Project Links &lt;br /&gt;
::-Project Screencast &amp;lt;-- insert video link here&lt;br /&gt;
::-[https://github.com/expertiza/expertiza/pull/1312# Pull request]&lt;br /&gt;
::-[https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit# Project Document]&lt;br /&gt;
::-[https://www.youtube.com/watch?v=CaUOA2WLsOY&amp;amp;list=PLfg44kGPNXFMb72Wnb9BD81h3HHYZDvjJ/edit# Tutorial videos on creating assignments]&lt;br /&gt;
::-[https://github.com/Manjunath-gaonkar/expertiza GitHub]: Forked Repository&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120961</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120961"/>
		<updated>2018-12-05T08:00:58Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* References &amp;amp; Related Links */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Project Introduction &amp;amp; Motivation''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
Expertiza Project : E1864 ‘Issues Related to Reviewing' is intended to fix five known issues in the current Expertiza Version related to reviewing student work. Issues are centered around peer reviewing and assignment feature calibration. The motivation behind this project is to identify and resolve each bug in an attempt to improve the current system version. The project has been divided into required fixes. Four of the five problems are presented in ''Figure 1 - Application Flow Diagram'' below. This image is a general representation describing when each of the issues is encountered during a user session. Problem 5 (Issue # 1142) is not present in this figure as the problem is simply associated with the coding of a view file and not directly connected to the flow of students and reviews. Additional discussion on proposed approaches to meet the requirements are explained in subsequent sections.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:FlowDiagram.PNG]]&lt;br /&gt;
::::::'''Figure 1 - Application Flow Diagram'''&lt;br /&gt;
::::::-----------------------------------------------&lt;br /&gt;
&lt;br /&gt;
== '''UML diagram for reviw''' ==&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig2_uml.PNG]]&lt;br /&gt;
'''Actors''':&lt;br /&gt;
&lt;br /&gt;
:*Instructor - This actor is responsible for creating assignments and adding students to the assignment.&lt;br /&gt;
:*Student - This actor is responsible for submitting, reviewing other students work.&lt;br /&gt;
&lt;br /&gt;
'''Database''':&lt;br /&gt;
&lt;br /&gt;
:*The database where all the data of Expertiza is getting stored.&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statements &amp;amp; Descriptions''' ==&lt;br /&gt;
&lt;br /&gt;
For this project, we have been asked to fix the follow bugs that have been found in the current Expertiza system :&lt;br /&gt;
=== Problem 1 : Issue #1093 ===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
:*Example : The project name for which the review was performed earlier should not appear for the next list of reviews when a student requests a review to perform. This could lead to students reviewing the same project more than once and the requirement is to review different projects each time. &lt;br /&gt;
 &lt;br /&gt;
&lt;br /&gt;
:::::[[File:Fig_3.PNG]]&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1093:'''&lt;br /&gt;
Figure 1 gives the holistic view on stages in which we see the issues. In this part, we will discuss the exact steps that need to be followed to reproduce the bugs.&lt;br /&gt;
:* Login as Instructor Create new assignment and associate to the course as shown in Figure 4&lt;br /&gt;
:* Add a participant to the assignment. there are two ways to do this in bulk first way is importing all the course participants to assignment . second approach is creating a file containing student details and import them to expertiza &lt;br /&gt;
:* Create topics and teams in expertiza either entering them one by one or from the file &lt;br /&gt;
:* In actual implementation topic association to the teams involves bidding process but for ease of use, we let instructor assign the topic (Figure 5). set min and max number of reviews allowed as shown in &lt;br /&gt;
:* Set the rubrics and number of review rounds (min one round is needed) (Figure 6)&lt;br /&gt;
:* Review assignment should be automatic not instructor controlled(scope of the stated issue is here) as shown in Figure 7&lt;br /&gt;
:* Set the deadlines for submission and review (shown in Figure 8)&lt;br /&gt;
:* Login as a student and submit work(this needs to be done for each team), request for review&lt;br /&gt;
:* If the issue persist system assign the same topic to review multiple times(as shown in Figure2).difficulty with this problem is that its reproducibility factor which is very low.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:p1_p1.PNG]]&lt;br /&gt;
:::::[[File:p1_p2.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
:*Example : When the reviewer submits a review for a project, the reviewer cannot edit/ update his review again. Before submitting it says &amp;quot;Once submitted, the review cannot be changed again&amp;quot;. After clicking yes the reviewer is only able to view his reviews and not update even before the deadline.  &lt;br /&gt;
This situation can occur in the following scenario. When a reviewer submits the review-1 a few minutes after the deadline, the rubric for review 2 occurs. So the review done for the first round actually becomes review for round 2. Hence the reviewer would not be able to update this review. In situations like these, updating the submitted review becomes useful.&lt;br /&gt;
&lt;br /&gt;
Steps to reproduce the issue:&lt;br /&gt;
*Initial steps to reproduce this problem is same as the issue #1093&lt;br /&gt;
*Change the deadlines for the review to a few days after the present date and check if you are able to update the review. The picture shows deadline to submit is after 14 days. But the reviews are only able to be viewed. &lt;br /&gt;
:::::[[File:p2_p1_redo.PNG]]&lt;br /&gt;
:::::[[File:p2_p2_redo.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
:*Example : An author of a project has submitted his/her assignment to Expertiza. When a reviewer tries to review the work, sometimes it happens that the system shows the reviewer that the work has not been submitted yet. The reviewer should have been shown the work of the author to review.&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1029:'''&lt;br /&gt;
:* steps to reproduce this issue is similar to issue #1093, only the difference is once reviewer requests the assignment to review system throws a message saying there is no work has been submitted even though there is actually submitted work. This issue is not always reproducible&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
:*Example : An instructor attempts to edit an existing assignment and change the number of review rounds. The reassignment causes an error in the system and this prevents the project update to occur.&lt;br /&gt;
'''Steps to reproduce the Issue #972 :'''&lt;br /&gt;
:*The [https://github.com/expertiza/expertiza/issues/972 Github Bug Report] states that ''&amp;quot;You can change the # of rounds from 1 to 2. You can then change the # of rounds back to 1, and the assignment will appear to be saved with one round of review. But if you edit it again, the 2 rounds will still be present.&amp;quot;'' Several attempts to reproduce this issue were made. Below are two of such test cases.&lt;br /&gt;
::- '''Test Case 1''' : Increment beyond current number of rounds then decrements back to the original assigned number of rounds for an existing assignment.&lt;br /&gt;
:::*Step 1 - Log in as ''instructor6''&lt;br /&gt;
:::*Step 2 - Go to the ''Manage Courses'' page and select - ''CSC 517 Spring 2015''&lt;br /&gt;
:::*Step 3 - Select the ''Edit'' option for - ''Final projects''&lt;br /&gt;
:::*Step 4 - Select the ''due dates'' tab as seen in figure 12&lt;br /&gt;
:::*Step 5a - Change the number of rounds from 2 to 3&lt;br /&gt;
:::*Step 6 - Press the ''Set'' option&lt;br /&gt;
:::*Step 7a - Select ''Save''&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig12_p4_redo.PNG]]&lt;br /&gt;
:::::[[File:fig13_p4.PNG]]&lt;br /&gt;
&lt;br /&gt;
:::- One can see from Figure 13 that the change in round number is successfully updated and reflected in the tab. To ensure that the assignment was saved correctly, logging out of the user session, steps 1 - 4 were repeated and the previous changes were found to persist.&lt;br /&gt;
&lt;br /&gt;
:::*Step 5b - Change the number of rounds from 3 back to 2&lt;br /&gt;
:::*Step 6 - Press the ''Set'' option&lt;br /&gt;
:::*Step 7b - Select ''Save''&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig14_p4.PNG]]&lt;br /&gt;
&lt;br /&gt;
:::- One can see from Figure 14 that the change in round number is successfully updated and reflected in the tab. To ensure that the assignment was saved correctly, logging out of the user session, steps 1 - 4 were repeated and the previous changes were found to persist.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
::- '''Test Case 2''' : Decrement below current number of rounds an existing assignment with submissions.&lt;br /&gt;
:::*Step 1 - Log in as ''instructor6''&lt;br /&gt;
:::*Step 2 - Go to the ''Manage Courses'' page and select - ''CSC 517 Spring 2016''&lt;br /&gt;
:::*Step 3 - Select the ''Edit'' option for - ''Program 1: Class portal''&lt;br /&gt;
:::*Step 4 - Select the ''due dates'' tab as seen in figure 12&lt;br /&gt;
:::*Step 5a - Change the number of rounds from 2 to 1&lt;br /&gt;
:::*Step 6 - Press the ''Set'' option&lt;br /&gt;
:::*Step 7 - Confirm the reduction below the current number of rounds&lt;br /&gt;
:::*Step 8 - Press ''OK'' to exit the notification popup&lt;br /&gt;
::::''Addition steps 6-8 can be seen in Figure 15 below.''&lt;br /&gt;
:::*Step 7a - Select ''Save''&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig15_p4.PNG]]&lt;br /&gt;
:::::[[File:fig16_p4.PNG]]&lt;br /&gt;
&lt;br /&gt;
:::- One can see from Figure 16 that the change in round number is successfully updated and reflected in the tab. To ensure that the assignment was saved correctly, logging out of the user session, steps 1 - 4 were repeated and the previous changes were found to persist.&lt;br /&gt;
&lt;br /&gt;
:*Several similar tests were conducted in an attempt to reproduce this issue; however, none were successful.&lt;br /&gt;
:*'''Unstated Issue''': there is an issue that arises from the reduction of rounds for assignments that currently contain submissions. After the udpate, When an current student attempts to go and review his/her scores, this causes a ''NoMethodError in Grades#view_team''. A bug should be created for this issue for another round of project issues.&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:*''“Summary Result Assignment” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
:*Example : As seen in Figure 17 below, the result of hovering over a review result displays the message in raw HTML. The intended result is for review comment to be rendered properly while displaying.&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig_17_p5.PNG]]&lt;br /&gt;
::::::''Figure 17 was taken from the actual deployed version of Expertiza through a person student account.''&lt;br /&gt;
&lt;br /&gt;
::-'''Test Case 1''' :  Hover for Reviewer Comment&lt;br /&gt;
:::*Step 1 - Log in as instructor6&lt;br /&gt;
:::*Step 2 - Select ''Manage'' and ''Impersonate User''&lt;br /&gt;
:::*Step 3 - Impersonate ''student6370''&lt;br /&gt;
:::*Step 4 - Selec ''OSS project/Writing assignment 2'' &lt;br /&gt;
:::*Step 5 - Hover over any underlined review score&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig_18_p5.PNG]]&lt;br /&gt;
::::::''Figure 18 was taken from the development version of Expertiza through the test case steps mentioned above.''&lt;br /&gt;
&lt;br /&gt;
:*After testing and research into this issue, it has been determined that the issue has been adjusted in the development image and has not yet been merged with the deployed version.&lt;br /&gt;
&lt;br /&gt;
== '''Files to be Modified''' ==&lt;br /&gt;
&lt;br /&gt;
:*''app/views/student_review/_responses.html.erb''&lt;br /&gt;
:*''app/views/response/response.html.erb''&lt;br /&gt;
:*''app/controllers/response_controller.rb''&lt;br /&gt;
:*''spec/controllers/response_controller_spec.rb''&lt;br /&gt;
:*''spec/features/assignment_round_adjustment.rb''&lt;br /&gt;
&lt;br /&gt;
== '''Solution Design''' ==&lt;br /&gt;
=== Problem 1 : Issue # 1093 ===&lt;br /&gt;
:* Several attempts have been made to reproduce this problem. We tested with both old and latest database but the issue did not reproduce.&lt;br /&gt;
:* We also tried with creating a new assignment, adding participants to the assignment, assign reviews to the student then logging in as student and request for a topic to review even with this issue did not reproduce &lt;br /&gt;
:* After discussing with mentor and Dr.Gehringer we are marking this issue as not reproducible&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*To solve this problem we will edit code in ''app/views/student_review/_responses.html.erb'', ''app/views/response/response.html.erb'', and ''app/controllers/response_controller.rb'' to enable a reviewer to update the review until the round deadline. We will also remove the confirmation message &amp;quot;Once submitted, it cannot be changed again&amp;quot; before the deadline to appropriate reflect this edit. &lt;br /&gt;
:*Once these changes have been made, the new view will be reflected as seen in the figure below.&lt;br /&gt;
&lt;br /&gt;
:::::[[File: P2 sol.PNG]]&lt;br /&gt;
:::::-The reviewer now has the option to both view and update their submitted reviews multiple times before the round deadline This is in contrast to the previous build where the reviewer could only 'view' their submission.&lt;br /&gt;
&lt;br /&gt;
:'''1)''' ''app/views/student_review/_responses.html.erb'' - added a condition such that a user is allowed to update a review even after submission.&lt;br /&gt;
&amp;lt;pre&amp;gt;&lt;br /&gt;
&amp;lt;% if (last_response_round == current_round)%&amp;gt;&lt;br /&gt;
  &amp;lt;td&amp;gt;&lt;br /&gt;
  &amp;lt;% if (!@latest_response.is_submitted) %&amp;gt;&lt;br /&gt;
    &amp;lt;%= link_to &amp;quot;Edit&amp;quot;, {:controller =&amp;gt; 'response', :action =&amp;gt; 'edit', :id =&amp;gt; @latest_response.id} %&amp;gt;&lt;br /&gt;
  &amp;lt;%end%&amp;gt;&lt;br /&gt;
  &amp;lt;/td&amp;gt;&lt;br /&gt;
&amp;lt;% else %&amp;gt;&lt;br /&gt;
  &amp;lt;td&amp;gt;&lt;br /&gt;
  &amp;lt;%= link_to &amp;quot;Update&amp;quot;, {:controller =&amp;gt; 'response', :action =&amp;gt; 'new', :id =&amp;gt; map.map_id} %&amp;gt;&lt;br /&gt;
  &amp;lt;/td&amp;gt;&lt;br /&gt;
&amp;lt;% end %&amp;gt;&lt;br /&gt;
&amp;lt;/pre&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;pre&amp;gt;&lt;br /&gt;
&amp;lt;% if (last_response_round == current_round)%&amp;gt;&lt;br /&gt;
  &amp;lt;td&amp;gt;&lt;br /&gt;
  &amp;lt;% if (!@latest_response.is_submitted) %&amp;gt;&lt;br /&gt;
    &amp;lt;%= link_to &amp;quot;Edit&amp;quot;, {:controller =&amp;gt; 'response', :action =&amp;gt; 'edit', :id =&amp;gt; @latest_response.id} %&amp;gt;&lt;br /&gt;
  &amp;lt;% else %&amp;gt;&lt;br /&gt;
    &amp;lt;%= link_to &amp;quot;Update&amp;quot;, {:controller =&amp;gt; 'response', :action =&amp;gt; 'edit', :id =&amp;gt; @latest_response.id} %&amp;gt;&lt;br /&gt;
  &amp;lt;%end%&amp;gt;&lt;br /&gt;
  &amp;lt;/td&amp;gt;&lt;br /&gt;
&amp;lt;% else %&amp;gt;&lt;br /&gt;
  &amp;lt;td&amp;gt;&lt;br /&gt;
  &amp;lt;%= link_to &amp;quot;Update&amp;quot;, {:controller =&amp;gt; 'response', :action =&amp;gt; 'new', :id =&amp;gt; map.map_id} %&amp;gt;&lt;br /&gt;
  &amp;lt;/td&amp;gt;&lt;br /&gt;
&amp;lt;% end %&amp;gt;&lt;br /&gt;
&amp;lt;/pre&amp;gt;&lt;br /&gt;
&lt;br /&gt;
:'''2)''' ''app/views/response/response.html.erb'' - update confirmation message&lt;br /&gt;
&lt;br /&gt;
&amp;lt;pre&amp;gt; &lt;br /&gt;
if(!confirm('Once a review has been submitted, you cannot edit it again')){&lt;br /&gt;
  e.preventDefault();&lt;br /&gt;
  e.stopPropagation();&lt;br /&gt;
  return;&lt;br /&gt;
}else{&lt;br /&gt;
  jQuery('#isSubmit').val('Yes');&lt;br /&gt;
  window.location.href= &amp;quot;../../../student_review/list?id=&amp;lt;%= @map.reviewer.id %&amp;gt;&amp;quot;;&lt;br /&gt;
}&lt;br /&gt;
&amp;lt;/pre&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;pre&amp;gt;&lt;br /&gt;
if(!confirm('Are you sure you would like to Submit?')){&lt;br /&gt;
  e.preventDefault();&lt;br /&gt;
  e.stopPropagation();&lt;br /&gt;
  return;&lt;br /&gt;
}else{&lt;br /&gt;
  jQuery('#isSubmit').val('Yes');&lt;br /&gt;
  window.location.href= &amp;quot;../../../student_review/list?id=&amp;lt;%= @map.reviewer.id %&amp;gt;&amp;quot;;&lt;br /&gt;
}&lt;br /&gt;
&amp;lt;/pre&amp;gt;&lt;br /&gt;
&lt;br /&gt;
:'''3)''' ''app/controllers/response_controller.rb'' - commented out line 14 that returned false if the response was submitted because we no longer need the value of this attribute&lt;br /&gt;
&amp;lt;pre&amp;gt;&lt;br /&gt;
when 'edit' # If response has been submitted, no further editing allowed&lt;br /&gt;
  return false if response.is_submitted&lt;br /&gt;
  return current_user_id?(user_id)&lt;br /&gt;
  # Deny access to anyone except reviewer &amp;amp; author's team&lt;br /&gt;
&amp;lt;/pre&amp;gt;&lt;br /&gt;
&amp;lt;pre&amp;gt; &lt;br /&gt;
when 'edit' # If response has been submitted, no further editing allowed&lt;br /&gt;
  #return false if response.is_submitted&lt;br /&gt;
  return current_user_id?(user_id)&lt;br /&gt;
  # Deny access to anyone except reviewer &amp;amp; author's team&lt;br /&gt;
&amp;lt;/pre&amp;gt;&lt;br /&gt;
&lt;br /&gt;
:*Required Updates to ''spec/controllers/response_controller_spec.rb''&lt;br /&gt;
::- The test to verify the restricted nature of editing a submitted review was removed as this restriction no longer applies. This testcase can be found on line 33 of the rspec test file.&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*As no attempt to reproduce this issue were not successful, After discussing with Dr.Gehringer we realized that issue is not reproducible. Hence marking this issue as not reproducible&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:* As no attempts to reproduce the stated issue were successful, no solution to this problem can be proposed. In the [https://github.com/expertiza/expertiza/issues/972 Github Bug Report] there is a reference to a similar [https://github.com/expertiza/expertiza/pull/1033 Github Bug Report] that encompasses this same issue that has been marked ''closed''. For the purposed of this project, testing of this believed fix in the ''update_feedback_assignment_form_attributes'' function of assignments_controller.rb will be tested to ensure correctness. This test has been added to the ''features'' spec folder of Expertiza as ''expertiza/spec/features/assignment_round_adjustment_spec.rb''. A video capture of this feature test has been included in the ''References &amp;amp; Related Links'' section of this wiki.&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:* As no attempts to reproduce the stated issue were successful, no solution to this problem can be proposed. Upon further exploration of the view file ''view_team.html.erb'', it was found that a [https://github.com/expertiza/expertiza/commit/bc09d3d6e2e4572614549a6b35161b65b9850df6#diff-4206b1581c5808c1e3148c42f7ef46f8 patch] was introduced to fix this bug by assuring that the html was rendered safely.Because this bug was already fixed prior to the distribution of our project, no further action is needed to address the issue. This action has been confirmed by Dr. Gehringer on Novemebr 27,2018. A video capture of this manual test has been included in the ''References &amp;amp; Related Links'' section of this wiki.&lt;br /&gt;
&lt;br /&gt;
== '''Testing Plan''' ==&lt;br /&gt;
''Testing Plan will be implemented upon the discovery of fixed bugs described in the project document as a means of verifying the fix.''&lt;br /&gt;
&lt;br /&gt;
To ensure correctness of bug fixes following test plan was implemented:&lt;br /&gt;
:* Problem 1 : Issue #1093&lt;br /&gt;
::- ''No Testing Required - Bug not Reproducible''&lt;br /&gt;
:* Problem 2 : Issue #1097 &lt;br /&gt;
::- Verify that upon submission of the review, the reviewer maintains an option to &amp;quot;update&amp;quot; the review until review deadline ends&lt;br /&gt;
:* Problem 3 : Issue #1029&lt;br /&gt;
::- ''No Testing Required - Bug not Reproducible''&lt;br /&gt;
:* Problem 4 : Issue #927&lt;br /&gt;
::- Verify assignment holds the number of review rounds value &lt;br /&gt;
::- Verify that the increasing number of review rounds after creating the assignment saves successfully and the new value is retained &lt;br /&gt;
::- Verify that the decreasing number of review rounds after creating the assignment saves successfully and the new value is retained &lt;br /&gt;
:* Problem 5 : Issue #1142&lt;br /&gt;
::- Verify that when user views score review comments rendered as processed HTML only(there should not be any rendered HTML tags)&lt;br /&gt;
:&lt;br /&gt;
:* The setup for testing both problems 2 &amp;amp; 5 is complex as there are many necessary associations and procedures that are required to achieve the appropriate testing state. Assuming that a sufficient setup is achieved, a feature test for Issue 2 would simulate logging in as a student, visiting the ''Others Work'' page and submitting a review submission which would allow for the verification that an option to update his or her review is available, upon returning to the student assignment page. Further, a feature test for Issue 5 would simulate logging in as a student, visiting the ''Your Scores'' page, where he or she would be able to hover over a response link to validate the comment rendering.&lt;br /&gt;
:* The follow is a list of several suitable models and possible relationships:&lt;br /&gt;
::- Models:&lt;br /&gt;
:::* Course&lt;br /&gt;
:::* Assignment&lt;br /&gt;
:::* Assignment_Mapping&lt;br /&gt;
:::* Response Questionnaire&lt;br /&gt;
:::* Review_Mapping&lt;br /&gt;
:::* Response&lt;br /&gt;
:::* Team&lt;br /&gt;
:::* Topic&lt;br /&gt;
:::* Participants - reviewer &amp;amp; reviewee&lt;br /&gt;
:::* Submission&lt;br /&gt;
::- Relationships:&lt;br /&gt;
:::* A course must contain participants and assignments&lt;br /&gt;
:::* An assignment must be associated with participants and response questionnaires&lt;br /&gt;
:::* A response questionnaire must be associated with participants and responses&lt;br /&gt;
:::* It is also required that a reviewee submit an assignment to then be reviewed by a reviewer.&lt;br /&gt;
&lt;br /&gt;
== '''References &amp;amp; Related Links''' ==&lt;br /&gt;
&lt;br /&gt;
:*Accompanying Videos for Issues and Testing:&lt;br /&gt;
::-[Problem 1 : Issue #1093]: Replication Attempts &amp;lt;-- insert video link here&lt;br /&gt;
::-[https://youtu.be/U2-DGxZOfz0 Problem 2 : Issue #1097]: Run of Manual Test&lt;br /&gt;
::-[Problem 3 : Issue #1029]: Replication Attempts &amp;lt;-- insert video link here&lt;br /&gt;
::-[https://drive.google.com/file/d/1wfurtDj8UuyjSyutFJmLptlyoz56p7jv/view?usp=sharing Problem 4 : Issue #927]: Run of Feature Test&lt;br /&gt;
::-[https://drive.google.com/file/d/1laFnMFBoTznsQ2QSh5TJfp7R5KQd6kuf/view?usp=sharing Problem 5 : Issue #1142]: Run of Manual Test&lt;br /&gt;
:*Project Links &lt;br /&gt;
::-Project Screencast &amp;lt;-- insert video link here&lt;br /&gt;
::-[https://github.com/expertiza/expertiza/pull/1312# Pull request]&lt;br /&gt;
::-[https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit# Project Document]&lt;br /&gt;
::-[https://www.youtube.com/watch?v=CaUOA2WLsOY&amp;amp;list=PLfg44kGPNXFMb72Wnb9BD81h3HHYZDvjJ/edit# Tutorial videos on creating assignments]&lt;br /&gt;
::-[https://github.com/Manjunath-gaonkar/expertiza GitHub]: Forked Repository&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120960</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120960"/>
		<updated>2018-12-05T07:51:32Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* References &amp;amp; Related Links */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Project Introduction &amp;amp; Motivation''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
Expertiza Project : E1864 ‘Issues Related to Reviewing' is intended to fix five known issues in the current Expertiza Version related to reviewing student work. Issues are centered around peer reviewing and assignment feature calibration. The motivation behind this project is to identify and resolve each bug in an attempt to improve the current system version. The project has been divided into required fixes. Four of the five problems are presented in ''Figure 1 - Application Flow Diagram'' below. This image is a general representation describing when each of the issues is encountered during a user session. Problem 5 (Issue # 1142) is not present in this figure as the problem is simply associated with the coding of a view file and not directly connected to the flow of students and reviews. Additional discussion on proposed approaches to meet the requirements are explained in subsequent sections.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:FlowDiagram.PNG]]&lt;br /&gt;
::::::'''Figure 1 - Application Flow Diagram'''&lt;br /&gt;
::::::-----------------------------------------------&lt;br /&gt;
&lt;br /&gt;
== '''UML diagram for reviw''' ==&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig2_uml.PNG]]&lt;br /&gt;
'''Actors''':&lt;br /&gt;
&lt;br /&gt;
:*Instructor - This actor is responsible for creating assignments and adding students to the assignment.&lt;br /&gt;
:*Student - This actor is responsible for submitting, reviewing other students work.&lt;br /&gt;
&lt;br /&gt;
'''Database''':&lt;br /&gt;
&lt;br /&gt;
:*The database where all the data of Expertiza is getting stored.&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statements &amp;amp; Descriptions''' ==&lt;br /&gt;
&lt;br /&gt;
For this project, we have been asked to fix the follow bugs that have been found in the current Expertiza system :&lt;br /&gt;
=== Problem 1 : Issue #1093 ===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
:*Example : The project name for which the review was performed earlier should not appear for the next list of reviews when a student requests a review to perform. This could lead to students reviewing the same project more than once and the requirement is to review different projects each time. &lt;br /&gt;
 &lt;br /&gt;
&lt;br /&gt;
:::::[[File:Fig_3.PNG]]&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1093:'''&lt;br /&gt;
Figure 1 gives the holistic view on stages in which we see the issues. In this part, we will discuss the exact steps that need to be followed to reproduce the bugs.&lt;br /&gt;
:* Login as Instructor Create new assignment and associate to the course as shown in Figure 4&lt;br /&gt;
:* Add a participant to the assignment. there are two ways to do this in bulk first way is importing all the course participants to assignment . second approach is creating a file containing student details and import them to expertiza &lt;br /&gt;
:* Create topics and teams in expertiza either entering them one by one or from the file &lt;br /&gt;
:* In actual implementation topic association to the teams involves bidding process but for ease of use, we let instructor assign the topic (Figure 5). set min and max number of reviews allowed as shown in &lt;br /&gt;
:* Set the rubrics and number of review rounds (min one round is needed) (Figure 6)&lt;br /&gt;
:* Review assignment should be automatic not instructor controlled(scope of the stated issue is here) as shown in Figure 7&lt;br /&gt;
:* Set the deadlines for submission and review (shown in Figure 8)&lt;br /&gt;
:* Login as a student and submit work(this needs to be done for each team), request for review&lt;br /&gt;
:* If the issue persist system assign the same topic to review multiple times(as shown in Figure2).difficulty with this problem is that its reproducibility factor which is very low.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:p1_p1.PNG]]&lt;br /&gt;
:::::[[File:p1_p2.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
:*Example : When the reviewer submits a review for a project, the reviewer cannot edit/ update his review again. Before submitting it says &amp;quot;Once submitted, the review cannot be changed again&amp;quot;. After clicking yes the reviewer is only able to view his reviews and not update even before the deadline.  &lt;br /&gt;
This situation can occur in the following scenario. When a reviewer submits the review-1 a few minutes after the deadline, the rubric for review 2 occurs. So the review done for the first round actually becomes review for round 2. Hence the reviewer would not be able to update this review. In situations like these, updating the submitted review becomes useful.&lt;br /&gt;
&lt;br /&gt;
Steps to reproduce the issue:&lt;br /&gt;
*Initial steps to reproduce this problem is same as the issue #1093&lt;br /&gt;
*Change the deadlines for the review to a few days after the present date and check if you are able to update the review. The picture shows deadline to submit is after 14 days. But the reviews are only able to be viewed. &lt;br /&gt;
:::::[[File:p2_p1_redo.PNG]]&lt;br /&gt;
:::::[[File:p2_p2_redo.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
:*Example : An author of a project has submitted his/her assignment to Expertiza. When a reviewer tries to review the work, sometimes it happens that the system shows the reviewer that the work has not been submitted yet. The reviewer should have been shown the work of the author to review.&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1029:'''&lt;br /&gt;
:* steps to reproduce this issue is similar to issue #1093, only the difference is once reviewer requests the assignment to review system throws a message saying there is no work has been submitted even though there is actually submitted work. This issue is not always reproducible&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
:*Example : An instructor attempts to edit an existing assignment and change the number of review rounds. The reassignment causes an error in the system and this prevents the project update to occur.&lt;br /&gt;
'''Steps to reproduce the Issue #972 :'''&lt;br /&gt;
:*The [https://github.com/expertiza/expertiza/issues/972 Github Bug Report] states that ''&amp;quot;You can change the # of rounds from 1 to 2. You can then change the # of rounds back to 1, and the assignment will appear to be saved with one round of review. But if you edit it again, the 2 rounds will still be present.&amp;quot;'' Several attempts to reproduce this issue were made. Below are two of such test cases.&lt;br /&gt;
::- '''Test Case 1''' : Increment beyond current number of rounds then decrements back to the original assigned number of rounds for an existing assignment.&lt;br /&gt;
:::*Step 1 - Log in as ''instructor6''&lt;br /&gt;
:::*Step 2 - Go to the ''Manage Courses'' page and select - ''CSC 517 Spring 2015''&lt;br /&gt;
:::*Step 3 - Select the ''Edit'' option for - ''Final projects''&lt;br /&gt;
:::*Step 4 - Select the ''due dates'' tab as seen in figure 12&lt;br /&gt;
:::*Step 5a - Change the number of rounds from 2 to 3&lt;br /&gt;
:::*Step 6 - Press the ''Set'' option&lt;br /&gt;
:::*Step 7a - Select ''Save''&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig12_p4_redo.PNG]]&lt;br /&gt;
:::::[[File:fig13_p4.PNG]]&lt;br /&gt;
&lt;br /&gt;
:::- One can see from Figure 13 that the change in round number is successfully updated and reflected in the tab. To ensure that the assignment was saved correctly, logging out of the user session, steps 1 - 4 were repeated and the previous changes were found to persist.&lt;br /&gt;
&lt;br /&gt;
:::*Step 5b - Change the number of rounds from 3 back to 2&lt;br /&gt;
:::*Step 6 - Press the ''Set'' option&lt;br /&gt;
:::*Step 7b - Select ''Save''&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig14_p4.PNG]]&lt;br /&gt;
&lt;br /&gt;
:::- One can see from Figure 14 that the change in round number is successfully updated and reflected in the tab. To ensure that the assignment was saved correctly, logging out of the user session, steps 1 - 4 were repeated and the previous changes were found to persist.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
::- '''Test Case 2''' : Decrement below current number of rounds an existing assignment with submissions.&lt;br /&gt;
:::*Step 1 - Log in as ''instructor6''&lt;br /&gt;
:::*Step 2 - Go to the ''Manage Courses'' page and select - ''CSC 517 Spring 2016''&lt;br /&gt;
:::*Step 3 - Select the ''Edit'' option for - ''Program 1: Class portal''&lt;br /&gt;
:::*Step 4 - Select the ''due dates'' tab as seen in figure 12&lt;br /&gt;
:::*Step 5a - Change the number of rounds from 2 to 1&lt;br /&gt;
:::*Step 6 - Press the ''Set'' option&lt;br /&gt;
:::*Step 7 - Confirm the reduction below the current number of rounds&lt;br /&gt;
:::*Step 8 - Press ''OK'' to exit the notification popup&lt;br /&gt;
::::''Addition steps 6-8 can be seen in Figure 15 below.''&lt;br /&gt;
:::*Step 7a - Select ''Save''&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig15_p4.PNG]]&lt;br /&gt;
:::::[[File:fig16_p4.PNG]]&lt;br /&gt;
&lt;br /&gt;
:::- One can see from Figure 16 that the change in round number is successfully updated and reflected in the tab. To ensure that the assignment was saved correctly, logging out of the user session, steps 1 - 4 were repeated and the previous changes were found to persist.&lt;br /&gt;
&lt;br /&gt;
:*Several similar tests were conducted in an attempt to reproduce this issue; however, none were successful.&lt;br /&gt;
:*'''Unstated Issue''': there is an issue that arises from the reduction of rounds for assignments that currently contain submissions. After the udpate, When an current student attempts to go and review his/her scores, this causes a ''NoMethodError in Grades#view_team''. A bug should be created for this issue for another round of project issues.&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:*''“Summary Result Assignment” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
:*Example : As seen in Figure 17 below, the result of hovering over a review result displays the message in raw HTML. The intended result is for review comment to be rendered properly while displaying.&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig_17_p5.PNG]]&lt;br /&gt;
::::::''Figure 17 was taken from the actual deployed version of Expertiza through a person student account.''&lt;br /&gt;
&lt;br /&gt;
::-'''Test Case 1''' :  Hover for Reviewer Comment&lt;br /&gt;
:::*Step 1 - Log in as instructor6&lt;br /&gt;
:::*Step 2 - Select ''Manage'' and ''Impersonate User''&lt;br /&gt;
:::*Step 3 - Impersonate ''student6370''&lt;br /&gt;
:::*Step 4 - Selec ''OSS project/Writing assignment 2'' &lt;br /&gt;
:::*Step 5 - Hover over any underlined review score&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig_18_p5.PNG]]&lt;br /&gt;
::::::''Figure 18 was taken from the development version of Expertiza through the test case steps mentioned above.''&lt;br /&gt;
&lt;br /&gt;
:*After testing and research into this issue, it has been determined that the issue has been adjusted in the development image and has not yet been merged with the deployed version.&lt;br /&gt;
&lt;br /&gt;
== '''Files to be Modified''' ==&lt;br /&gt;
&lt;br /&gt;
:*''app/views/student_review/_responses.html.erb''&lt;br /&gt;
:*''app/views/response/response.html.erb''&lt;br /&gt;
:*''app/controllers/response_controller.rb''&lt;br /&gt;
:*''spec/controllers/response_controller_spec.rb''&lt;br /&gt;
:*''spec/features/assignment_round_adjustment.rb''&lt;br /&gt;
&lt;br /&gt;
== '''Solution Design''' ==&lt;br /&gt;
=== Problem 1 : Issue # 1093 ===&lt;br /&gt;
:* Several attempts have been made to reproduce this problem. We tested with both old and latest database but the issue did not reproduce.&lt;br /&gt;
:* We also tried with creating a new assignment, adding participants to the assignment, assign reviews to the student then logging in as student and request for a topic to review even with this issue did not reproduce &lt;br /&gt;
:* After discussing with mentor and Dr.Gehringer we are marking this issue as not reproducible&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*To solve this problem we will edit code in ''app/views/student_review/_responses.html.erb'', ''app/views/response/response.html.erb'', and ''app/controllers/response_controller.rb'' to enable a reviewer to update the review until the round deadline. We will also remove the confirmation message &amp;quot;Once submitted, it cannot be changed again&amp;quot; before the deadline to appropriate reflect this edit. &lt;br /&gt;
:*Once these changes have been made, the new view will be reflected as seen in the figure below.&lt;br /&gt;
&lt;br /&gt;
:::::[[File: P2 sol.PNG]]&lt;br /&gt;
:::::-The reviewer now has the option to both view and update their submitted reviews multiple times before the round deadline This is in contrast to the previous build where the reviewer could only 'view' their submission.&lt;br /&gt;
&lt;br /&gt;
:'''1)''' ''app/views/student_review/_responses.html.erb'' - added a condition such that a user is allowed to update a review even after submission.&lt;br /&gt;
&amp;lt;pre&amp;gt;&lt;br /&gt;
&amp;lt;% if (last_response_round == current_round)%&amp;gt;&lt;br /&gt;
  &amp;lt;td&amp;gt;&lt;br /&gt;
  &amp;lt;% if (!@latest_response.is_submitted) %&amp;gt;&lt;br /&gt;
    &amp;lt;%= link_to &amp;quot;Edit&amp;quot;, {:controller =&amp;gt; 'response', :action =&amp;gt; 'edit', :id =&amp;gt; @latest_response.id} %&amp;gt;&lt;br /&gt;
  &amp;lt;%end%&amp;gt;&lt;br /&gt;
  &amp;lt;/td&amp;gt;&lt;br /&gt;
&amp;lt;% else %&amp;gt;&lt;br /&gt;
  &amp;lt;td&amp;gt;&lt;br /&gt;
  &amp;lt;%= link_to &amp;quot;Update&amp;quot;, {:controller =&amp;gt; 'response', :action =&amp;gt; 'new', :id =&amp;gt; map.map_id} %&amp;gt;&lt;br /&gt;
  &amp;lt;/td&amp;gt;&lt;br /&gt;
&amp;lt;% end %&amp;gt;&lt;br /&gt;
&amp;lt;/pre&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;pre&amp;gt;&lt;br /&gt;
&amp;lt;% if (last_response_round == current_round)%&amp;gt;&lt;br /&gt;
  &amp;lt;td&amp;gt;&lt;br /&gt;
  &amp;lt;% if (!@latest_response.is_submitted) %&amp;gt;&lt;br /&gt;
    &amp;lt;%= link_to &amp;quot;Edit&amp;quot;, {:controller =&amp;gt; 'response', :action =&amp;gt; 'edit', :id =&amp;gt; @latest_response.id} %&amp;gt;&lt;br /&gt;
  &amp;lt;% else %&amp;gt;&lt;br /&gt;
    &amp;lt;%= link_to &amp;quot;Update&amp;quot;, {:controller =&amp;gt; 'response', :action =&amp;gt; 'edit', :id =&amp;gt; @latest_response.id} %&amp;gt;&lt;br /&gt;
  &amp;lt;%end%&amp;gt;&lt;br /&gt;
  &amp;lt;/td&amp;gt;&lt;br /&gt;
&amp;lt;% else %&amp;gt;&lt;br /&gt;
  &amp;lt;td&amp;gt;&lt;br /&gt;
  &amp;lt;%= link_to &amp;quot;Update&amp;quot;, {:controller =&amp;gt; 'response', :action =&amp;gt; 'new', :id =&amp;gt; map.map_id} %&amp;gt;&lt;br /&gt;
  &amp;lt;/td&amp;gt;&lt;br /&gt;
&amp;lt;% end %&amp;gt;&lt;br /&gt;
&amp;lt;/pre&amp;gt;&lt;br /&gt;
&lt;br /&gt;
:'''2)''' ''app/views/response/response.html.erb'' - update confirmation message&lt;br /&gt;
&lt;br /&gt;
&amp;lt;pre&amp;gt; &lt;br /&gt;
if(!confirm('Once a review has been submitted, you cannot edit it again')){&lt;br /&gt;
  e.preventDefault();&lt;br /&gt;
  e.stopPropagation();&lt;br /&gt;
  return;&lt;br /&gt;
}else{&lt;br /&gt;
  jQuery('#isSubmit').val('Yes');&lt;br /&gt;
  window.location.href= &amp;quot;../../../student_review/list?id=&amp;lt;%= @map.reviewer.id %&amp;gt;&amp;quot;;&lt;br /&gt;
}&lt;br /&gt;
&amp;lt;/pre&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;pre&amp;gt;&lt;br /&gt;
if(!confirm('Are you sure you would like to Submit?')){&lt;br /&gt;
  e.preventDefault();&lt;br /&gt;
  e.stopPropagation();&lt;br /&gt;
  return;&lt;br /&gt;
}else{&lt;br /&gt;
  jQuery('#isSubmit').val('Yes');&lt;br /&gt;
  window.location.href= &amp;quot;../../../student_review/list?id=&amp;lt;%= @map.reviewer.id %&amp;gt;&amp;quot;;&lt;br /&gt;
}&lt;br /&gt;
&amp;lt;/pre&amp;gt;&lt;br /&gt;
&lt;br /&gt;
:'''3)''' ''app/controllers/response_controller.rb'' - commented out line 14 that returned false if the response was submitted because we no longer need the value of this attribute&lt;br /&gt;
&amp;lt;pre&amp;gt;&lt;br /&gt;
when 'edit' # If response has been submitted, no further editing allowed&lt;br /&gt;
  return false if response.is_submitted&lt;br /&gt;
  return current_user_id?(user_id)&lt;br /&gt;
  # Deny access to anyone except reviewer &amp;amp; author's team&lt;br /&gt;
&amp;lt;/pre&amp;gt;&lt;br /&gt;
&amp;lt;pre&amp;gt; &lt;br /&gt;
when 'edit' # If response has been submitted, no further editing allowed&lt;br /&gt;
  #return false if response.is_submitted&lt;br /&gt;
  return current_user_id?(user_id)&lt;br /&gt;
  # Deny access to anyone except reviewer &amp;amp; author's team&lt;br /&gt;
&amp;lt;/pre&amp;gt;&lt;br /&gt;
&lt;br /&gt;
:*Required Updates to ''spec/controllers/response_controller_spec.rb''&lt;br /&gt;
::- The test to verify the restricted nature of editing a submitted review was removed as this restriction no longer applies. This testcase can be found on line 33 of the rspec test file.&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*As no attempt to reproduce this issue were not successful, After discussing with Dr.Gehringer we realized that issue is not reproducible. Hence marking this issue as not reproducible&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:* As no attempts to reproduce the stated issue were successful, no solution to this problem can be proposed. In the [https://github.com/expertiza/expertiza/issues/972 Github Bug Report] there is a reference to a similar [https://github.com/expertiza/expertiza/pull/1033 Github Bug Report] that encompasses this same issue that has been marked ''closed''. For the purposed of this project, testing of this believed fix in the ''update_feedback_assignment_form_attributes'' function of assignments_controller.rb will be tested to ensure correctness. This test has been added to the ''features'' spec folder of Expertiza as ''expertiza/spec/features/assignment_round_adjustment_spec.rb''. A video capture of this feature test has been included in the ''References &amp;amp; Related Links'' section of this wiki.&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:* As no attempts to reproduce the stated issue were successful, no solution to this problem can be proposed. Upon further exploration of the view file ''view_team.html.erb'', it was found that a [https://github.com/expertiza/expertiza/commit/bc09d3d6e2e4572614549a6b35161b65b9850df6#diff-4206b1581c5808c1e3148c42f7ef46f8 patch] was introduced to fix this bug by assuring that the html was rendered safely.Because this bug was already fixed prior to the distribution of our project, no further action is needed to address the issue. This action has been confirmed by Dr. Gehringer on Novemebr 27,2018. A video capture of this manual test has been included in the ''References &amp;amp; Related Links'' section of this wiki.&lt;br /&gt;
&lt;br /&gt;
== '''Testing Plan''' ==&lt;br /&gt;
''Testing Plan will be implemented upon the discovery of fixed bugs described in the project document as a means of verifying the fix.''&lt;br /&gt;
&lt;br /&gt;
To ensure correctness of bug fixes following test plan was implemented:&lt;br /&gt;
:* Problem 1 : Issue #1093&lt;br /&gt;
::- ''No Testing Required - Bug not Reproducible''&lt;br /&gt;
:* Problem 2 : Issue #1097 &lt;br /&gt;
::- Verify that upon submission of the review, the reviewer maintains an option to &amp;quot;update&amp;quot; the review until review deadline ends&lt;br /&gt;
:* Problem 3 : Issue #1029&lt;br /&gt;
::- ''No Testing Required - Bug not Reproducible''&lt;br /&gt;
:* Problem 4 : Issue #927&lt;br /&gt;
::- Verify assignment holds the number of review rounds value &lt;br /&gt;
::- Verify that the increasing number of review rounds after creating the assignment saves successfully and the new value is retained &lt;br /&gt;
::- Verify that the decreasing number of review rounds after creating the assignment saves successfully and the new value is retained &lt;br /&gt;
:* Problem 5 : Issue #1142&lt;br /&gt;
::- Verify that when user views score review comments rendered as processed HTML only(there should not be any rendered HTML tags)&lt;br /&gt;
:&lt;br /&gt;
:* The setup for testing both problems 2 &amp;amp; 5 is complex as there are many necessary associations and procedures that are required to achieve the appropriate testing state. Assuming that a sufficient setup is achieved, a feature test for Issue 2 would simulate logging in as a student, visiting the ''Others Work'' page and submitting a review submission which would allow for the verification that an option to update his or her review is available, upon returning to the student assignment page. Further, a feature test for Issue 5 would simulate logging in as a student, visiting the ''Your Scores'' page, where he or she would be able to hover over a response link to validate the comment rendering.&lt;br /&gt;
:* The follow is a list of several suitable models and possible relationships:&lt;br /&gt;
::- Models:&lt;br /&gt;
:::* Course&lt;br /&gt;
:::* Assignment&lt;br /&gt;
:::* Assignment_Mapping&lt;br /&gt;
:::* Response Questionnaire&lt;br /&gt;
:::* Review_Mapping&lt;br /&gt;
:::* Response&lt;br /&gt;
:::* Team&lt;br /&gt;
:::* Topic&lt;br /&gt;
:::* Participants - reviewer &amp;amp; reviewee&lt;br /&gt;
:::* Submission&lt;br /&gt;
::- Relationships:&lt;br /&gt;
:::* A course must contain participants and assignments&lt;br /&gt;
:::* An assignment must be associated with participants and response questionnaires&lt;br /&gt;
:::* A response questionnaire must be associated with participants and responses&lt;br /&gt;
:::* It is also required that a reviewee submit an assignment to then be reviewed by a reviewer.&lt;br /&gt;
&lt;br /&gt;
== '''References &amp;amp; Related Links''' ==&lt;br /&gt;
&lt;br /&gt;
:*Accompanying Videos for Issues and Testing:&lt;br /&gt;
::-[Problem 1 : Issue #1093]: Replication Attempts &amp;lt;-- insert video link here&lt;br /&gt;
::-[https://youtu.be/4FZIFS76KBc Problem 2 : Issue #1097]: Run of Manual Test&lt;br /&gt;
::-[Problem 3 : Issue #1029]: Replication Attempts &amp;lt;-- insert video link here&lt;br /&gt;
::-[https://drive.google.com/file/d/1wfurtDj8UuyjSyutFJmLptlyoz56p7jv/view?usp=sharing Problem 4 : Issue #927]: Run of Feature Test&lt;br /&gt;
::-[https://drive.google.com/file/d/1laFnMFBoTznsQ2QSh5TJfp7R5KQd6kuf/view?usp=sharing Problem 5 : Issue #1142]: Run of Manual Test&lt;br /&gt;
:*Project Links &lt;br /&gt;
::-Project Screencast &amp;lt;-- insert video link here&lt;br /&gt;
::-[https://github.com/expertiza/expertiza/pull/1312# Pull request]&lt;br /&gt;
::-[https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit# Project Document]&lt;br /&gt;
::-[https://www.youtube.com/watch?v=CaUOA2WLsOY&amp;amp;list=PLfg44kGPNXFMb72Wnb9BD81h3HHYZDvjJ/edit# Tutorial videos on creating assignments]&lt;br /&gt;
::-[https://github.com/Manjunath-gaonkar/expertiza GitHub]: Forked Repository&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120800</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120800"/>
		<updated>2018-11-21T22:16:05Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Problem 2 : Issue # 1097 */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Project Introduction &amp;amp; Motivation''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
Expertiza Project : E1864 ‘Issues Related to Reviewing' is intended to fix five known issues in the current Expertiza Version related to reviewing student work. Issues are centered around peer reviewing and assignment feature calibration. The motivation behind this project is to identify and resolve each bug in an attempt to improve the current system version. The project has been divided into required fixes. Four of the five problems are presented in ''Figure 1 - Application Flow Diagram'' below. This image is a general representation describing when each of the issues is encountered during a user session. Problem 5 (Issue # 1142) is not present in this figure as the problem is simply associated with the coding of a view file and not directly connected to the flow of students and reviews. Additional discussion on proposed approaches to meet the requirements are explained in subsequent sections.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:FlowDiagram.PNG]]&lt;br /&gt;
::::::'''Figure 1 - Application Flow Diagram'''&lt;br /&gt;
::::::-----------------------------------------------&lt;br /&gt;
&lt;br /&gt;
== '''UML diagram for reviw''' ==&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig2_uml.PNG]]&lt;br /&gt;
'''Actors''':&lt;br /&gt;
&lt;br /&gt;
:*Instructor - This actor is responsible for creating assignments and adding students to the assignment.&lt;br /&gt;
:*Student - This actor is responsible for submitting, reviewing other students work.&lt;br /&gt;
&lt;br /&gt;
'''Database''':&lt;br /&gt;
&lt;br /&gt;
:*The database where all the data of Expertiza is getting stored.&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statements &amp;amp; Descriptions''' ==&lt;br /&gt;
&lt;br /&gt;
For this project, we have been asked to fix the follow bugs that have been found in the current Expertiza system :&lt;br /&gt;
=== Problem 1 : Issue #1093 ===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
:*Example : The project name for which the review was performed earlier should not appear for the next list of reviews when a student requests a review to perform. This could lead to students reviewing the same project more than once and the requirement is to review different projects each time. &lt;br /&gt;
 &lt;br /&gt;
&lt;br /&gt;
:::::[[File:Fig_3.PNG]]&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1093:'''&lt;br /&gt;
Figure 1 gives the holistic view on stages in which we see the issues. In this part, we will discuss the exact steps that need to be followed to reproduce the bugs.&lt;br /&gt;
:* Login as Instructor Create new assignment and associate to the course as shown in Figure 4&lt;br /&gt;
:* Add a participant to the assignment. there are two ways to do this in bulk first way is importing all the course participants to assignment . second approach is creating a file containing student details and import them to expertiza &lt;br /&gt;
:* Create topics and teams in expertiza either entering them one by one or from the file &lt;br /&gt;
:* In actual implementation topic association to the teams involves bidding process but for ease of use, we let instructor assign the topic (Figure 5). set min and max number of reviews allowed as shown in &lt;br /&gt;
:* Set the rubrics and number of review rounds (min one round is needed) (Figure 6)&lt;br /&gt;
:* Review assignment should be automatic not instructor controlled(scope of the stated issue is here) as shown in Figure 7&lt;br /&gt;
:* Set the deadlines for submission and review (shown in Figure 8)&lt;br /&gt;
:* Login as a student and submit work(this needs to be done for each team), request for review&lt;br /&gt;
:* If the issue persist system assign the same topic to review multiple times(as shown in Figure2).difficulty with this problem is that its reproducibility factor which is very low.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:p1_p1.PNG]]&lt;br /&gt;
:::::[[File:p1_p2.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
:*Example : When the reviewer submits a review for a project, the reviewer cannot edit/ update his review again. Before submitting it says &amp;quot;Once submitted, the review cannot be changed again&amp;quot;. After clicking yes the reviewer is only able to view his reviews and not update even before the deadline.  &lt;br /&gt;
This situation can occur in the following scenario. When a reviewer submits the review-1 a few minutes after the deadline, the rubric for review 2 occurs. So the review done for the first round actually becomes review for round 2. Hence the reviewer would not be able to update this review. In situations like these, updating the submitted review becomes useful.&lt;br /&gt;
&lt;br /&gt;
Steps to reproduce the issue:&lt;br /&gt;
*Initial steps to reproduce this problem is same as the issue #1093&lt;br /&gt;
*Change the deadlines for the review to a few days after the present date and check if you are able to update the review. The picture shows deadline to submit is after 14 days. But the reviews are only able to be viewed. &lt;br /&gt;
:::::[[File:p2_p1.PNG]]&lt;br /&gt;
:::::[[File:p2_p2.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
:*Example : An author of a project has submitted his/her assignment to Expertiza. When a reviewer tries to review the work, sometimes it happens that the system shows the reviewer that the work has not been submitted yet. The reviewer should have been shown the work of the author to review.&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1029:'''&lt;br /&gt;
:* steps to reproduce this issue is similar to issue #1093, only the difference is once reviewer requests the assignment to review system throws a message saying there is no work has been submitted even though there is actually submitted work. This issue is not always reproducible&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
:*Example : An instructor attempts to edit an existing assignment and change the number of review rounds. The reassignment causes an error in the system and this prevents the project update to occur.&lt;br /&gt;
'''Steps to reproduce the Issue #972 :'''&lt;br /&gt;
:*We will choose one of the existing assignments in expertiza and try to increase the number of review rounds from &amp;quot;x&amp;quot; to &amp;quot;y&amp;quot;(x&amp;lt;y). when we try to save the assignment we get the error message as shown in the figure 12 below also number of reviews reverts back to &amp;quot;x&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:P4_p1.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:*''“Summary Result Assignment” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
:*Example : As seen in Figure 16 below, the result of hovering over a review result displays the message in raw HTML. The intended result is for review comment to be rendered properly while displaying.&lt;br /&gt;
::-It should be that this issue can be reproduced by going to any student assignment result and attempt to produce a quick view of the review comment by hovering over the desired linked question score.&lt;br /&gt;
:::::[[File:p4_html.PNG]]&lt;br /&gt;
&lt;br /&gt;
== '''Files to be Modified''' ==&lt;br /&gt;
&lt;br /&gt;
:*''app/models/review_assignment.rb''&lt;br /&gt;
:*''app/controllers/assignments_controller.rb''&lt;br /&gt;
:*''app/views/view_team.html.erb''&lt;br /&gt;
&lt;br /&gt;
== '''Solution Design''' ==&lt;br /&gt;
=== Problem 1 : Issue # 1093 ===&lt;br /&gt;
:*If the issue reproducible consistantly we need to fix ''reject_previously_reviewed_submissions(contributor_set, reviewer)'' method in ''review_assignment.rb'' model file. This method is responsible for the seperating the current review topic and previously reviewed topics. solution flow diagram is shown below&lt;br /&gt;
:::::[[File:p1_sol.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*To solve this problem we can let the reviewers to update the review until the deadline and remove the confirmation message &amp;quot;Once submitted, it cannot be changed again&amp;quot; before the deadline. &lt;br /&gt;
:*We can let the reviewers update their reviews multiple times before the deadline. We can change the system design which says only &amp;quot;view&amp;quot; after submitting the review to &amp;quot;view and Update&amp;quot; until the deadline and after which it can be changed back to only &amp;quot;view&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*Solution to this issue involves identifying students work as correctly submitted or not submitted so that system will always know that submission status this identification should be available to the method which assigns topics to the reviewer.&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:* To solve this problem we must first identify the necessary actions for which the review round updates are to be executed. From there, we can step through the calls to determine which is not executing as intended. After testing, there is a suspicion that the error is occurring due to the response by, or lack there of, the 'set' button on the edit page beside the rounds value box. The response of this action button determines the outcome of the conditional statement that must evaluate to true to properly update the number of review rounds. Additionally, the 'set' button seems to be inactive upon the first render of the edit page but active on subsequent visits. This update action can be found in the ''update_feedback_assignment_form_attributes'' function of assignments_controller.rb&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:* In this case, we need to identify the mistakes in HTML file and then correct them. final expected outcome is to have processed HTML file.&lt;br /&gt;
::- We believe that this issue stems from one of two places:&lt;br /&gt;
:::(1) The reviewer content is being captured and stored into the database as a string still containing the html formatting and then being populated into the view as a string containing those tags.&lt;br /&gt;
:::(2) There is a tag missing from view_team.html.erb where this hovered content is being requested. There are eight instances where hovered content is referenced. More testing review of the view file will lend to narrowing down the actual line where the problem resides.&lt;br /&gt;
&lt;br /&gt;
== '''Testing Plan''' ==&lt;br /&gt;
''Testing Plan will be implemented upon the discovery of fixed bugs described in the project document as a means of verifying the fix.''&lt;br /&gt;
&lt;br /&gt;
To ensure correctness of bug fixes following test plan was implemented:&lt;br /&gt;
&lt;br /&gt;
:*Obtain the appropriate testing environment via a provided virtual box image and RSPEC testing framework.&lt;br /&gt;
:*Acquire a deeper understanding of the necessary models and views, their functionalities and dependencies.&lt;br /&gt;
:*Create factories and doubles to assist in the testing of these models and views methods.&lt;br /&gt;
:*Mock message passing and expected outcomes.&lt;br /&gt;
:*Apply generated helper objects and mocks to achieve high test coverage of methods within the models and views that were updated.&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
:*[https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit# Project Document]&lt;br /&gt;
:*[https://www.youtube.com/watch?v=CaUOA2WLsOY&amp;amp;list=PLfg44kGPNXFMb72Wnb9BD81h3HHYZDvjJ/edit# Tutorial videos on creating assignments]&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120799</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120799"/>
		<updated>2018-11-21T22:15:21Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Problem 2 : Issue # 1097 */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Project Introduction &amp;amp; Motivation''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
Expertiza Project : E1864 ‘Issues Related to Reviewing' is intended to fix five known issues in the current Expertiza Version related to reviewing student work. Issues are centered around peer reviewing and assignment feature calibration. The motivation behind this project is to identify and resolve each bug in an attempt to improve the current system version. The project has been divided into required fixes. Four of the five problems are presented in ''Figure 1 - Application Flow Diagram'' below. This image is a general representation describing when each of the issues is encountered during a user session. Problem 5 (Issue # 1142) is not present in this figure as the problem is simply associated with the coding of a view file and not directly connected to the flow of students and reviews. Additional discussion on proposed approaches to meet the requirements are explained in subsequent sections.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:FlowDiagram.PNG]]&lt;br /&gt;
::::::'''Figure 1 - Application Flow Diagram'''&lt;br /&gt;
::::::-----------------------------------------------&lt;br /&gt;
&lt;br /&gt;
== '''UML diagram for reviw''' ==&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig2_uml.PNG]]&lt;br /&gt;
'''Actors''':&lt;br /&gt;
&lt;br /&gt;
:*Instructor - This actor is responsible for creating assignments and adding students to the assignment.&lt;br /&gt;
:*Student - This actor is responsible for submitting, reviewing other students work.&lt;br /&gt;
&lt;br /&gt;
'''Database''':&lt;br /&gt;
&lt;br /&gt;
:*The database where all the data of Expertiza is getting stored.&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statements &amp;amp; Descriptions''' ==&lt;br /&gt;
&lt;br /&gt;
For this project, we have been asked to fix the follow bugs that have been found in the current Expertiza system :&lt;br /&gt;
=== Problem 1 : Issue #1093 ===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
:*Example : The project name for which the review was performed earlier should not appear for the next list of reviews when a student requests a review to perform. This could lead to students reviewing the same project more than once and the requirement is to review different projects each time. &lt;br /&gt;
 &lt;br /&gt;
&lt;br /&gt;
:::::[[File:Fig_3.PNG]]&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1093:'''&lt;br /&gt;
Figure 1 gives the holistic view on stages in which we see the issues. In this part, we will discuss the exact steps that need to be followed to reproduce the bugs.&lt;br /&gt;
:* Login as Instructor Create new assignment and associate to the course as shown in Figure 4&lt;br /&gt;
:* Add a participant to the assignment. there are two ways to do this in bulk first way is importing all the course participants to assignment . second approach is creating a file containing student details and import them to expertiza &lt;br /&gt;
:* Create topics and teams in expertiza either entering them one by one or from the file &lt;br /&gt;
:* In actual implementation topic association to the teams involves bidding process but for ease of use, we let instructor assign the topic (Figure 5). set min and max number of reviews allowed as shown in &lt;br /&gt;
:* Set the rubrics and number of review rounds (min one round is needed) (Figure 6)&lt;br /&gt;
:* Review assignment should be automatic not instructor controlled(scope of the stated issue is here) as shown in Figure 7&lt;br /&gt;
:* Set the deadlines for submission and review (shown in Figure 8)&lt;br /&gt;
:* Login as a student and submit work(this needs to be done for each team), request for review&lt;br /&gt;
:* If the issue persist system assign the same topic to review multiple times(as shown in Figure2).difficulty with this problem is that its reproducibility factor which is very low.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:p1_p1.PNG]]&lt;br /&gt;
:::::[[File:p1_p2.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
:*Example : When the reviewer submits a review for a project, the reviewer cannot edit/ update his review again. Before submitting it says &amp;quot;Once submitted, the review cannot be changed again&amp;quot;. After clicking yes the reviewer is only able to view his reviews and not update even before the deadline.  &lt;br /&gt;
This situation can occur in the following scenario. When a reviewer submits the review-1 a few minutes after the deadline, the rubric for review 2 occurs. So the review done for the first round actually becomes review for round 2. Hence the reviewer would not be able to update this review. In situations like these, updating the submitted review becomes useful.&lt;br /&gt;
&lt;br /&gt;
Steps to reproduce the issue:&lt;br /&gt;
*Initial steps to reproduce this problem is same as the issue #1093&lt;br /&gt;
*Change the deadlines for the review to a few days after the present date and check if you are able to update the review. The picture shows deadline to submit is after 14 days. But the reviews are only able to be viewed. &lt;br /&gt;
:::::[[File:p2_p1.PNG]]&lt;br /&gt;
:::::[[File:p2_p2.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
:*Example : An author of a project has submitted his/her assignment to Expertiza. When a reviewer tries to review the work, sometimes it happens that the system shows the reviewer that the work has not been submitted yet. The reviewer should have been shown the work of the author to review.&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1029:'''&lt;br /&gt;
:* steps to reproduce this issue is similar to issue #1093, only the difference is once reviewer requests the assignment to review system throws a message saying there is no work has been submitted even though there is actually submitted work. This issue is not always reproducible&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
:*Example : An instructor attempts to edit an existing assignment and change the number of review rounds. The reassignment causes an error in the system and this prevents the project update to occur.&lt;br /&gt;
'''Steps to reproduce the Issue #972 :'''&lt;br /&gt;
:*We will choose one of the existing assignments in expertiza and try to increase the number of review rounds from &amp;quot;x&amp;quot; to &amp;quot;y&amp;quot;(x&amp;lt;y). when we try to save the assignment we get the error message as shown in the figure 12 below also number of reviews reverts back to &amp;quot;x&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:P4_p1.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:*''“Summary Result Assignment” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
:*Example : As seen in Figure 16 below, the result of hovering over a review result displays the message in raw HTML. The intended result is for review comment to be rendered properly while displaying.&lt;br /&gt;
::-It should be that this issue can be reproduced by going to any student assignment result and attempt to produce a quick view of the review comment by hovering over the desired linked question score.&lt;br /&gt;
:::::[[File:p4_html.PNG]]&lt;br /&gt;
&lt;br /&gt;
== '''Files to be Modified''' ==&lt;br /&gt;
&lt;br /&gt;
:*''app/models/review_assignment.rb''&lt;br /&gt;
:*''app/controllers/assignments_controller.rb''&lt;br /&gt;
:*''app/views/view_team.html.erb''&lt;br /&gt;
&lt;br /&gt;
== '''Solution Design''' ==&lt;br /&gt;
=== Problem 1 : Issue # 1093 ===&lt;br /&gt;
:*If the issue reproducible consistantly we need to fix ''reject_previously_reviewed_submissions(contributor_set, reviewer)'' method in ''review_assignment.rb'' model file. This method is responsible for the seperating the current review topic and previously reviewed topics. solution flow diagram is shown below&lt;br /&gt;
:::::[[File:p1_sol.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*To solve this problem we can let the reviewers to update the review until the deadline and remove the confirmation message &amp;quot;Once submitted, it cannot be changed again&amp;quot; before the deadline. &lt;br /&gt;
:*We can let the reviewers update their reviews multiple times before the deadline. We can change the system design which says only &amp;quot;view&amp;quot; after submitting the review to &amp;quot;view and Update&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*Solution to this issue involves identifying students work as correctly submitted or not submitted so that system will always know that submission status this identification should be available to the method which assigns topics to the reviewer.&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:* To solve this problem we must first identify the necessary actions for which the review round updates are to be executed. From there, we can step through the calls to determine which is not executing as intended. After testing, there is a suspicion that the error is occurring due to the response by, or lack there of, the 'set' button on the edit page beside the rounds value box. The response of this action button determines the outcome of the conditional statement that must evaluate to true to properly update the number of review rounds. Additionally, the 'set' button seems to be inactive upon the first render of the edit page but active on subsequent visits. This update action can be found in the ''update_feedback_assignment_form_attributes'' function of assignments_controller.rb&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:* In this case, we need to identify the mistakes in HTML file and then correct them. final expected outcome is to have processed HTML file.&lt;br /&gt;
::- We believe that this issue stems from one of two places:&lt;br /&gt;
:::(1) The reviewer content is being captured and stored into the database as a string still containing the html formatting and then being populated into the view as a string containing those tags.&lt;br /&gt;
:::(2) There is a tag missing from view_team.html.erb where this hovered content is being requested. There are eight instances where hovered content is referenced. More testing review of the view file will lend to narrowing down the actual line where the problem resides.&lt;br /&gt;
&lt;br /&gt;
== '''Testing Plan''' ==&lt;br /&gt;
''Testing Plan will be implemented upon the discovery of fixed bugs described in the project document as a means of verifying the fix.''&lt;br /&gt;
&lt;br /&gt;
To ensure correctness of bug fixes following test plan was implemented:&lt;br /&gt;
&lt;br /&gt;
:*Obtain the appropriate testing environment via a provided virtual box image and RSPEC testing framework.&lt;br /&gt;
:*Acquire a deeper understanding of the necessary models and views, their functionalities and dependencies.&lt;br /&gt;
:*Create factories and doubles to assist in the testing of these models and views methods.&lt;br /&gt;
:*Mock message passing and expected outcomes.&lt;br /&gt;
:*Apply generated helper objects and mocks to achieve high test coverage of methods within the models and views that were updated.&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
:*[https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit# Project Document]&lt;br /&gt;
:*[https://www.youtube.com/watch?v=CaUOA2WLsOY&amp;amp;list=PLfg44kGPNXFMb72Wnb9BD81h3HHYZDvjJ/edit# Tutorial videos on creating assignments]&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120798</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120798"/>
		<updated>2018-11-21T22:15:03Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Problem 2 : Issue # 1097 */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Project Introduction &amp;amp; Motivation''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
Expertiza Project : E1864 ‘Issues Related to Reviewing' is intended to fix five known issues in the current Expertiza Version related to reviewing student work. Issues are centered around peer reviewing and assignment feature calibration. The motivation behind this project is to identify and resolve each bug in an attempt to improve the current system version. The project has been divided into required fixes. Four of the five problems are presented in ''Figure 1 - Application Flow Diagram'' below. This image is a general representation describing when each of the issues is encountered during a user session. Problem 5 (Issue # 1142) is not present in this figure as the problem is simply associated with the coding of a view file and not directly connected to the flow of students and reviews. Additional discussion on proposed approaches to meet the requirements are explained in subsequent sections.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:FlowDiagram.PNG]]&lt;br /&gt;
::::::'''Figure 1 - Application Flow Diagram'''&lt;br /&gt;
::::::-----------------------------------------------&lt;br /&gt;
&lt;br /&gt;
== '''UML diagram for reviw''' ==&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig2_uml.PNG]]&lt;br /&gt;
'''Actors''':&lt;br /&gt;
&lt;br /&gt;
:*Instructor - This actor is responsible for creating assignments and adding students to the assignment.&lt;br /&gt;
:*Student - This actor is responsible for submitting, reviewing other students work.&lt;br /&gt;
&lt;br /&gt;
'''Database''':&lt;br /&gt;
&lt;br /&gt;
:*The database where all the data of Expertiza is getting stored.&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statements &amp;amp; Descriptions''' ==&lt;br /&gt;
&lt;br /&gt;
For this project, we have been asked to fix the follow bugs that have been found in the current Expertiza system :&lt;br /&gt;
=== Problem 1 : Issue #1093 ===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
:*Example : The project name for which the review was performed earlier should not appear for the next list of reviews when a student requests a review to perform. This could lead to students reviewing the same project more than once and the requirement is to review different projects each time. &lt;br /&gt;
 &lt;br /&gt;
&lt;br /&gt;
:::::[[File:Fig_3.PNG]]&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1093:'''&lt;br /&gt;
Figure 1 gives the holistic view on stages in which we see the issues. In this part, we will discuss the exact steps that need to be followed to reproduce the bugs.&lt;br /&gt;
:* Login as Instructor Create new assignment and associate to the course as shown in Figure 4&lt;br /&gt;
:* Add a participant to the assignment. there are two ways to do this in bulk first way is importing all the course participants to assignment . second approach is creating a file containing student details and import them to expertiza &lt;br /&gt;
:* Create topics and teams in expertiza either entering them one by one or from the file &lt;br /&gt;
:* In actual implementation topic association to the teams involves bidding process but for ease of use, we let instructor assign the topic (Figure 5). set min and max number of reviews allowed as shown in &lt;br /&gt;
:* Set the rubrics and number of review rounds (min one round is needed) (Figure 6)&lt;br /&gt;
:* Review assignment should be automatic not instructor controlled(scope of the stated issue is here) as shown in Figure 7&lt;br /&gt;
:* Set the deadlines for submission and review (shown in Figure 8)&lt;br /&gt;
:* Login as a student and submit work(this needs to be done for each team), request for review&lt;br /&gt;
:* If the issue persist system assign the same topic to review multiple times(as shown in Figure2).difficulty with this problem is that its reproducibility factor which is very low.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:p1_p1.PNG]]&lt;br /&gt;
:::::[[File:p1_p2.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
:*Example : When the reviewer submits a review for a project, the reviewer cannot edit/ update his review again. Before submitting it says &amp;quot;Once submitted, the review cannot be changed again&amp;quot;. After clicking yes the reviewer is only able to view his reviews and not update even before the deadline.  &lt;br /&gt;
This situation can occur in the following scenario. When a reviewer submits the review-1 a few minutes after the deadline, the rubric for review 2 occurs. So the review done for the first round actually becomes review for round 2. Hence the reviewer would not be able to update this review. In situations like these, updating the submitted review becomes useful.&lt;br /&gt;
&lt;br /&gt;
Steps to reproduce the issue:&lt;br /&gt;
*Initial steps to reproduce this problem is same as the issue #1093&lt;br /&gt;
*Change the deadlines for the review to a few days after the present date and check if you are able to update the review. The picture shows deadline to submit is after 14 days. But the reviews are only able to be viewed. &lt;br /&gt;
:::::[[File:p2_p1.PNG]]&lt;br /&gt;
:::::[[File:p2_p2.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
:*Example : An author of a project has submitted his/her assignment to Expertiza. When a reviewer tries to review the work, sometimes it happens that the system shows the reviewer that the work has not been submitted yet. The reviewer should have been shown the work of the author to review.&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1029:'''&lt;br /&gt;
:* steps to reproduce this issue is similar to issue #1093, only the difference is once reviewer requests the assignment to review system throws a message saying there is no work has been submitted even though there is actually submitted work. This issue is not always reproducible&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
:*Example : An instructor attempts to edit an existing assignment and change the number of review rounds. The reassignment causes an error in the system and this prevents the project update to occur.&lt;br /&gt;
'''Steps to reproduce the Issue #972 :'''&lt;br /&gt;
:*We will choose one of the existing assignments in expertiza and try to increase the number of review rounds from &amp;quot;x&amp;quot; to &amp;quot;y&amp;quot;(x&amp;lt;y). when we try to save the assignment we get the error message as shown in the figure 12 below also number of reviews reverts back to &amp;quot;x&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:P4_p1.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:*''“Summary Result Assignment” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
:*Example : As seen in Figure 16 below, the result of hovering over a review result displays the message in raw HTML. The intended result is for review comment to be rendered properly while displaying.&lt;br /&gt;
::-It should be that this issue can be reproduced by going to any student assignment result and attempt to produce a quick view of the review comment by hovering over the desired linked question score.&lt;br /&gt;
:::::[[File:p4_html.PNG]]&lt;br /&gt;
&lt;br /&gt;
== '''Files to be Modified''' ==&lt;br /&gt;
&lt;br /&gt;
:*''app/models/review_assignment.rb''&lt;br /&gt;
:*''app/controllers/assignments_controller.rb''&lt;br /&gt;
:*''app/views/view_team.html.erb''&lt;br /&gt;
&lt;br /&gt;
== '''Solution Design''' ==&lt;br /&gt;
=== Problem 1 : Issue # 1093 ===&lt;br /&gt;
:*If the issue reproducible consistantly we need to fix ''reject_previously_reviewed_submissions(contributor_set, reviewer)'' method in ''review_assignment.rb'' model file. This method is responsible for the seperating the current review topic and previously reviewed topics. solution flow diagram is shown below&lt;br /&gt;
:::::[[File:p1_sol.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*To solve this problem we can let the reviewers to update the review until the deadline and remove the confirmation message &amp;quot;Once submitted, it cannot be changed again&amp;quot; before the deadline. &lt;br /&gt;
We can let the reviewers update their reviews multiple times before the deadline. We can change the system design which says only &amp;quot;view&amp;quot; after submitting the review to &amp;quot;view and Update&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*Solution to this issue involves identifying students work as correctly submitted or not submitted so that system will always know that submission status this identification should be available to the method which assigns topics to the reviewer.&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:* To solve this problem we must first identify the necessary actions for which the review round updates are to be executed. From there, we can step through the calls to determine which is not executing as intended. After testing, there is a suspicion that the error is occurring due to the response by, or lack there of, the 'set' button on the edit page beside the rounds value box. The response of this action button determines the outcome of the conditional statement that must evaluate to true to properly update the number of review rounds. Additionally, the 'set' button seems to be inactive upon the first render of the edit page but active on subsequent visits. This update action can be found in the ''update_feedback_assignment_form_attributes'' function of assignments_controller.rb&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:* In this case, we need to identify the mistakes in HTML file and then correct them. final expected outcome is to have processed HTML file.&lt;br /&gt;
::- We believe that this issue stems from one of two places:&lt;br /&gt;
:::(1) The reviewer content is being captured and stored into the database as a string still containing the html formatting and then being populated into the view as a string containing those tags.&lt;br /&gt;
:::(2) There is a tag missing from view_team.html.erb where this hovered content is being requested. There are eight instances where hovered content is referenced. More testing review of the view file will lend to narrowing down the actual line where the problem resides.&lt;br /&gt;
&lt;br /&gt;
== '''Testing Plan''' ==&lt;br /&gt;
''Testing Plan will be implemented upon the discovery of fixed bugs described in the project document as a means of verifying the fix.''&lt;br /&gt;
&lt;br /&gt;
To ensure correctness of bug fixes following test plan was implemented:&lt;br /&gt;
&lt;br /&gt;
:*Obtain the appropriate testing environment via a provided virtual box image and RSPEC testing framework.&lt;br /&gt;
:*Acquire a deeper understanding of the necessary models and views, their functionalities and dependencies.&lt;br /&gt;
:*Create factories and doubles to assist in the testing of these models and views methods.&lt;br /&gt;
:*Mock message passing and expected outcomes.&lt;br /&gt;
:*Apply generated helper objects and mocks to achieve high test coverage of methods within the models and views that were updated.&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
:*[https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit# Project Document]&lt;br /&gt;
:*[https://www.youtube.com/watch?v=CaUOA2WLsOY&amp;amp;list=PLfg44kGPNXFMb72Wnb9BD81h3HHYZDvjJ/edit# Tutorial videos on creating assignments]&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:2.png&amp;diff=120797</id>
		<title>File:2.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:2.png&amp;diff=120797"/>
		<updated>2018-11-21T22:05:34Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: uploaded a new version of &amp;amp;quot;File:2.png&amp;amp;quot;&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;Double diamond problem&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120796</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120796"/>
		<updated>2018-11-21T21:37:10Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Problem 2 : Issue # 1097 */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Project Introduction &amp;amp; Motivation''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
Expertiza Project : E1864 ‘Issues Related to Reviewing' is intended to fix five known issues in the current Expertiza Version related to reviewing student work. Issues are centered around peer reviewing and assignment feature calibration. The motivation behind this project is to identify and resolve each bug in an attempt to improve the current system version. The project has been divided into required fixes. Four of the five problems are presented in ''Figure 1 - Application Flow Diagram'' below. This image is a general representation describing when each of the issues is encountered during a user session. Problem 5 (Issue # 1142) is not present in this figure as the problem is simply associated with the coding of a view file and not directly connected to the flow of students and reviews. Additional discussion on proposed approaches to meet the requirements are explained in subsequent sections.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:FlowDiagram.PNG]]&lt;br /&gt;
::::::'''Figure 1 - Application Flow Diagram'''&lt;br /&gt;
::::::-----------------------------------------------&lt;br /&gt;
&lt;br /&gt;
== '''UML diagram for reviw''' ==&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig2_uml.PNG]]&lt;br /&gt;
'''Actors''':&lt;br /&gt;
&lt;br /&gt;
:*Instructor - This actor is responsible for creating assignments and adding students to the assignment.&lt;br /&gt;
:*Student - This actor is responsible for submitting, reviewing other students work.&lt;br /&gt;
&lt;br /&gt;
'''Database''':&lt;br /&gt;
&lt;br /&gt;
:*The database where all the data of Expertiza is getting stored.&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statements &amp;amp; Descriptions''' ==&lt;br /&gt;
&lt;br /&gt;
For this project, we have been asked to fix the follow bugs that have been found in the current Expertiza system :&lt;br /&gt;
=== Problem 1 : Issue #1093 ===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
:*Example : The project name for which the review was performed earlier should not appear for the next list of reviews when a student requests a review to perform. This could lead to students reviewing the same project more than once and the requirement is to review different projects each time. &lt;br /&gt;
 &lt;br /&gt;
&lt;br /&gt;
:::::[[File:Fig_3.PNG]]&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1093:'''&lt;br /&gt;
Figure 1 gives the holistic view on stages in which we see the issues. In this part, we will discuss the exact steps that need to be followed to reproduce the bugs.&lt;br /&gt;
:* Login as Instructor Create new assignment and associate to the course as shown in Figure 4&lt;br /&gt;
:* Add a participant to the assignment. there are two ways to do this in bulk first way is importing all the course participants to assignment . second approach is creating a file containing student details and import them to expertiza &lt;br /&gt;
:* Create topics and teams in expertiza either entering them one by one or from the file &lt;br /&gt;
:* In actual implementation topic association to the teams involves bidding process but for ease of use, we let instructor assign the topic (Figure 5). set min and max number of reviews allowed as shown in &lt;br /&gt;
:* Set the rubrics and number of review rounds (min one round is needed) (Figure 6)&lt;br /&gt;
:* Review assignment should be automatic not instructor controlled(scope of the stated issue is here) as shown in Figure 7&lt;br /&gt;
:* Set the deadlines for submission and review (shown in Figure 8)&lt;br /&gt;
:* Login as a student and submit work(this needs to be done for each team), request for review&lt;br /&gt;
:* If the issue persist system assign the same topic to review multiple times(as shown in Figure2).difficulty with this problem is that its reproducibility factor which is very low.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:p1_p1.PNG]]&lt;br /&gt;
:::::[[File:p1_p2.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
:*Example : When the reviewer submits a review for a project, the reviewer cannot edit/ update his review again. Before submitting it says &amp;quot;Once submitted, the review cannot be changed again&amp;quot;. After clicking yes the reviewer is only able to view his reviews and not update even before the deadline.  &lt;br /&gt;
This situation can occur in the following scenario. When a reviewer submits the review-1 a few minutes after the deadline, the rubric for review 2 occurs. So the review done for the first round actually becomes review for round 2. Hence the reviewer would not be able to update this review. In situations like these, updating the submitted review becomes useful.&lt;br /&gt;
&lt;br /&gt;
Steps to reproduce the issue:&lt;br /&gt;
*Initial steps to reproduce this problem is same as the issue #1093&lt;br /&gt;
*Change the deadlines for the review to a few days after the present date and check if you are able to update the review. The picture shows deadline to submit is after 14 days. But the reviews are only able to be viewed. &lt;br /&gt;
:::::[[File:p2_p1.PNG]]&lt;br /&gt;
:::::[[File:p2_p2.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
:*Example : An author of a project has submitted his/her assignment to Expertiza. When a reviewer tries to review the work, sometimes it happens that the system shows the reviewer that the work has not been submitted yet. The reviewer should have been shown the work of the author to review.&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1029:'''&lt;br /&gt;
:* steps to reproduce this issue is similar to issue #1093, only the difference is once reviewer requests the assignment to review system throws a message saying there is no work has been submitted even though there is actually submitted work. This issue is not always reproducible&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
:*Example : An instructor attempts to edit an existing assignment and change the number of review rounds. The reassignment causes an error in the system and this prevents the project update to occur.&lt;br /&gt;
'''Steps to reproduce the Issue #972 :'''&lt;br /&gt;
:*We will choose one of the existing assignments in expertiza and try to increase the number of review rounds from &amp;quot;x&amp;quot; to &amp;quot;y&amp;quot;(x&amp;lt;y). when we try to save the assignment we get the error message as shown in the figure 12 below also number of reviews reverts back to &amp;quot;x&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:P4_p1.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:*''“Summary Result Assignment” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
:*Example : As seen in Figure 16 below, the result of hovering over a review result displays the message in raw HTML. The intended result is for review comment to be rendered properly while displaying.&lt;br /&gt;
::-It should be that this issue can be reproduced by going to any student assignment result and attempt to produce a quick view of the review comment by hovering over the desired linked question score.&lt;br /&gt;
:::::[[File:p4_html.PNG]]&lt;br /&gt;
&lt;br /&gt;
== '''Files to be Modified''' ==&lt;br /&gt;
&lt;br /&gt;
:*''app/models/review_assignment.rb''&lt;br /&gt;
:*''app/controllers/assignments_controller.rb''&lt;br /&gt;
:*''app/views/view_team.html.erb''&lt;br /&gt;
&lt;br /&gt;
== '''Solution Design''' ==&lt;br /&gt;
=== Problem 1 : Issue # 1093 ===&lt;br /&gt;
:*If the issue reproducible consistantly we need to fix ''reject_previously_reviewed_submissions(contributor_set, reviewer)'' method in ''review_assignment.rb'' model file. This method is responsible for the seperating the current review topic and previously reviewed topics. solution flow diagram is shown below&lt;br /&gt;
:::::[[File:p1_sol.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*A possible solution is to let the reviewers update the review until the deadline and possibly remove the message &amp;quot;Once submitted, it cannot be changed again&amp;quot;. We can let the reviewers update their reviews multiple times before the deadline.&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*Solution to this issue involves identifying students work as correctly submitted or not submitted so that system will always know that submission status this identification should be available to the method which assigns topics to the reviewer.&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:* To solve this problem we must first identify the necessary actions for which the review round updates are to be executed. From there, we can step through the calls to determine which is not executing as intended. After testing, there is a suspicion that the error is occurring due to the response by, or lack there of, the 'set' button on the edit page beside the rounds value box. The response of this action button determines the outcome of the conditional statement that must evaluate to true to properly update the number of review rounds. Additionally, the 'set' button seems to be inactive upon the first render of the edit page but active on subsequent visits. This update action can be found in the ''update_feedback_assignment_form_attributes'' function of assignments_controller.rb&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:* In this case, we need to identify the mistakes in HTML file and then correct them. final expected outcome is to have processed HTML file.&lt;br /&gt;
::- We believe that this issue stems from one of two places:&lt;br /&gt;
:::(1) The reviewer content is being captured and stored into the database as a string still containing the html formatting and then being populated into the view as a string containing those tags.&lt;br /&gt;
:::(2) There is a tag missing from view_team.html.erb where this hovered content is being requested. There are eight instances where hovered content is referenced. More testing review of the view file will lend to narrowing down the actual line where the problem resides.&lt;br /&gt;
&lt;br /&gt;
== '''Testing Plan''' ==&lt;br /&gt;
''Testing Plan will be implemented upon the discovery of fixed bugs described in the project document as a means of verifying the fix.''&lt;br /&gt;
&lt;br /&gt;
To ensure correctness of bug fixes following test plan was implemented:&lt;br /&gt;
&lt;br /&gt;
:*Obtain the appropriate testing environment via a provided virtual box image and RSPEC testing framework.&lt;br /&gt;
:*Acquire a deeper understanding of the necessary models and views, their functionalities and dependencies.&lt;br /&gt;
:*Create factories and doubles to assist in the testing of these models and views methods.&lt;br /&gt;
:*Mock message passing and expected outcomes.&lt;br /&gt;
:*Apply generated helper objects and mocks to achieve high test coverage of methods within the models and views that were updated.&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
:*[https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit# Project Document]&lt;br /&gt;
:*[https://www.youtube.com/watch?v=CaUOA2WLsOY&amp;amp;list=PLfg44kGPNXFMb72Wnb9BD81h3HHYZDvjJ/edit# Tutorial videos on creating assignments]&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120795</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120795"/>
		<updated>2018-11-21T21:20:04Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Problem 2 : Issue # 1097 */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Project Introduction &amp;amp; Motivation''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
Expertiza Project : E1864 ‘Issues Related to Reviewing' is intended to fix five known issues in the current Expertiza Version related to reviewing student work. Issues are centered around peer reviewing and assignment feature calibration. The motivation behind this project is to identify and resolve each bug in an attempt to improve the current system version. The project has been divided into required fixes. Four of the five problems are presented in ''Figure 1 - Application Flow Diagram'' below. This image is a general representation describing when each of the issues is encountered during a user session. Problem 5 (Issue # 1142) is not present in this figure as the problem is simply associated with the coding of a view file and not directly connected to the flow of students and reviews. Additional discussion on proposed approaches to meet the requirements are explained in subsequent sections.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:FlowDiagram.PNG]]&lt;br /&gt;
::::::'''Figure 1 - Application Flow Diagram'''&lt;br /&gt;
::::::-----------------------------------------------&lt;br /&gt;
&lt;br /&gt;
== '''UML diagram for reviw''' ==&lt;br /&gt;
&lt;br /&gt;
:::::[[File:fig2_uml.PNG]]&lt;br /&gt;
'''Actors''':&lt;br /&gt;
&lt;br /&gt;
:*Instructor - This actor is responsible for creating assignments and adding students to the assignment.&lt;br /&gt;
:*Student - This actor is responsible for submitting, reviewing other students work.&lt;br /&gt;
&lt;br /&gt;
'''Database''':&lt;br /&gt;
&lt;br /&gt;
:*The database where all the data of Expertiza is getting stored.&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statements &amp;amp; Descriptions''' ==&lt;br /&gt;
&lt;br /&gt;
For this project, we have been asked to fix the follow bugs that have been found in the current Expertiza system :&lt;br /&gt;
=== Problem 1 : Issue #1093 ===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
:*Example : The project name for which the review was performed earlier should not appear for the next list of reviews when a student requests a review to perform. This could lead to students reviewing the same project more than once and the requirement is to review different projects each time. &lt;br /&gt;
 &lt;br /&gt;
&lt;br /&gt;
:::::[[File:Fig_3.PNG]]&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1093:'''&lt;br /&gt;
Figure 1 gives the holistic view on stages in which we see the issues. In this part, we will discuss the exact steps that need to be followed to reproduce the bugs.&lt;br /&gt;
:* Login as Instructor Create new assignment and associate to the course as shown in Figure 4&lt;br /&gt;
:* Add a participant to the assignment. there are two ways to do this in bulk first way is importing all the course participants to assignment . second approach is creating a file containing student details and import them to expertiza &lt;br /&gt;
:* Create topics and teams in expertiza either entering them one by one or from the file &lt;br /&gt;
:* In actual implementation topic association to the teams involves bidding process but for ease of use, we let instructor assign the topic (Figure 5). set min and max number of reviews allowed as shown in &lt;br /&gt;
:* Set the rubrics and number of review rounds (min one round is needed) (Figure 6)&lt;br /&gt;
:* Review assignment should be automatic not instructor controlled(scope of the stated issue is here) as shown in Figure 7&lt;br /&gt;
:* Set the deadlines for submission and review (shown in Figure 8)&lt;br /&gt;
:* Login as a student and submit work(this needs to be done for each team), request for review&lt;br /&gt;
:* If the issue persist system assign the same topic to review multiple times(as shown in Figure2).difficulty with this problem is that its reproducibility factor which is very low.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:p1_p1.PNG]]&lt;br /&gt;
:::::[[File:p1_p2.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
:*Example : When the reviewer submits a review for a project, the reviewer cannot edit/ update again. Before submitting it says &amp;quot;Once submitted, the review cannot be changed again&amp;quot;. &lt;br /&gt;
Real life example : When a reviewer submits the review 1 a few minutes after the deadline, the rubric for review 2 occurs. So the review 1 actually becomes review 2 and the reviewer was not able to update this review. In situations like these, update the submitted review becomes useful.&lt;br /&gt;
&lt;br /&gt;
Steps to reproduce the issue:&lt;br /&gt;
*Initial steps to reproduce this problem is same as the issue #1093&lt;br /&gt;
*Change the deadlines for the review to a few days after the present date and check if you are able to update the review. The picture shows deadline to submit is after 14 days. But the reviews are only able to be viewed. &lt;br /&gt;
:::::[[File:p2_p1.PNG]]&lt;br /&gt;
:::::[[File:p2_p2.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
:*Example : An author of a project has submitted his/her assignment to Expertiza. When a reviewer tries to review the work, sometimes it happens that the system shows the reviewer that the work has not been submitted yet. The reviewer should have been shown the work of the author to review.&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1029:'''&lt;br /&gt;
:* steps to reproduce this issue is similar to issue #1093, only the difference is once reviewer requests the assignment to review system throws a message saying there is no work has been submitted even though there is actually submitted work. This issue is not always reproducible&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
:*Example : An instructor attempts to edit an existing assignment and change the number of review rounds. The reassignment causes an error in the system and this prevents the project update to occur.&lt;br /&gt;
'''Steps to reproduce the Issue #972 :'''&lt;br /&gt;
:*We will choose one of the existing assignments in expertiza and try to increase the number of review rounds from &amp;quot;x&amp;quot; to &amp;quot;y&amp;quot;(x&amp;lt;y). when we try to save the assignment we get the error message as shown in the figure 12 below also number of reviews reverts back to &amp;quot;x&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:::::[[File:P4_p1.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:*''“Summary Result Assignment” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
:*Example : As seen in Figure 16 below, the result of hovering over a review result displays the message in raw HTML. The intended result is for review comment to be rendered properly while displaying.&lt;br /&gt;
::-It should be that this issue can be reproduced by going to any student assignment result and attempt to produce a quick view of the review comment by hovering over the desired linked question score.&lt;br /&gt;
:::::[[File:p4_html.PNG]]&lt;br /&gt;
&lt;br /&gt;
== '''Files to be Modified''' ==&lt;br /&gt;
&lt;br /&gt;
:*''app/models/review_assignment.rb''&lt;br /&gt;
:*''app/controllers/assignments_controller.rb''&lt;br /&gt;
:*''app/views/view_team.html.erb''&lt;br /&gt;
&lt;br /&gt;
== '''Solution Design''' ==&lt;br /&gt;
=== Problem 1 : Issue # 1093 ===&lt;br /&gt;
:*If the issue reproducible consistantly we need to fix ''reject_previously_reviewed_submissions(contributor_set, reviewer)'' method in ''review_assignment.rb'' model file. This method is responsible for the seperating the current review topic and previously reviewed topics. solution flow diagram is shown below&lt;br /&gt;
:::::[[File:p1_sol.PNG]]&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*A possible solution is to let the reviewers update the review until the deadline and possibly remove the message &amp;quot;Once submitted, it cannot be changed again&amp;quot;. We can let the reviewers update their reviews multiple times before the deadline.&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*Solution to this issue involves identifying students work as correctly submitted or not submitted so that system will always know that submission status this identification should be available to the method which assigns topics to the reviewer.&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:* To solve this problem we must first identify the necessary actions for which the review round updates are to be executed. From there, we can step through the calls to determine which is not executing as intended. After testing, there is a suspicion that the error is occurring due to the response by, or lack there of, the 'set' button on the edit page beside the rounds value box. The response of this action button determines the outcome of the conditional statement that must evaluate to true to properly update the number of review rounds. Additionally, the 'set' button seems to be inactive upon the first render of the edit page but active on subsequent visits. This update action can be found in the ''update_feedback_assignment_form_attributes'' function of assignments_controller.rb&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:* In this case, we need to identify the mistakes in HTML file and then correct them. final expected outcome is to have processed HTML file.&lt;br /&gt;
::- We believe that this issue stems from one of two places:&lt;br /&gt;
:::(1) The reviewer content is being captured and stored into the database as a string still containing the html formatting and then being populated into the view as a string containing those tags.&lt;br /&gt;
:::(2) There is a tag missing from view_team.html.erb where this hovered content is being requested. There are eight instances where hovered content is referenced. More testing review of the view file will lend to narrowing down the actual line where the problem resides.&lt;br /&gt;
&lt;br /&gt;
== '''Testing Plan''' ==&lt;br /&gt;
''Testing Plan will be implemented upon the discovery of fixed bugs described in the project document as a means of verifying the fix.''&lt;br /&gt;
&lt;br /&gt;
To ensure correctness of bug fixes following test plan was implemented:&lt;br /&gt;
&lt;br /&gt;
:*Obtain the appropriate testing environment via a provided virtual box image and RSPEC testing framework.&lt;br /&gt;
:*Acquire a deeper understanding of the necessary models and views, their functionalities and dependencies.&lt;br /&gt;
:*Create factories and doubles to assist in the testing of these models and views methods.&lt;br /&gt;
:*Mock message passing and expected outcomes.&lt;br /&gt;
:*Apply generated helper objects and mocks to achieve high test coverage of methods within the models and views that were updated.&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
:*[https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit# Project Document]&lt;br /&gt;
:*[https://www.youtube.com/watch?v=CaUOA2WLsOY&amp;amp;list=PLfg44kGPNXFMb72Wnb9BD81h3HHYZDvjJ/edit# Tutorial videos on creating assignments]&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120713</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120713"/>
		<updated>2018-11-21T04:35:15Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Problem 2 : Issue # 1097 */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Project Introduction &amp;amp; Motivation''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
Expertiza Project : E1864 ‘Issues Related to Reviewing' is intended to fix five known issues in the current Expertiza Version related to reviewing student work. Issues are centered around peer reviewing and assignment feature calibration. The motivation behind this project is to identify and resolve each bug in an attempt to improve the current system version. The project has been divided into required fixes. Four of the five problems are presented in the flow diagram below. Problem 5 (Issue # 1142) is not present as the problem is simply associated with the coding of a view file and not directly connected to the flow of students and reviews. Additional discussion on proposed approaches to meet the requirements are explained in subsequent sections.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:FlowDiagram.PNG]]&lt;br /&gt;
:'''Figure 1.Application flow diagram'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
&lt;br /&gt;
== '''UML diagram for reviw''' ==&lt;br /&gt;
&lt;br /&gt;
 [[File:UML_diag.PNG]]&lt;br /&gt;
:'''Figure 2.UML diagram'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
Actors:&lt;br /&gt;
&lt;br /&gt;
:Instructor: This actor is responsible for creating assignments and adding students to the assignment.&lt;br /&gt;
:Student: This actor is responsible for submitting, reviewing other students work.&lt;br /&gt;
&lt;br /&gt;
Database:&lt;br /&gt;
&lt;br /&gt;
The database where all the data of Expertiza is getting stored.&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statements &amp;amp; Descriptions''' ==&lt;br /&gt;
&lt;br /&gt;
For this project, we have been asked to fix the follow bugs that have been found in the current Expertiza system :&lt;br /&gt;
=== Problem 1 : Issue #1093 ===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
:*Example : The project name for which the review was performed earlier should not appear for the next list of reviews when a student requests a review to perform. This could lead to students reviewing the same project more than once and the requirement is to review different projects each time. &lt;br /&gt;
 &lt;br /&gt;
&lt;br /&gt;
 [[File:Prob1.png]]&lt;br /&gt;
:'''Figure 3.Duplicate topic issue'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1093:'''&lt;br /&gt;
Figure 1 gives the holistic view on stages in which we see the issues. In this part, we will discuss the exact steps that need to be followed to reproduce the bugs.&lt;br /&gt;
:* Login as Instructor Create new assignment and associate to the course as shown in Figure 4&lt;br /&gt;
:* Add a participant to the assignment. there are two ways to do this in bulk first way is importing all the course participants to assignment . second approach is creating a file containing student details and import them to expertiza &lt;br /&gt;
:* Create topics and teams in expertiza either entering them one by one or from the file &lt;br /&gt;
:* In actual implementation topic association to the teams involves bidding process but for ease of use, we let instructor assign the topic (Figure 5). set min and max number of reviews allowed as shown in &lt;br /&gt;
:* Set the rubrics and number of review rounds (min one round is needed) (Figure 6)&lt;br /&gt;
:* Review assignment should be automatic not instructor controlled(scope of the stated issue is here) as shown in Figure 7&lt;br /&gt;
:* Set the deadlines for submission and review (shown in Figure 8)&lt;br /&gt;
:* Login as a student and submit work(this needs to be done for each team), request for review&lt;br /&gt;
:* If the issue persist system assign the same topic to review multiple times(as shown in Figure2).difficulty with this problem is that its reproducibility factor which is very low.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
 &lt;br /&gt;
[[File:issue1step1.PNG]]&lt;br /&gt;
:'''Figure 4.Assignment creation'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:issue1step2.PNG]]&lt;br /&gt;
:'''Figure 5.Topic assosciation to teams''' &lt;br /&gt;
:---------------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
[[File:issue1step3.PNG]]&lt;br /&gt;
:'''Figure 6.Rubric settings''' &lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
 &lt;br /&gt;
[[File:issue1step4.PNG]]&lt;br /&gt;
:'''Figure 7.Review settings '''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
 &lt;br /&gt;
[[File:issue1step5.PNG]]&lt;br /&gt;
:'''Figure 8.Deadline settings'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
:*Example : When the reviewer submits a review for a project, the reviewer cannot edit/ update again. Before submitting it says &amp;quot;Once submitted, the review cannot be changed again&amp;quot;. &lt;br /&gt;
Real life example : When a reviewer submits the review 1 a few minutes after the deadline, the rubric for review 2 occurs. So the review 1 actually becomes review 2 and the reviewer was not able to update this review. In situations like these, update the submitted review becomes useful.&lt;br /&gt;
&lt;br /&gt;
Steps to reproduce the issue:&lt;br /&gt;
*Login as Instructor Create new assignment and associate to the course as shown in Figure 4&lt;br /&gt;
*Add a participant to the assignment. there are two ways to do this in bulk first way is importing all the course participants to assignment . second approach is creating a file containing student details and import them to expertiza&lt;br /&gt;
*Create topics and teams in expertiza either entering them one by one or from the file&lt;br /&gt;
*In actual implementation topic association to the teams involves bidding process but for ease of use, we let instructor assign the topic (Figure 5). Set min and max number of reviews allowed as shown in (Figure 6)&lt;br /&gt;
*Set the rubrics and number of review rounds (min one round is needed) &lt;br /&gt;
*Review assignment should be automatic not instructor controlled(scope of the stated issue is here) as shown in Figure 7&lt;br /&gt;
*Set the deadlines for submission and review (shown in Figure 8)&lt;br /&gt;
*Login as a student and submit work(this needs to be done for each team), request for review.&lt;br /&gt;
*Change the deadlines for the review to a few days after the present date and check if you are able to update the review. The picture shows deadline to submit is after 14 days. But the reviews are only able to be viewed. &lt;br /&gt;
[[File:1.png]]&lt;br /&gt;
:'''Figure 9.Assignment creation'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:2.png]]&lt;br /&gt;
&lt;br /&gt;
:'''Figure 10.Assignment creation'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:3.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
:'''Figure 11.Assignment creation'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
Possible solution is to let the reviewers update the review until the deadline and possibly remove the message &amp;quot; Once submitted , it cannot be changed again.&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
:*Example : An author of a project has submitted his/her assignment to Expertiza. When a reviewer tries to review the work, sometimes it happens that the system shows the reviewer that the work has not been submitted yet. The reviewer should have been shown the work of the author to review.&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1029:'''&lt;br /&gt;
:* steps to reproduce this issue is similar to issue #1093, only the difference is once reviewer requests the assignment to review system throws a message saying there is no work has been submitted even though there is actually submitted work. This issue is not always reproducible&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
:*Example : An instructor attempts to edit an existing assignment and change the number of review rounds. The reassignment causes an error in the system and this prevents the project update to occur.&lt;br /&gt;
'''Steps to reproduce the Issue #972 :'''&lt;br /&gt;
:*We will choose one of the existing assignments in expertiza and try to increase the number of review rounds from &amp;quot;x&amp;quot; to &amp;quot;y&amp;quot;(x&amp;lt;y). when we try to save the assignment we get the error message as shwon in the figure  below also number of reviews revrts back to &amp;quot;x&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:Issue4fig1.PNG]]&lt;br /&gt;
:'''Figure 9.Error message in Issue #972'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
:*Example : The Calibration Results page has several instances of raw HTML. The intended result was for the raw HTML to be rendered properly while displaying on the page.&lt;br /&gt;
&lt;br /&gt;
== '''Files Modified''' ==&lt;br /&gt;
&lt;br /&gt;
:*''views/review_mapping/_calibration_report.html.erb'' - this file must be altered to handle the bug fix for problem #5.&lt;br /&gt;
:*''app/models/review_assignment.rb''&lt;br /&gt;
&lt;br /&gt;
== '''Solution Design''' ==&lt;br /&gt;
=== Problem 1 : Issue # 1093 ===&lt;br /&gt;
:*If the issue reproducible consistantly we need to fix ''reject_previously_reviewed_submissions(contributor_set, reviewer)'' method in ''review_assignment.rb'' model file. This method is responsible for the seperating the current review topic and previously reviewed topics. solution flow diagram is shown below&lt;br /&gt;
[[File:Issue1soln1.PNG]]&lt;br /&gt;
:'''Figure 10.Proposed solution to Issue #1093'''&lt;br /&gt;
:------------------------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*[''An appropriate solution design and implementation will be suggested in the final design document submission'']&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*Solution to this issue involves identifying students work as correctly submitted or not submitted so that system will always know that submission status this identification should be available to the method which assigns topics to the reviewer.&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:* The proposed solution to this issue is, we need to enable edit operation for the number of review rounds option provided new number is greater than the previous number. The reason behind this is if we allow the instructor to reduce the number of rounds we lose all review data and grades associated with them. also, we need to make sure that increasing the number of rounds should populate same number &amp;quot;review round&amp;quot; attributes (such as deadline submission rights)&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:* In this case, we need to identify the mistakes in HTML file and then correct them. final expected outcome is to have processed HTML file.&lt;br /&gt;
&lt;br /&gt;
== '''Testing Plan''' ==&lt;br /&gt;
''Testing Plan will be implemented upon the discovery of fixed bugs described in the project document as a means of verifying the fix.''&lt;br /&gt;
&lt;br /&gt;
To ensure correctness of bug fixes following test plan was implemented:&lt;br /&gt;
&lt;br /&gt;
:*Obtain the appropriate testing environment via a provided virtual box image and RSPEC testing framework.&lt;br /&gt;
:*Acquire a deeper understanding of the necessary models and views, their functionalities and dependencies.&lt;br /&gt;
:*Create factories and doubles to assist in the testing of these models and views methods.&lt;br /&gt;
:*Mock message passing and expected outcomes.&lt;br /&gt;
:*Apply generated helper objects and mocks to achieve high test coverage of methods within the models and views that were updated.&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
:*[https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit# Project Document]&lt;br /&gt;
:*[https://www.youtube.com/watch?v=CaUOA2WLsOY&amp;amp;list=PLfg44kGPNXFMb72Wnb9BD81h3HHYZDvjJ/edit# Tutorial videos on creating assignments]&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120710</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120710"/>
		<updated>2018-11-21T04:32:05Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Problem 2 : Issue # 1097 */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Project Introduction &amp;amp; Motivation''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
Expertiza Project : E1864 ‘Issues Related to Reviewing' is intended to fix five known issues in the current Expertiza Version related to reviewing student work. Issues are centered around peer reviewing and assignment feature calibration. The motivation behind this project is to identify and resolve each bug in an attempt to improve the current system version. The project has been divided into required fixes. Four of the five problems are presented in the flow diagram below. Problem 5 (Issue # 1142) is not present as the problem is simply associated with the coding of a view file and not directly connected to the flow of students and reviews. Additional discussion on proposed approaches to meet the requirements are explained in subsequent sections.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:FlowDiagram.PNG]]&lt;br /&gt;
:'''Figure 1.Application flow diagram'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
&lt;br /&gt;
== '''UML diagram for reviw''' ==&lt;br /&gt;
&lt;br /&gt;
 [[File:UML_diag.PNG]]&lt;br /&gt;
:'''Figure 2.UML diagram'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
Actors:&lt;br /&gt;
&lt;br /&gt;
:Instructor: This actor is responsible for creating assignments and adding students to the assignment.&lt;br /&gt;
:Student: This actor is responsible for submitting, reviewing other students work.&lt;br /&gt;
&lt;br /&gt;
Database:&lt;br /&gt;
&lt;br /&gt;
The database where all the data of Expertiza is getting stored.&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statements &amp;amp; Descriptions''' ==&lt;br /&gt;
&lt;br /&gt;
For this project, we have been asked to fix the follow bugs that have been found in the current Expertiza system :&lt;br /&gt;
=== Problem 1 : Issue #1093 ===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
:*Example : The project name for which the review was performed earlier should not appear for the next list of reviews when a student requests a review to perform. This could lead to students reviewing the same project more than once and the requirement is to review different projects each time. &lt;br /&gt;
 &lt;br /&gt;
&lt;br /&gt;
 [[File:Prob1.png]]&lt;br /&gt;
:'''Figure 3.Duplicate topic issue'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1093:'''&lt;br /&gt;
Figure 1 gives the holistic view on stages in which we see the issues. In this part, we will discuss the exact steps that need to be followed to reproduce the bugs.&lt;br /&gt;
:* Login as Instructor Create new assignment and associate to the course as shown in Figure 4&lt;br /&gt;
:* Add a participant to the assignment. there are two ways to do this in bulk first way is importing all the course participants to assignment . second approach is creating a file containing student details and import them to expertiza &lt;br /&gt;
:* Create topics and teams in expertiza either entering them one by one or from the file &lt;br /&gt;
:* In actual implementation topic association to the teams involves bidding process but for ease of use, we let instructor assign the topic (Figure 5). set min and max number of reviews allowed as shown in &lt;br /&gt;
:* Set the rubrics and number of review rounds (min one round is needed) (Figure 6)&lt;br /&gt;
:* Review assignment should be automatic not instructor controlled(scope of the stated issue is here) as shown in Figure 7&lt;br /&gt;
:* Set the deadlines for submission and review (shown in Figure 8)&lt;br /&gt;
:* Login as a student and submit work(this needs to be done for each team), request for review&lt;br /&gt;
:* If the issue persist system assign the same topic to review multiple times(as shown in Figure2).difficulty with this problem is that its reproducibility factor which is very low.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
 &lt;br /&gt;
[[File:issue1step1.PNG]]&lt;br /&gt;
:'''Figure 4.Assignment creation'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:issue1step2.PNG]]&lt;br /&gt;
:'''Figure 5.Topic assosciation to teams''' &lt;br /&gt;
:---------------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
[[File:issue1step3.PNG]]&lt;br /&gt;
:'''Figure 6.Rubric settings''' &lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
 &lt;br /&gt;
[[File:issue1step4.PNG]]&lt;br /&gt;
:'''Figure 7.Review settings '''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
 &lt;br /&gt;
[[File:issue1step5.PNG]]&lt;br /&gt;
:'''Figure 8.Deadline settings'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
:*Example : When the reviewer submits a review for a project, the reviewer cannot edit/ update again. Before submitting it says &amp;quot;Once submitted, the review cannot be changed again&amp;quot;. &lt;br /&gt;
Real life example : When a reviewer submits the review 1 a few minutes after the deadline, the rubric for review 2 occurs. So the review 1 actually becomes review 2 and the reviewer was not able to update this review. In situations like these, update the submitted review becomes useful.&lt;br /&gt;
&lt;br /&gt;
Steps to reproduce the issue:&lt;br /&gt;
*Login as Instructor Create new assignment and associate to the course as shown in Figure 4&lt;br /&gt;
*Add a participant to the assignment. there are two ways to do this in bulk first way is importing all the course participants to assignment . second approach is creating a file containing student details and import them to expertiza&lt;br /&gt;
*Create topics and teams in expertiza either entering them one by one or from the file&lt;br /&gt;
*In actual implementation topic association to the teams involves bidding process but for ease of use, we let instructor assign the topic (Figure 5). Set min and max number of reviews allowed as shown in (Figure 6)&lt;br /&gt;
*Set the rubrics and number of review rounds (min one round is needed) &lt;br /&gt;
*Review assignment should be automatic not instructor controlled(scope of the stated issue is here) as shown in Figure 7&lt;br /&gt;
*Set the deadlines for submission and review (shown in Figure 8)&lt;br /&gt;
*Login as a student and submit work(this needs to be done for each team), request for review.&lt;br /&gt;
*Change the deadlines for the review to a few days after the present date and check if you are able to update the review. The picture shows deadline to submit is after 14 days. But the reviews are only able to be viewed. &lt;br /&gt;
[[File:1.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:2.png]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:3.png]]&lt;br /&gt;
Possible solution is to let the reviewers update the review until the deadline and possibly remove the message &amp;quot; Once submitted , it cannot be changed again.&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
:*Example : An author of a project has submitted his/her assignment to Expertiza. When a reviewer tries to review the work, sometimes it happens that the system shows the reviewer that the work has not been submitted yet. The reviewer should have been shown the work of the author to review.&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1029:'''&lt;br /&gt;
:* steps to reproduce this issue is similar to issue #1093, only the difference is once reviewer requests the assignment to review system throws a message saying there is no work has been submitted even though there is actually submitted work. This issue is not always reproducible&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
:*Example : An instructor attempts to edit an existing assignment and change the number of review rounds. The reassignment causes an error in the system and this prevents the project update to occur.&lt;br /&gt;
'''Steps to reproduce the Issue #972 :'''&lt;br /&gt;
:*We will choose one of the existing assignments in expertiza and try to increase the number of review rounds from &amp;quot;x&amp;quot; to &amp;quot;y&amp;quot;(x&amp;lt;y). when we try to save the assignment we get the error message as shwon in the figure  below also number of reviews revrts back to &amp;quot;x&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:Issue4fig1.PNG]]&lt;br /&gt;
:'''Figure 9.Error message in Issue #972'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
:*Example : The Calibration Results page has several instances of raw HTML. The intended result was for the raw HTML to be rendered properly while displaying on the page.&lt;br /&gt;
&lt;br /&gt;
== '''Files Modified''' ==&lt;br /&gt;
&lt;br /&gt;
:*''views/review_mapping/_calibration_report.html.erb'' - this file must be altered to handle the bug fix for problem #5.&lt;br /&gt;
:*''app/models/review_assignment.rb''&lt;br /&gt;
&lt;br /&gt;
== '''Solution Design''' ==&lt;br /&gt;
=== Problem 1 : Issue # 1093 ===&lt;br /&gt;
:*If the issue reproducible consistantly we need to fix ''reject_previously_reviewed_submissions(contributor_set, reviewer)'' method in ''review_assignment.rb'' model file. This method is responsible for the seperating the current review topic and previously reviewed topics. solution flow diagram is shown below&lt;br /&gt;
[[File:Issue1soln1.PNG]]&lt;br /&gt;
:'''Figure 10.Proposed solution to Issue #1093'''&lt;br /&gt;
:------------------------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*[''An appropriate solution design and implementation will be suggested in the final design document submission'']&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*Solution to this issue involves identifying students work as correctly submitted or not submitted so that system will always know that submission status this identification should be available to the method which assigns topics to the reviewer.&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:* The proposed solution to this issue is, we need to enable edit operation for the number of review rounds option provided new number is greater than the previous number. The reason behind this is if we allow the instructor to reduce the number of rounds we lose all review data and grades associated with them. also, we need to make sure that increasing the number of rounds should populate same number &amp;quot;review round&amp;quot; attributes (such as deadline submission rights)&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:* In this case, we need to identify the mistakes in HTML file and then correct them. final expected outcome is to have processed HTML file.&lt;br /&gt;
&lt;br /&gt;
== '''Testing Plan''' ==&lt;br /&gt;
''Testing Plan will be implemented upon the discovery of fixed bugs described in the project document as a means of verifying the fix.''&lt;br /&gt;
&lt;br /&gt;
To ensure correctness of bug fixes following test plan was implemented:&lt;br /&gt;
&lt;br /&gt;
:*Obtain the appropriate testing environment via a provided virtual box image and RSPEC testing framework.&lt;br /&gt;
:*Acquire a deeper understanding of the necessary models and views, their functionalities and dependencies.&lt;br /&gt;
:*Create factories and doubles to assist in the testing of these models and views methods.&lt;br /&gt;
:*Mock message passing and expected outcomes.&lt;br /&gt;
:*Apply generated helper objects and mocks to achieve high test coverage of methods within the models and views that were updated.&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
:*[https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit# Project Document]&lt;br /&gt;
:*[https://www.youtube.com/watch?v=CaUOA2WLsOY&amp;amp;list=PLfg44kGPNXFMb72Wnb9BD81h3HHYZDvjJ/edit# Tutorial videos on creating assignments]&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:3.png&amp;diff=120707</id>
		<title>File:3.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:3.png&amp;diff=120707"/>
		<updated>2018-11-21T04:30:36Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: uploaded a new version of &amp;amp;quot;File:3.png&amp;amp;quot;&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;IS-A and HAS-A Rules of Inheritance&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:2.png&amp;diff=120706</id>
		<title>File:2.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:2.png&amp;diff=120706"/>
		<updated>2018-11-21T04:30:27Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: uploaded a new version of &amp;amp;quot;File:2.png&amp;amp;quot;&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;Double diamond problem&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:1.png&amp;diff=120705</id>
		<title>File:1.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:1.png&amp;diff=120705"/>
		<updated>2018-11-21T04:30:08Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: uploaded a new version of &amp;amp;quot;File:1.png&amp;amp;quot;&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;Distributed Version Control System&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120703</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=120703"/>
		<updated>2018-11-21T04:29:32Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Problem 2 : Issue # 1097 */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Project Introduction &amp;amp; Motivation''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
Expertiza Project : E1864 ‘Issues Related to Reviewing' is intended to fix five known issues in the current Expertiza Version related to reviewing student work. Issues are centered around peer reviewing and assignment feature calibration. The motivation behind this project is to identify and resolve each bug in an attempt to improve the current system version. The project has been divided into required fixes. Four of the five problems are presented in the flow diagram below. Problem 5 (Issue # 1142) is not present as the problem is simply associated with the coding of a view file and not directly connected to the flow of students and reviews. Additional discussion on proposed approaches to meet the requirements are explained in subsequent sections.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:FlowDiagram.PNG]]&lt;br /&gt;
:'''Figure 1.Application flow diagram'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
&lt;br /&gt;
== '''UML diagram for reviw''' ==&lt;br /&gt;
&lt;br /&gt;
 [[File:UML_diag.PNG]]&lt;br /&gt;
:'''Figure 2.UML diagram'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
Actors:&lt;br /&gt;
&lt;br /&gt;
:Instructor: This actor is responsible for creating assignments and adding students to the assignment.&lt;br /&gt;
:Student: This actor is responsible for submitting, reviewing other students work.&lt;br /&gt;
&lt;br /&gt;
Database:&lt;br /&gt;
&lt;br /&gt;
The database where all the data of Expertiza is getting stored.&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statements &amp;amp; Descriptions''' ==&lt;br /&gt;
&lt;br /&gt;
For this project, we have been asked to fix the follow bugs that have been found in the current Expertiza system :&lt;br /&gt;
=== Problem 1 : Issue #1093 ===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
:*Example : The project name for which the review was performed earlier should not appear for the next list of reviews when a student requests a review to perform. This could lead to students reviewing the same project more than once and the requirement is to review different projects each time. &lt;br /&gt;
 &lt;br /&gt;
&lt;br /&gt;
 [[File:Prob1.png]]&lt;br /&gt;
:'''Figure 3.Duplicate topic issue'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1093:'''&lt;br /&gt;
Figure 1 gives the holistic view on stages in which we see the issues. In this part, we will discuss the exact steps that need to be followed to reproduce the bugs.&lt;br /&gt;
:* Login as Instructor Create new assignment and associate to the course as shown in Figure 4&lt;br /&gt;
:* Add a participant to the assignment. there are two ways to do this in bulk first way is importing all the course participants to assignment . second approach is creating a file containing student details and import them to expertiza &lt;br /&gt;
:* Create topics and teams in expertiza either entering them one by one or from the file &lt;br /&gt;
:* In actual implementation topic association to the teams involves bidding process but for ease of use, we let instructor assign the topic (Figure 5). set min and max number of reviews allowed as shown in &lt;br /&gt;
:* Set the rubrics and number of review rounds (min one round is needed) (Figure 6)&lt;br /&gt;
:* Review assignment should be automatic not instructor controlled(scope of the stated issue is here) as shown in Figure 7&lt;br /&gt;
:* Set the deadlines for submission and review (shown in Figure 8)&lt;br /&gt;
:* Login as a student and submit work(this needs to be done for each team), request for review&lt;br /&gt;
:* If the issue persist system assign the same topic to review multiple times(as shown in Figure2).difficulty with this problem is that its reproducibility factor which is very low.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
 &lt;br /&gt;
[[File:issue1step1.PNG]]&lt;br /&gt;
:'''Figure 4.Assignment creation'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:issue1step2.PNG]]&lt;br /&gt;
:'''Figure 5.Topic assosciation to teams''' &lt;br /&gt;
:---------------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
[[File:issue1step3.PNG]]&lt;br /&gt;
:'''Figure 6.Rubric settings''' &lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
 &lt;br /&gt;
[[File:issue1step4.PNG]]&lt;br /&gt;
:'''Figure 7.Review settings '''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
 &lt;br /&gt;
[[File:issue1step5.PNG]]&lt;br /&gt;
:'''Figure 8.Deadline settings'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
:*Example : When the reviewer submits a review for a project, the reviewer cannot edit/ update again. Before submitting it says &amp;quot;Once submitted, the review cannot be changed again&amp;quot;. &lt;br /&gt;
Real life example : When a reviewer submits the review 1 a few minutes after the deadline, the rubric for review 2 occurs. So the review 1 actually becomes review 2 and the reviewer was not able to update this review. In situations like these, update the submitted review becomes useful.&lt;br /&gt;
&lt;br /&gt;
Steps to reproduce the issue:&lt;br /&gt;
*Login as Instructor Create new assignment and associate to the course as shown in Figure 4&lt;br /&gt;
*Add a participant to the assignment. there are two ways to do this in bulk first way is importing all the course participants to assignment . second approach is creating a file containing student details and import them to expertiza&lt;br /&gt;
*Create topics and teams in expertiza either entering them one by one or from the file&lt;br /&gt;
*In actual implementation topic association to the teams involves bidding process but for ease of use, we let instructor assign the topic (Figure 5). Set min and max number of reviews allowed as shown in (Figure 6)&lt;br /&gt;
*Set the rubrics and number of review rounds (min one round is needed) &lt;br /&gt;
*Review assignment should be automatic not instructor controlled(scope of the stated issue is here) as shown in Figure 7&lt;br /&gt;
*Set the deadlines for submission and review (shown in Figure 8)&lt;br /&gt;
*Login as a student and submit work(this needs to be done for each team), request for review.&lt;br /&gt;
*Change the deadlines for the review to a few days after the present date and check if you are able to update the review. The picture shows deadline to submit is after 14 days. But the reviews are only able to be viewed. &lt;br /&gt;
&lt;br /&gt;
Possible solution is to let the reviewers update the review until the deadline and possibly remove the message &amp;quot; Once submitted , it cannot be changed again.&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
:*Example : An author of a project has submitted his/her assignment to Expertiza. When a reviewer tries to review the work, sometimes it happens that the system shows the reviewer that the work has not been submitted yet. The reviewer should have been shown the work of the author to review.&lt;br /&gt;
&lt;br /&gt;
'''Steps to reproduce the Issue #1029:'''&lt;br /&gt;
:* steps to reproduce this issue is similar to issue #1093, only the difference is once reviewer requests the assignment to review system throws a message saying there is no work has been submitted even though there is actually submitted work. This issue is not always reproducible&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
:*Example : An instructor attempts to edit an existing assignment and change the number of review rounds. The reassignment causes an error in the system and this prevents the project update to occur.&lt;br /&gt;
'''Steps to reproduce the Issue #972 :'''&lt;br /&gt;
:*We will choose one of the existing assignments in expertiza and try to increase the number of review rounds from &amp;quot;x&amp;quot; to &amp;quot;y&amp;quot;(x&amp;lt;y). when we try to save the assignment we get the error message as shwon in the figure  below also number of reviews revrts back to &amp;quot;x&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[File:Issue4fig1.PNG]]&lt;br /&gt;
:'''Figure 9.Error message in Issue #972'''&lt;br /&gt;
:-----------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
:*Example : The Calibration Results page has several instances of raw HTML. The intended result was for the raw HTML to be rendered properly while displaying on the page.&lt;br /&gt;
&lt;br /&gt;
== '''Files Modified''' ==&lt;br /&gt;
&lt;br /&gt;
:*''views/review_mapping/_calibration_report.html.erb'' - this file must be altered to handle the bug fix for problem #5.&lt;br /&gt;
:*''app/models/review_assignment.rb''&lt;br /&gt;
&lt;br /&gt;
== '''Solution Design''' ==&lt;br /&gt;
=== Problem 1 : Issue # 1093 ===&lt;br /&gt;
:*If the issue reproducible consistantly we need to fix ''reject_previously_reviewed_submissions(contributor_set, reviewer)'' method in ''review_assignment.rb'' model file. This method is responsible for the seperating the current review topic and previously reviewed topics. solution flow diagram is shown below&lt;br /&gt;
[[File:Issue1soln1.PNG]]&lt;br /&gt;
:'''Figure 10.Proposed solution to Issue #1093'''&lt;br /&gt;
:------------------------------------------------------------&lt;br /&gt;
:&lt;br /&gt;
:&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*[''An appropriate solution design and implementation will be suggested in the final design document submission'']&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*Solution to this issue involves identifying students work as correctly submitted or not submitted so that system will always know that submission status this identification should be available to the method which assigns topics to the reviewer.&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:* The proposed solution to this issue is, we need to enable edit operation for the number of review rounds option provided new number is greater than the previous number. The reason behind this is if we allow the instructor to reduce the number of rounds we lose all review data and grades associated with them. also, we need to make sure that increasing the number of rounds should populate same number &amp;quot;review round&amp;quot; attributes (such as deadline submission rights)&lt;br /&gt;
&lt;br /&gt;
=== Problem 5 : Issue # 1142 ===&lt;br /&gt;
:* In this case, we need to identify the mistakes in HTML file and then correct them. final expected outcome is to have processed HTML file.&lt;br /&gt;
&lt;br /&gt;
== '''Testing Plan''' ==&lt;br /&gt;
''Testing Plan will be implemented upon the discovery of fixed bugs described in the project document as a means of verifying the fix.''&lt;br /&gt;
&lt;br /&gt;
To ensure correctness of bug fixes following test plan was implemented:&lt;br /&gt;
&lt;br /&gt;
:*Obtain the appropriate testing environment via a provided virtual box image and RSPEC testing framework.&lt;br /&gt;
:*Acquire a deeper understanding of the necessary models and views, their functionalities and dependencies.&lt;br /&gt;
:*Create factories and doubles to assist in the testing of these models and views methods.&lt;br /&gt;
:*Mock message passing and expected outcomes.&lt;br /&gt;
:*Apply generated helper objects and mocks to achieve high test coverage of methods within the models and views that were updated.&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
:*[https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit# Project Document]&lt;br /&gt;
:*[https://www.youtube.com/watch?v=CaUOA2WLsOY&amp;amp;list=PLfg44kGPNXFMb72Wnb9BD81h3HHYZDvjJ/edit# Tutorial videos on creating assignments]&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119354</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119354"/>
		<updated>2018-11-10T22:34:16Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Problem Statement */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Project Introduction &amp;amp; Motivation''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
The project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem requirements and each of them is addressing an individual issue we need to fix. The description and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Files Modified''' ==&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
*The project name for which the review was performed earlier should not appear for the next list of reviews when a student requests a review to perform. This issue should be fixed because the students might review the same project more than once and the requirement is to review different projects each time.&lt;br /&gt;
  [[File:prob1.png|center]]&lt;br /&gt;
*When the author resubmits, then reviewers should be able to Update (not Edit) their reviews, even if those reviews have already been submitted. Current system does not allow reviewers to update their reviews. This issue should be fixed because the students can effortlessly perform the reviews by just updating and not editing the new one.&lt;br /&gt;
&lt;br /&gt;
*When a reviewer tries to review a work, sometimes it happens that system shows the reviewer that the work has not been submitted yet. However, author has really submitted the work. Such situation should not happen. Reviewer should be shown the work of the author to review.&lt;br /&gt;
&lt;br /&gt;
*In current system, when we edit an existing assignment and change the number of review rounds, it doesn’t work and it fails with an error. This issues needs to be fixed.&lt;br /&gt;
&lt;br /&gt;
*“Show calibration results” page shows raw HTML. Actually it should be processed as HTML while displaying on the page. This needs to be fixed&lt;br /&gt;
&lt;br /&gt;
== '''Project Requirements''' ==&lt;br /&gt;
For this project, we have been asked to fix the follow bugs that have been found in the current Expertiza system :&lt;br /&gt;
=== Problem 1 : Issue #1093 ===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 1142 ===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== '''Solution Design''' ==&lt;br /&gt;
=== Problem 1 ===&lt;br /&gt;
:*''insert''&lt;br /&gt;
=== Problem 2 ===&lt;br /&gt;
:*''insert''&lt;br /&gt;
=== Problem 3 ===&lt;br /&gt;
:*''insert''&lt;br /&gt;
=== Problem 4 ===&lt;br /&gt;
:*''insert''&lt;br /&gt;
&lt;br /&gt;
== '''Testing Plan''' ==&lt;br /&gt;
&lt;br /&gt;
To ensure correctness of bug fixes following test plan was implemented:&lt;br /&gt;
&lt;br /&gt;
:*Obtain the appropriate testing environment via a provided virtual box image and RSPEC testing framework.&lt;br /&gt;
:*Acquire a deeper understanding of the necessary models and views, their functionalities and dependencies.&lt;br /&gt;
:*Create factories and doubles to assist in the testing of these models and views methods.&lt;br /&gt;
:*Mock message passing and expected outcomes.&lt;br /&gt;
:*Apply generated helper objects and mocks to achieve high test coverage of methods within the models and views that were updated.&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
:*[https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit# Project Document]&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:Prob1.png&amp;diff=119353</id>
		<title>File:Prob1.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:Prob1.png&amp;diff=119353"/>
		<updated>2018-11-10T22:33:51Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: uploaded a new version of &amp;amp;quot;File:Prob1.png&amp;amp;quot;&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119350</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119350"/>
		<updated>2018-11-10T22:29:46Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Problem Statement */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Project Introduction &amp;amp; Motivation''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
The project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem requirements and each of them is addressing an individual issue we need to fix. The description and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Files Modified''' ==&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
*The project name for which the review was performed earlier should not appear for the next list of reviews when a student requests a review to perform. This issue should be fixed because the students might review the same project more than once and the requirement is to review different projects each time.&lt;br /&gt;
  [[File:prob1.png|frame|upright|center]]&lt;br /&gt;
*When the author resubmits, then reviewers should be able to Update (not Edit) their reviews, even if those reviews have already been submitted. Current system does not allow reviewers to update their reviews. This issue should be fixed because the students can effortlessly perform the reviews by just updating and not editing the new one.&lt;br /&gt;
&lt;br /&gt;
*When a reviewer tries to review a work, sometimes it happens that system shows the reviewer that the work has not been submitted yet. However, author has really submitted the work. Such situation should not happen. Reviewer should be shown the work of the author to review.&lt;br /&gt;
&lt;br /&gt;
*In current system, when we edit an existing assignment and change the number of review rounds, it doesn’t work and it fails with an error. This issues needs to be fixed.&lt;br /&gt;
&lt;br /&gt;
*“Show calibration results” page shows raw HTML. Actually it should be processed as HTML while displaying on the page. This needs to be fixed&lt;br /&gt;
&lt;br /&gt;
== '''Project Requirements''' ==&lt;br /&gt;
For this project, we have been asked to fix the follow bugs that have been found in the current Expertiza system :&lt;br /&gt;
=== Problem 1 : Issue #1093 ===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 1142 ===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== '''Solution Design''' ==&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''Testing Plan''' ==&lt;br /&gt;
&lt;br /&gt;
To ensure correctness of bug fixes following test plan was implemented:&lt;br /&gt;
&lt;br /&gt;
:*Obtain the appropriate testing environment via a provided virtual box image and RSPEC testing framework.&lt;br /&gt;
:*Acquire a deeper understanding of the necessary models and views, their functionalities and dependencies.&lt;br /&gt;
:*Create factories and doubles to assist in the testing of these models and views methods.&lt;br /&gt;
:*Mock message passing and expected outcomes.&lt;br /&gt;
:*Apply generated helper objects and mocks to achieve high test coverage of methods within the models and views that were updated.&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
:*[https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit# Project Document]&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119349</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119349"/>
		<updated>2018-11-10T22:29:15Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Problem Statement */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Project Introduction &amp;amp; Motivation''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
The project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem requirements and each of them is addressing an individual issue we need to fix. The description and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Files Modified''' ==&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
*The project name for which the review was performed earlier should not appear for the next list of reviews when a student requests a review to perform. This issue should be fixed because the students might review the same project more than once and the requirement is to review different projects each time.&lt;br /&gt;
  [[File:prob1.png]]&lt;br /&gt;
*When the author resubmits, then reviewers should be able to Update (not Edit) their reviews, even if those reviews have already been submitted. Current system does not allow reviewers to update their reviews. This issue should be fixed because the students can effortlessly perform the reviews by just updating and not editing the new one.&lt;br /&gt;
&lt;br /&gt;
*When a reviewer tries to review a work, sometimes it happens that system shows the reviewer that the work has not been submitted yet. However, author has really submitted the work. Such situation should not happen. Reviewer should be shown the work of the author to review.&lt;br /&gt;
&lt;br /&gt;
*In current system, when we edit an existing assignment and change the number of review rounds, it doesn’t work and it fails with an error. This issues needs to be fixed.&lt;br /&gt;
&lt;br /&gt;
*“Show calibration results” page shows raw HTML. Actually it should be processed as HTML while displaying on the page. This needs to be fixed&lt;br /&gt;
&lt;br /&gt;
== '''Project Requirements''' ==&lt;br /&gt;
For this project, we have been asked to fix the follow bugs that have been found in the current Expertiza system :&lt;br /&gt;
=== Problem 1 : Issue #1093 ===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 1142 ===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== '''Solution Design''' ==&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''Testing Plan''' ==&lt;br /&gt;
&lt;br /&gt;
To ensure correctness of bug fixes following test plan was implemented:&lt;br /&gt;
&lt;br /&gt;
:*Obtain the appropriate testing environment via a provided virtual box image and RSPEC testing framework.&lt;br /&gt;
:*Acquire a deeper understanding of the necessary models and views, their functionalities and dependencies.&lt;br /&gt;
:*Create factories and doubles to assist in the testing of these models and views methods.&lt;br /&gt;
:*Mock message passing and expected outcomes.&lt;br /&gt;
:*Apply generated helper objects and mocks to achieve high test coverage of methods within the models and views that were updated.&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
:*[https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit# Project Document]&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:Prob1.png&amp;diff=119348</id>
		<title>File:Prob1.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:Prob1.png&amp;diff=119348"/>
		<updated>2018-11-10T22:28:25Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119337</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119337"/>
		<updated>2018-11-10T22:19:09Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Problem Statement */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Project Introduction &amp;amp; Motivation''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
The project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem requirements and each of them is addressing an individual issue we need to fix. The description and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Files Modified''' ==&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
*The project name for which the review was performed earlier should not appear for the next list of reviews when a student requests a review to perform. This issue should be fixed because the students might review the same project more than once and the requirement is to review different projects each time.&lt;br /&gt;
  &lt;br /&gt;
*When the author resubmits, then reviewers should be able to Update (not Edit) their reviews, even if those reviews have already been submitted. Current system does not allow reviewers to update their reviews. This issue should be fixed because the students can effortlessly perform the reviews by just updating and not editing the new one.&lt;br /&gt;
&lt;br /&gt;
*When a reviewer tries to review a work, sometimes it happens that system shows the reviewer that the work has not been submitted yet. However, author has really submitted the work. Such situation should not happen. Reviewer should be shown the work of the author to review.&lt;br /&gt;
&lt;br /&gt;
*In current system, when we edit an existing assignment and change the number of review rounds, it doesn’t work and it fails with an error. This issues needs to be fixed.&lt;br /&gt;
&lt;br /&gt;
*“Show calibration results” page shows raw HTML. Actually it should be processed as HTML while displaying on the page. This needs to be fixed&lt;br /&gt;
&lt;br /&gt;
== '''Project Requirements''' ==&lt;br /&gt;
For this project, we have been asked to fix the follow bugs that have been found in the current Expertiza system :&lt;br /&gt;
=== Problem 1 : Issue #1093 ===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
=== Problem 2 : Issue # 1097 ===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
=== Problem 3 : Issue # 1029 ===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 972 ===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
=== Problem 4 : Issue # 1142 ===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== '''Solution Design''' ==&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== '''Testing Plan''' ==&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
:*[https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit# Project Document]&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119328</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119328"/>
		<updated>2018-11-10T21:55:59Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* References */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
== '''Motivation''' ==&lt;br /&gt;
'''Previous Implementation'''&lt;br /&gt;
*When a student requests a review to perform, same reviews appear multiple times in a list of reviews.&lt;br /&gt;
*The current system does not allow the students to update the reviews. They are only allowed to edit the reviews even if has already been submitted.&lt;br /&gt;
*The system shows the reviewer that the work has not been submitted yet even when it has already been submitted.&lt;br /&gt;
*The system fails and throws an error we edit an existing assignment and change the number of review rounds.&lt;br /&gt;
&lt;br /&gt;
'''Motivation'''&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
The project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem statements and each of them is addressing an individual issue we need to fix. The statements and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
== '''Project requirement''' ==&lt;br /&gt;
===Problem 1 : Issue #1093===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
===Problem 2 : Issue #1097===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
===Problem 3 : Issue #1029===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #972===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #1142===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== '''Task Description''' ==&lt;br /&gt;
&lt;br /&gt;
== '''Use Cases''' ==&lt;br /&gt;
&lt;br /&gt;
== '''Unit Testing''' ==&lt;br /&gt;
&lt;br /&gt;
== '''Testing Plan''' ==&lt;br /&gt;
&lt;br /&gt;
== '''References''' ==&lt;br /&gt;
https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit#&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119327</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119327"/>
		<updated>2018-11-10T21:55:51Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Testing Plan */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
== '''Motivation''' ==&lt;br /&gt;
'''Previous Implementation'''&lt;br /&gt;
*When a student requests a review to perform, same reviews appear multiple times in a list of reviews.&lt;br /&gt;
*The current system does not allow the students to update the reviews. They are only allowed to edit the reviews even if has already been submitted.&lt;br /&gt;
*The system shows the reviewer that the work has not been submitted yet even when it has already been submitted.&lt;br /&gt;
*The system fails and throws an error we edit an existing assignment and change the number of review rounds.&lt;br /&gt;
&lt;br /&gt;
'''Motivation'''&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
The project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem statements and each of them is addressing an individual issue we need to fix. The statements and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
== '''Project requirement''' ==&lt;br /&gt;
===Problem 1 : Issue #1093===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
===Problem 2 : Issue #1097===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
===Problem 3 : Issue #1029===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #972===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #1142===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== '''Task Description''' ==&lt;br /&gt;
&lt;br /&gt;
== '''Use Cases''' ==&lt;br /&gt;
&lt;br /&gt;
== '''Unit Testing''' ==&lt;br /&gt;
&lt;br /&gt;
== '''Testing Plan''' ==&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit#&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119326</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119326"/>
		<updated>2018-11-10T21:55:42Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Unit Testing */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
== '''Motivation''' ==&lt;br /&gt;
'''Previous Implementation'''&lt;br /&gt;
*When a student requests a review to perform, same reviews appear multiple times in a list of reviews.&lt;br /&gt;
*The current system does not allow the students to update the reviews. They are only allowed to edit the reviews even if has already been submitted.&lt;br /&gt;
*The system shows the reviewer that the work has not been submitted yet even when it has already been submitted.&lt;br /&gt;
*The system fails and throws an error we edit an existing assignment and change the number of review rounds.&lt;br /&gt;
&lt;br /&gt;
'''Motivation'''&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
The project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem statements and each of them is addressing an individual issue we need to fix. The statements and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
== '''Project requirement''' ==&lt;br /&gt;
===Problem 1 : Issue #1093===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
===Problem 2 : Issue #1097===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
===Problem 3 : Issue #1029===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #972===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #1142===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== '''Task Description''' ==&lt;br /&gt;
&lt;br /&gt;
== '''Use Cases''' ==&lt;br /&gt;
&lt;br /&gt;
== '''Unit Testing''' ==&lt;br /&gt;
&lt;br /&gt;
== Testing Plan ==&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit#&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119325</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119325"/>
		<updated>2018-11-10T21:55:35Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Use Cases */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
== '''Motivation''' ==&lt;br /&gt;
'''Previous Implementation'''&lt;br /&gt;
*When a student requests a review to perform, same reviews appear multiple times in a list of reviews.&lt;br /&gt;
*The current system does not allow the students to update the reviews. They are only allowed to edit the reviews even if has already been submitted.&lt;br /&gt;
*The system shows the reviewer that the work has not been submitted yet even when it has already been submitted.&lt;br /&gt;
*The system fails and throws an error we edit an existing assignment and change the number of review rounds.&lt;br /&gt;
&lt;br /&gt;
'''Motivation'''&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
The project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem statements and each of them is addressing an individual issue we need to fix. The statements and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
== '''Project requirement''' ==&lt;br /&gt;
===Problem 1 : Issue #1093===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
===Problem 2 : Issue #1097===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
===Problem 3 : Issue #1029===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #972===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #1142===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== '''Task Description''' ==&lt;br /&gt;
&lt;br /&gt;
== '''Use Cases''' ==&lt;br /&gt;
&lt;br /&gt;
== Unit Testing ==&lt;br /&gt;
&lt;br /&gt;
== Testing Plan ==&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit#&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119324</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119324"/>
		<updated>2018-11-10T21:55:27Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Task Description */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
== '''Motivation''' ==&lt;br /&gt;
'''Previous Implementation'''&lt;br /&gt;
*When a student requests a review to perform, same reviews appear multiple times in a list of reviews.&lt;br /&gt;
*The current system does not allow the students to update the reviews. They are only allowed to edit the reviews even if has already been submitted.&lt;br /&gt;
*The system shows the reviewer that the work has not been submitted yet even when it has already been submitted.&lt;br /&gt;
*The system fails and throws an error we edit an existing assignment and change the number of review rounds.&lt;br /&gt;
&lt;br /&gt;
'''Motivation'''&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
The project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem statements and each of them is addressing an individual issue we need to fix. The statements and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
== '''Project requirement''' ==&lt;br /&gt;
===Problem 1 : Issue #1093===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
===Problem 2 : Issue #1097===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
===Problem 3 : Issue #1029===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #972===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #1142===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== '''Task Description''' ==&lt;br /&gt;
&lt;br /&gt;
== Use Cases ==&lt;br /&gt;
&lt;br /&gt;
== Unit Testing ==&lt;br /&gt;
&lt;br /&gt;
== Testing Plan ==&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit#&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119323</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119323"/>
		<updated>2018-11-10T21:55:16Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Project requirement */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
== '''Motivation''' ==&lt;br /&gt;
'''Previous Implementation'''&lt;br /&gt;
*When a student requests a review to perform, same reviews appear multiple times in a list of reviews.&lt;br /&gt;
*The current system does not allow the students to update the reviews. They are only allowed to edit the reviews even if has already been submitted.&lt;br /&gt;
*The system shows the reviewer that the work has not been submitted yet even when it has already been submitted.&lt;br /&gt;
*The system fails and throws an error we edit an existing assignment and change the number of review rounds.&lt;br /&gt;
&lt;br /&gt;
'''Motivation'''&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
The project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem statements and each of them is addressing an individual issue we need to fix. The statements and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
== '''Project requirement''' ==&lt;br /&gt;
===Problem 1 : Issue #1093===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
===Problem 2 : Issue #1097===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
===Problem 3 : Issue #1029===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #972===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #1142===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== Task Description ==&lt;br /&gt;
&lt;br /&gt;
== Use Cases ==&lt;br /&gt;
&lt;br /&gt;
== Unit Testing ==&lt;br /&gt;
&lt;br /&gt;
== Testing Plan ==&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit#&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119322</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119322"/>
		<updated>2018-11-10T21:55:07Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Problem Statement */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
== '''Motivation''' ==&lt;br /&gt;
'''Previous Implementation'''&lt;br /&gt;
*When a student requests a review to perform, same reviews appear multiple times in a list of reviews.&lt;br /&gt;
*The current system does not allow the students to update the reviews. They are only allowed to edit the reviews even if has already been submitted.&lt;br /&gt;
*The system shows the reviewer that the work has not been submitted yet even when it has already been submitted.&lt;br /&gt;
*The system fails and throws an error we edit an existing assignment and change the number of review rounds.&lt;br /&gt;
&lt;br /&gt;
'''Motivation'''&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
The project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem statements and each of them is addressing an individual issue we need to fix. The statements and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Problem Statement''' ==&lt;br /&gt;
&lt;br /&gt;
== Project requirement ==&lt;br /&gt;
===Problem 1 : Issue #1093===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
===Problem 2 : Issue #1097===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
===Problem 3 : Issue #1029===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #972===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #1142===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== Task Description ==&lt;br /&gt;
&lt;br /&gt;
== Use Cases ==&lt;br /&gt;
&lt;br /&gt;
== Unit Testing ==&lt;br /&gt;
&lt;br /&gt;
== Testing Plan ==&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit#&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119321</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119321"/>
		<updated>2018-11-10T21:54:55Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Description of Project */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
== '''Motivation''' ==&lt;br /&gt;
'''Previous Implementation'''&lt;br /&gt;
*When a student requests a review to perform, same reviews appear multiple times in a list of reviews.&lt;br /&gt;
*The current system does not allow the students to update the reviews. They are only allowed to edit the reviews even if has already been submitted.&lt;br /&gt;
*The system shows the reviewer that the work has not been submitted yet even when it has already been submitted.&lt;br /&gt;
*The system fails and throws an error we edit an existing assignment and change the number of review rounds.&lt;br /&gt;
&lt;br /&gt;
'''Motivation'''&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== '''Description of Project''' ==&lt;br /&gt;
The project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem statements and each of them is addressing an individual issue we need to fix. The statements and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== Problem Statement ==&lt;br /&gt;
&lt;br /&gt;
== Project requirement ==&lt;br /&gt;
===Problem 1 : Issue #1093===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
===Problem 2 : Issue #1097===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
===Problem 3 : Issue #1029===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #972===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #1142===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== Task Description ==&lt;br /&gt;
&lt;br /&gt;
== Use Cases ==&lt;br /&gt;
&lt;br /&gt;
== Unit Testing ==&lt;br /&gt;
&lt;br /&gt;
== Testing Plan ==&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit#&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119320</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119320"/>
		<updated>2018-11-10T21:54:40Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: &lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
== '''Motivation''' ==&lt;br /&gt;
'''Previous Implementation'''&lt;br /&gt;
*When a student requests a review to perform, same reviews appear multiple times in a list of reviews.&lt;br /&gt;
*The current system does not allow the students to update the reviews. They are only allowed to edit the reviews even if has already been submitted.&lt;br /&gt;
*The system shows the reviewer that the work has not been submitted yet even when it has already been submitted.&lt;br /&gt;
*The system fails and throws an error we edit an existing assignment and change the number of review rounds.&lt;br /&gt;
&lt;br /&gt;
'''Motivation'''&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== Description of Project ==&lt;br /&gt;
The project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem statements and each of them is addressing an individual issue we need to fix. The statements and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== Problem Statement ==&lt;br /&gt;
&lt;br /&gt;
== Project requirement ==&lt;br /&gt;
===Problem 1 : Issue #1093===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
===Problem 2 : Issue #1097===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
===Problem 3 : Issue #1029===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #972===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #1142===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== Task Description ==&lt;br /&gt;
&lt;br /&gt;
== Use Cases ==&lt;br /&gt;
&lt;br /&gt;
== Unit Testing ==&lt;br /&gt;
&lt;br /&gt;
== Testing Plan ==&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit#&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119318</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119318"/>
		<updated>2018-11-10T21:48:23Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Motivation */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
== '''Motivation''' ==&lt;br /&gt;
'''Previous Implementation'''&lt;br /&gt;
*When a student requests a review to perform, same reviews appear multiple times in a list of reviews.&lt;br /&gt;
*The current system does not allow the students to update the reviews. They are only allowed to edit the reviews even if has already been submitted.&lt;br /&gt;
*The system shows the reviewer that the work has not been submitted yet even when it has already been submitted.&lt;br /&gt;
*The system fails and throws an error we edit an existing assignment and change the number of review rounds.&lt;br /&gt;
&lt;br /&gt;
'''Motivation'''&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== Description of Project ==&lt;br /&gt;
The project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem statements and each of them is addressing an individual issue we need to fix. The statements and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== Project requirement ==&lt;br /&gt;
===Problem 1 : Issue #1093===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
===Problem 2 : Issue #1097===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
===Problem 3 : Issue #1029===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #972===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #1142===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== Analysis and Implementation ==&lt;br /&gt;
&lt;br /&gt;
== Use Cases ==&lt;br /&gt;
&lt;br /&gt;
== Unit Testing ==&lt;br /&gt;
&lt;br /&gt;
== Testing Plan ==&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit#&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119317</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119317"/>
		<updated>2018-11-10T21:47:58Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Motivation: */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
== '''Motivation''' ==&lt;br /&gt;
'''Previous Implementation'''&lt;br /&gt;
*When a student requests a review to perform, same reviews appear multiple times in a list of reviews.&lt;br /&gt;
*The current system does not allow the students to update the reviews. They are only allowed to edit the reviews even if has already been submitted.&lt;br /&gt;
*The system shows the reviewer that the work has not been submitted yet even when it has already been submitted.&lt;br /&gt;
*The system fails and throws an error we edit an existing assignment and change the number of review rounds.&lt;br /&gt;
&lt;br /&gt;
== Description of Project ==&lt;br /&gt;
The project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem statements and each of them is addressing an individual issue we need to fix. The statements and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== Project requirement ==&lt;br /&gt;
===Problem 1 : Issue #1093===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
===Problem 2 : Issue #1097===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
===Problem 3 : Issue #1029===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #972===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #1142===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== Analysis and Implementation ==&lt;br /&gt;
&lt;br /&gt;
== Use Cases ==&lt;br /&gt;
&lt;br /&gt;
== Unit Testing ==&lt;br /&gt;
&lt;br /&gt;
== Testing Plan ==&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit#&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119316</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119316"/>
		<updated>2018-11-10T21:47:48Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Motivation */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
== '''Motivation''' ==&lt;br /&gt;
'''Previous Implementation'''&lt;br /&gt;
*When a student requests a review to perform, same reviews appear multiple times in a list of reviews.&lt;br /&gt;
*The current system does not allow the students to update the reviews. They are only allowed to edit the reviews even if has already been submitted.&lt;br /&gt;
*The system shows the reviewer that the work has not been submitted yet even when it has already been submitted.&lt;br /&gt;
*The system fails and throws an error we edit an existing assignment and change the number of review rounds.&lt;br /&gt;
&lt;br /&gt;
== Motivation: ==&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== Description of Project ==&lt;br /&gt;
The project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem statements and each of them is addressing an individual issue we need to fix. The statements and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== Project requirement ==&lt;br /&gt;
===Problem 1 : Issue #1093===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
===Problem 2 : Issue #1097===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
===Problem 3 : Issue #1029===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #972===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #1142===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== Analysis and Implementation ==&lt;br /&gt;
&lt;br /&gt;
== Use Cases ==&lt;br /&gt;
&lt;br /&gt;
== Unit Testing ==&lt;br /&gt;
&lt;br /&gt;
== Testing Plan ==&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit#&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119315</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119315"/>
		<updated>2018-11-10T21:47:24Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Previous Implementation: */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
== '''Motivation''' ==&lt;br /&gt;
== Motivation: ==&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== Description of Project ==&lt;br /&gt;
The project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem statements and each of them is addressing an individual issue we need to fix. The statements and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== Project requirement ==&lt;br /&gt;
===Problem 1 : Issue #1093===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
===Problem 2 : Issue #1097===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
===Problem 3 : Issue #1029===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #972===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #1142===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== Analysis and Implementation ==&lt;br /&gt;
&lt;br /&gt;
== Use Cases ==&lt;br /&gt;
&lt;br /&gt;
== Unit Testing ==&lt;br /&gt;
&lt;br /&gt;
== Testing Plan ==&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit#&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119314</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119314"/>
		<updated>2018-11-10T21:46:55Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Introduction */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== '''Introduction''' ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
== '''Motivation''' ==&lt;br /&gt;
== Previous Implementation: ==&lt;br /&gt;
&lt;br /&gt;
*When a student requests a review to perform, same reviews appear multiple times in a list of reviews.&lt;br /&gt;
*The current system does not allow the students to update the reviews. They are only allowed to edit the reviews even if has already been submitted.&lt;br /&gt;
*The system shows the reviewer that the work has not been submitted yet even when it has already been submitted.&lt;br /&gt;
*The system fails and throws an error we edit an existing assignment and change the number of review rounds. &lt;br /&gt;
== Motivation: ==&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== Description of Project ==&lt;br /&gt;
The project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem statements and each of them is addressing an individual issue we need to fix. The statements and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== Project requirement ==&lt;br /&gt;
===Problem 1 : Issue #1093===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
===Problem 2 : Issue #1097===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
===Problem 3 : Issue #1029===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #972===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #1142===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== Analysis and Implementation ==&lt;br /&gt;
&lt;br /&gt;
== Use Cases ==&lt;br /&gt;
&lt;br /&gt;
== Unit Testing ==&lt;br /&gt;
&lt;br /&gt;
== Testing Plan ==&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit#&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119313</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119313"/>
		<updated>2018-11-10T21:46:05Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Description of Project */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== Introduction ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
== '''Motivation''' ==&lt;br /&gt;
== Previous Implementation: ==&lt;br /&gt;
&lt;br /&gt;
*When a student requests a review to perform, same reviews appear multiple times in a list of reviews.&lt;br /&gt;
*The current system does not allow the students to update the reviews. They are only allowed to edit the reviews even if has already been submitted.&lt;br /&gt;
*The system shows the reviewer that the work has not been submitted yet even when it has already been submitted.&lt;br /&gt;
*The system fails and throws an error we edit an existing assignment and change the number of review rounds. &lt;br /&gt;
== Motivation: ==&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== Description of Project ==&lt;br /&gt;
The project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem statements and each of them is addressing an individual issue we need to fix. The statements and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== Project requirement ==&lt;br /&gt;
===Problem 1 : Issue #1093===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
===Problem 2 : Issue #1097===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
===Problem 3 : Issue #1029===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #972===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #1142===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== Analysis and Implementation ==&lt;br /&gt;
&lt;br /&gt;
== Use Cases ==&lt;br /&gt;
&lt;br /&gt;
== Unit Testing ==&lt;br /&gt;
&lt;br /&gt;
== Testing Plan ==&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit#&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119312</id>
		<title>CSC/ECE 517 Fall 2018 E1864: Issues related to Reviewing</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_E1864:_Issues_related_to_Reviewing&amp;diff=119312"/>
		<updated>2018-11-10T21:45:46Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Motivation */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;== Introduction ==&lt;br /&gt;
[http://expertiza.ncsu.edu/ Expertiza] is an open source web-based peer review system developed and maintained by students and faculty members at North Carolina State University. It has been developed as Open Source Software using Ruby on Rails framework. Expertiza allows students to form teams, review each other's work such as assignments and projects. It provides the role based access so that instructor can impose restriction what students can view/edit.&lt;br /&gt;
&lt;br /&gt;
== '''Motivation''' ==&lt;br /&gt;
== Previous Implementation: ==&lt;br /&gt;
&lt;br /&gt;
*When a student requests a review to perform, same reviews appear multiple times in a list of reviews.&lt;br /&gt;
*The current system does not allow the students to update the reviews. They are only allowed to edit the reviews even if has already been submitted.&lt;br /&gt;
*The system shows the reviewer that the work has not been submitted yet even when it has already been submitted.&lt;br /&gt;
*The system fails and throws an error we edit an existing assignment and change the number of review rounds. &lt;br /&gt;
== Motivation: ==&lt;br /&gt;
&lt;br /&gt;
The primary motivation behind this project is to give the students to review the projects of their peers effortlessly and fix all the issues of the previous implementation.&lt;br /&gt;
&lt;br /&gt;
== Description of Project ==&lt;br /&gt;
he project numbered E1864 and titled ‘Issues Related to Reviewing' is intended to fix five known issues related to reviewing, so that whenever your peers review your work, or an instructor try to configure number of reviews that should be performed by each student for each round, it will work properly in all situation. The project has been divided into five problem statements and each of them is addressing an individual issue we need to fix. The statements and the proposed approaches to meet the requirements are explained below as implementation.&lt;br /&gt;
&lt;br /&gt;
== Project requirement ==&lt;br /&gt;
===Problem 1 : Issue #1093===&lt;br /&gt;
:*''When a student requests a project to review, duplicate reviews appear in the list of available projects.''&lt;br /&gt;
&lt;br /&gt;
===Problem 2 : Issue #1097===&lt;br /&gt;
:*''When a project author resubmits their assignment, the reviewers should be able to update, not edit, their reviews. This should hold even if those reviews have already been submitted. The current system does not allow reviewers to update their reviews.''&lt;br /&gt;
&lt;br /&gt;
===Problem 3 : Issue #1029===&lt;br /&gt;
:*''When a reviewer tries to review a project, sometimes he/she is shown that the project has not yet been submitted when in fact it has.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #972===&lt;br /&gt;
:*''When updating the number of review rounds for an existing project, and error is generated and this action fails.''&lt;br /&gt;
&lt;br /&gt;
===Problem 4 : Issue #1142===&lt;br /&gt;
:*''“Show calibration results” page shows raw HTML when it should displayed as processed HTML.''&lt;br /&gt;
&lt;br /&gt;
== Analysis and Implementation ==&lt;br /&gt;
&lt;br /&gt;
== Use Cases ==&lt;br /&gt;
&lt;br /&gt;
== Unit Testing ==&lt;br /&gt;
&lt;br /&gt;
== Testing Plan ==&lt;br /&gt;
&lt;br /&gt;
== References ==&lt;br /&gt;
https://docs.google.com/document/d/1Br9hm-SWIvl5ibWSfRVjmiYTQl5j27l8slWhv2iUCqQ/edit#&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_-_E1825:_Add_past-due_assignments_to_task_list&amp;diff=119288</id>
		<title>CSC/ECE 517 Fall 2018 - E1825: Add past-due assignments to task list</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_-_E1825:_Add_past-due_assignments_to_task_list&amp;diff=119288"/>
		<updated>2018-11-10T04:58:20Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Color code assignments by closeness to due-date */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;=== About Expertiza === &lt;br /&gt;
Expertiza is a web application where students can submit and peer-review learning objects (articles, code, websites, etc). It is used in select courses at NC State and by professors at several other colleges and universities. -- Expertiza project&lt;br /&gt;
&lt;br /&gt;
== Overview:- == &lt;br /&gt;
The E1825 project is a course project for CSC 517 - Object Oriented Development and Design for Fall 2018. It involves adding some enhancements to the existing system. The primary goal of this project is to differentiate past due assignments from current assignments. The tasks to be completed are as follows:- &lt;br /&gt;
* Add past due assignments to the student’s task list (on Student View).&lt;br /&gt;
* Color code assignments by closeness to due date (on Student View).&lt;br /&gt;
* Check for correction in due dates of assignments (when an assignment’s due date is edited, it should be appropriately moved from the “Past assignments” list to the “Current Assignments” list if needed)&lt;br /&gt;
* On Student Task page, separate the list of 'teamed with' students from the current tasks box.&lt;br /&gt;
* Write the required tests before implementing/refactoring the methods in the above-mentioned classes.&lt;br /&gt;
&lt;br /&gt;
== Files Changed ==&lt;br /&gt;
&lt;br /&gt;
student_task_controller.erb &amp;lt;br&amp;gt;&lt;br /&gt;
app/views/student_task/list.html.erb &amp;lt;br&amp;gt;&lt;br /&gt;
student_task_helper.rb &amp;lt;br&amp;gt;&lt;br /&gt;
Airbrake_exception_errors_feature_tests_spec.rb&amp;lt;br&amp;gt;&lt;br /&gt;
&lt;br /&gt;
== New Files Added ==&lt;br /&gt;
&lt;br /&gt;
will_paginate_array_fix.rb &amp;lt;br&amp;gt;&lt;br /&gt;
student_task_controller_spec.rb&lt;br /&gt;
&lt;br /&gt;
== Add past-due assignments to the student’s task list ==&lt;br /&gt;
&lt;br /&gt;
The existing system contains the view where all the assignments of a student are displayed as a single list regardless of their due date. Now we have created a separate table for assignments that are overdue by the student. The displayed list is such that the most recent due assignment is shown at the top.&amp;lt;br&amp;gt;&lt;br /&gt;
To accomplish this task we have modified student_task_controller.rb and list.html.erb file (in student_task). A helper function was also added to format a string into multiple lines. In student_task_controller a new instance variable was created to capture all the student tasks that are overdue in ascending order of dueness. The existing instance variable was used to capture all the tasks that are currently due.&amp;lt;br&amp;gt;&lt;br /&gt;
In the view file i.e list.html.erb, a new table is created to contain a list of past assignments.&lt;br /&gt;
&lt;br /&gt;
== Color code assignments by closeness to due-date ==&lt;br /&gt;
&lt;br /&gt;
The current task-table on the homepage contains all the assignments displayed in white background. So to alert the user of approaching deadlines, we color code the background of each assignment title as red, orange, yellow or green depending on the proximity to its deadline.&amp;lt;br&amp;gt;&lt;br /&gt;
To accomplish the above-mentioned task, we added a helper method for student_task_controller that receives a due_date and calculates the days remaining for that date and then using this value it returns a string which denotes what should be the background of the row.&lt;br /&gt;
&lt;br /&gt;
Separate the list of 'teamed with' students from the current tasks box &lt;br /&gt;
&lt;br /&gt;
Currently, the current task lists and the student you have teamed up with are being shown in the same box. We need to separate these two. To achieve this we create an additional box, by adding a new &amp;quot;taskbox&amp;quot; div tag in list.html.erb. So the task list and the teammates are shown in different boxes.&lt;br /&gt;
&lt;br /&gt;
You can find the snapshot of the changes here:&lt;br /&gt;
&lt;br /&gt;
[https://drive.google.com/open?id=1PZeo8QBNOMKlObuy53Kfx6KqbLiRkCxr Separating past assignments with the present ]&lt;br /&gt;
&lt;br /&gt;
[https://drive.google.com/open?id=1gOnzGbT1AZjPQrAbprWfZFfa_1nv2Kyy list.html.erb]&lt;br /&gt;
&lt;br /&gt;
== Test Plan ==&lt;br /&gt;
&lt;br /&gt;
Our project involves mostly changing the view based on certain conditions. The testing of our project is based on simply checking whether the elements on the view change after a certain condition is satisfied, like changing of the background color for tasks as we approach the deadline. For example, if the due date is within a day, then the background color should be red or if it's more than 10 days it should be green.&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_-_E1825:_Add_past-due_assignments_to_task_list&amp;diff=119287</id>
		<title>CSC/ECE 517 Fall 2018 - E1825: Add past-due assignments to task list</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2018_-_E1825:_Add_past-due_assignments_to_task_list&amp;diff=119287"/>
		<updated>2018-11-10T04:55:38Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: /* Separate the list of 'teamed with' students from the current tasks box */&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;=== About Expertiza === &lt;br /&gt;
Expertiza is a web application where students can submit and peer-review learning objects (articles, code, websites, etc). It is used in select courses at NC State and by professors at several other colleges and universities. -- Expertiza project&lt;br /&gt;
&lt;br /&gt;
== Overview:- == &lt;br /&gt;
The E1825 project is a course project for CSC 517 - Object Oriented Development and Design for Fall 2018. It involves adding some enhancements to the existing system. The primary goal of this project is to differentiate past due assignments from current assignments. The tasks to be completed are as follows:- &lt;br /&gt;
* Add past due assignments to the student’s task list (on Student View).&lt;br /&gt;
* Color code assignments by closeness to due date (on Student View).&lt;br /&gt;
* Check for correction in due dates of assignments (when an assignment’s due date is edited, it should be appropriately moved from the “Past assignments” list to the “Current Assignments” list if needed)&lt;br /&gt;
* On Student Task page, separate the list of 'teamed with' students from the current tasks box.&lt;br /&gt;
* Write the required tests before implementing/refactoring the methods in the above-mentioned classes.&lt;br /&gt;
&lt;br /&gt;
== Files Changed ==&lt;br /&gt;
&lt;br /&gt;
student_task_controller.erb &amp;lt;br&amp;gt;&lt;br /&gt;
app/views/student_task/list.html.erb &amp;lt;br&amp;gt;&lt;br /&gt;
student_task_helper.rb &amp;lt;br&amp;gt;&lt;br /&gt;
Airbrake_exception_errors_feature_tests_spec.rb&amp;lt;br&amp;gt;&lt;br /&gt;
&lt;br /&gt;
== New Files Added ==&lt;br /&gt;
&lt;br /&gt;
will_paginate_array_fix.rb &amp;lt;br&amp;gt;&lt;br /&gt;
student_task_controller_spec.rb&lt;br /&gt;
&lt;br /&gt;
== Add past-due assignments to the student’s task list ==&lt;br /&gt;
&lt;br /&gt;
The existing system contains the view where all the assignments of a student are displayed as a single list regardless of their due date. Now we have created a separate table for assignments that are overdue by the student. The displayed list is such that the most recent due assignment is shown at the top.&amp;lt;br&amp;gt;&lt;br /&gt;
To accomplish this task we have modified student_task_controller.rb and list.html.erb file (in student_task). A helper function was also added to format a string into multiple lines. In student_task_controller a new instance variable was created to capture all the student tasks that are overdue in ascending order of dueness. The existing instance variable was used to capture all the tasks that are currently due.&amp;lt;br&amp;gt;&lt;br /&gt;
In the view file i.e list.html.erb, a new table is created to contain a list of past assignments.&lt;br /&gt;
&lt;br /&gt;
== Color code assignments by closeness to due-date ==&lt;br /&gt;
&lt;br /&gt;
The current task-table on the homepage contains all the assignments displayed in white background. So to alert the user of approaching deadlines, we color code the background of each assignment title as red, orange, yellow or green depending on the proximity to its deadline.&amp;lt;br&amp;gt;&lt;br /&gt;
To accomplish the above-mentioned task, we added a helper method for student_task_controller that receives a due_date and calculates the days remaining for that date and then using this value it returns a string which denotes what should be the background of the row.&lt;br /&gt;
&lt;br /&gt;
Separate the list of 'teamed with' students from the current tasks box ==&lt;br /&gt;
&lt;br /&gt;
Currently, the current task lists and the student you have teamed up with are being shown in the same box. We need to separate these two. To achieve this we create an additional box, by adding a new &amp;quot;taskbox&amp;quot; div tag in list.html.erb. So the task list and the teammates are shown in different boxes.&lt;br /&gt;
&lt;br /&gt;
You can find the snapshot of the changes here:&lt;br /&gt;
&lt;br /&gt;
[https://drive.google.com/open?id=1PZeo8QBNOMKlObuy53Kfx6KqbLiRkCxr Separating past assignments with the present ]&lt;br /&gt;
&lt;br /&gt;
[https://drive.google.com/open?id=1gOnzGbT1AZjPQrAbprWfZFfa_1nv2Kyy list.html.erb]&lt;br /&gt;
&lt;br /&gt;
== Test Plan ==&lt;br /&gt;
&lt;br /&gt;
Our project involves mostly changing the view based on certain conditions. The testing of our project is based on simply checking whether the elements on the view change after a certain condition is satisfied, like changing of the background color for tasks as we approach the deadline. For example, if the due date is within a day, then the background color should be red or if it's more than 10 days it should be green.&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
	<entry>
		<id>https://wiki.expertiza.ncsu.edu/index.php?title=File:Im1.png&amp;diff=119277</id>
		<title>File:Im1.png</title>
		<link rel="alternate" type="text/html" href="https://wiki.expertiza.ncsu.edu/index.php?title=File:Im1.png&amp;diff=119277"/>
		<updated>2018-11-10T04:42:12Z</updated>

		<summary type="html">&lt;p&gt;Rrajan3: Separating past assignments with the present&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;Separating past assignments with the present&lt;/div&gt;</summary>
		<author><name>Rrajan3</name></author>
	</entry>
</feed>