Expertiza_Wiki - User contributions [en]

E1867 allow reviewer to say review can be shown to class as an example

2018-12-08T00:02:36Z

Smadhur: /* Test Plan */

== Problem Statement ==
The objective of this project is to:
# Add a feature for students to make their reviews 'public', that is, allow other students to view them.
# Add a feature for TA to select a subset of 'public' reviews, and make those reviews visible as sample reviews of the particular assignment.
# Add a feature for Instructor to select a subset of 'public' reviews and make those reviews visible as sample reviews of any of his/her assignments in the course.
# Create a view where the student can see a list of sample reviews of the assignment and have a detailed view of each.
# Allow the student to toggle the visibility of a review he/she has submitted.

== Approach & Design ==

# Consent to make the review public - add a checkbox and an oncheck event handlers (JS) that sets a new field 'visibility' to public of Response object.
# Change the schema of Responses table (add the new column) and write db migrations.
# Create new table, model, view, controller for "similar_assignments" and validate CRUD operations that access the table.
# Add HTML (checkbox) to uncheck the consent such that the reviews becomes private again.
# On the "popup/team_users_popup" page (where instructor/TA can view all reviews), we give a checkbox against every review with public visibility to allow instructors/TAs to select one or more reviews as sample reviews to be available for students.
# Once the instructor selects and submits some reviews as sample reviews, we give a popup containing a list of assignments with a checkbox against each of them and a submit button at the end to allow instructors to make sample reviews available for multiple assignments in one go. We perform validation checks also.
# On submit of the popup, we update the similar_assignments table.
# At the top of student_reviews/list page, we give an option for the student to preview all the available sample reviews.
# Create the MVC setup for this new page to list all the sample reviews. Students will be able to click on one particular review and preview it.

'''DB Design'''

Currently, the Expertiza database design does not maintain any link between different assignments. An assignment of the current semester is completely independent of any other assignment of any other course having similar or exact objectives. For example, in a course C, the assignment named A1 in a semester Sx has no association to the same assignment given in an earlier semester Sy.

Since our task involves using reviews from the past as samples for the present, we should create this association as a new table. Further, reviews may not be the only intention to associate assignments with each other, as future requirements might require associating them on other criteria too. Thus, we find it appropriate to name the table as "similar_assignments".

The table structure is defined [http://wiki.expertiza.ncsu.edu/index.php/Similar_assignments here].

This table can be visualized as a directed graph where vertices represent assignments. An edge (u,v) with a label L means u is similar to v for the intent of association, L.

Consider a row (id = x, assignment_id = Ak, is_similar_for = An, association_intent = "review"). This means, given the intent of association as "review", assignment Ak was chosen as a similar assignment for assignment An. That is, while marking some review for An as a sample, the instructor opted to have reviews of Ak as samples for An as well.

== Implementation Details ==

==== UML - Use Case Diagram ====

[[Image:UseCase.png]]

'''Power Users:''' Instructors, TAs, Admins and Super Admins

'''More details about each point mentioned in the approach section will be updated after the implementation.'''

== Implementation ==

We have added a new column in the ‘responses’ table (in the database), namely, ‘visibility’.
Visibility can have 4 values as listed below:

{| class="wikitable"
|+ Table showing list of visibility values and the properties
! Visibility
! Properties
|-
| 0 || Response is private. This is the default value.
|-
| 1 || The response which was in the review has been approved as an example (that is, it has been marked as a sample)
|-
| 2 || The response which was in the review has been approved as an example (that is, it has been marked as a sample)
|-
| 3 || The response which was either in the review or approved earlier, has now been rejected as an example (it has been unmarked as a sample)
|-
|}

We have maintained these constants in a new file at helpers/response_constants.rb.

<pre>
module ResponseConstants
def _private
0
end

def in_review
1
end

def approved_as_sample
2
end

def rejected_as_sample
3
end
end
</pre>

In the existing implementation of reviews, when a student starts a review (but hasn’t filled any text or ratings yet), a response gets created in the database. This response has a default visibility of 0.

We have provided a checkbox (an HTML input node with attribute ‘type’ as ‘checkbox’) for the student to consent for his / her review to be used as an example, with values 0 and 1 for unchecked and checked respectively. This value is used to update the response object as part of the form submission.

However, a student might want to remove their consent or give their consent, for a review that is already submitted. So, in the page where student views his / her own response, we have added the same HTML checkbox. On checking or unchecking the checkbox, the visibility field in the corresponding response object in the database gets updated.Consider this as case 1.

Now when a power user looks at a review (at url , which is an HTML rendering of a ResponseMap containing Responses), he/she must be able to approve and reject responses which students have consented (offered) to be made visible to all. This is done by providing a button “Mark as Sample” or “Remove as Sample”. Responses without consent will not have any button.

These HTML changes appear in views/popup/team_users_popup.html.haml
<pre>
if instance_variable_get('@sample_button_'+round.to_s)
%div{:class=>'col-md-12 mark-delete-sample '+'round'+round.to_s}
%h3{:class=>'col-md-10'} "Reviewed by #{User.find(@reviewer_id).fullname} (Round #{round})"
%div{:class=>'col-md-2'}

%button{:class=>'col-md-12 mark-unmark-sample-button '+instance_variable_get('@mark_as_sample_'+round.to_s),
:data=>{'visibility':2, 'response_id':instance_variable_get('@response_id_round_' + round.to_s),'round':round} } Mark as Sample
%button{:class=>'col-md-12 mark-unmark-sample-button '+instance_variable_get('@remove_as_sample_'+round.to_s),
:data=>{'visibility':3, 'response_id':instance_variable_get('@response_id_round_' + round.to_s),'round':round} } Remove as Sample

%span{:class=>"hide col-md-12 mark-unmark-sample-result", :id=>"mark_unmark_fail_"+round.to_s}
%span{:class=>"hide col-md-12 mark-unmark-sample-result success", :id=>"mark_unmark_success_"+round.to_s}
</pre>

Clicking on “Mark as Sample” or “Unmark as Sample” changes the visibility of the response to 2 or 3 respectively. Like case 1 mentioned above, this is another situation where the visibility needs to be updated when there is a page event.

Both these cases are event-based and require to make an HTTP request from the browser and handle the response while staying on the same page. Therefore, according to standard practice, an AJAX request must be initiated on click of the button or checkbox. The request needs two parameters - response id, and the updated value of visibility. User-identifying data is sent by default in HTTP header cookies (as in any usual HTTP request).

To handle these requests, we have created a sample_reviews controller with a method update_visibility. Within the method, we first check whether the request parameters are valid, and then proceed to check whether the current user (identified by session id) should be allowed to edit the response object to the visibility value passed in the request.

We have validated requests in this manner since HTTP is stateless and requests can easily be cloned (a browser need not be the only client making requests). For example, one could simply copy the request as a cURL, change the session id in the HTTP header to a student’s session, and pass alternative values of visibility (say 2, meaning, approved as a sample) in the request. Such requests should be identified as unauthorized requests, while requests which want to update visibility to a value that’s not allowed need to be rejected as bad requests.

<pre>
def update_visibility
begin
visibility = params[:visibility] #response object consists of visibility in string format
if(visibility.nil?)
raise StandardError.new("Missing parameter 'visibility'")
end
visibility = visibility.to_i

if not (_private..rejected_as_sample).include? visibility
raise StandardError.new("Invalid value for parameter 'visibility'")
end
@@response_id = params[:id]
response_map_id = Response.find(@@response_id).map_id
response_map = ResponseMap.find(response_map_id)
assignment_id = response_map.reviewed_object_id
is_admin = [Role.administrator.id,Role.superadministrator.id].include? current_user.role.id
if is_admin
Response.update(@@response_id.to_i, :visibility => visibility)
update_similar_assignment(assignment_id, visibility)
render json:{"success" => true}
return
end
course_id = Assignment.find(assignment_id).course_id
instructor_id = Course.find(course_id).instructor_id
ta_ids = []
if current_user.role.id == Role.ta.id
ta_ids = TaMapping.where(course_id).ids # do this query only if current user is ta
elsif current_user.role.id == Role.student.id
# find if this student id is the same as the response reviewer id
# and that visiblity is 0 or 1 and nothing else.
# if anything fails, return failure
if visibility > in_review
render json:{"success" => false, "error"=>"Not allowed"}
return
end
reviewer_user_id = AssignmentParticipant.find(response_map.reviewer_id).user_id
if reviewer_user_id != current_user.id
render json:{"success" => false,"error" => "Unathorized"}
return
end

elsif not ([instructor_id] + ta_ids).include? current_user.id
render json:{"success" => false,"error" => "Unathorized"}
return
end
Response.update(@@response_id.to_i, :visibility => visibility)
update_similar_assignment(assignment_id, visibility)
rescue StandardError => e
render json:{"success" => false,"error" => e.message}
else
render json:{"success" => true}
end
end

</pre>

We have provided a success or error message text below the button to indicate to the user that the request is completed.

[[file: Mark unmark picssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss]]

We have used the same request mark_unmark/:id with POST data as {“visibility”:x}, in the student view as well.

This project also required that assignments be linked to each other, as explained in the sections above. To this end, we have created a controller, model, and a migration (to create the database table) for similar assignments.

By default, every assignment is similar to itself (assume it’s id is X). So, after updating a response’s visibility, we add a new entry in the similar_assignments table: (assignment_id = X, similar_for = X, association_intent = “Review”). This addition is done only after confirming for non-existence, as one can infer from the following code snippet:

<pre>
private
def update_similar_assignment(assignment_id, visibility)
if visibility == approved_as_sample
ids = SimilarAssignment.where(:is_similar_for => assignment_id, :association_intent => intent_review,
:assignment_id => assignment_id).ids
if ids.empty?
SimilarAssignment.create({:is_similar_for => assignment_id, :association_intent => intent_review,
:assignment_id => assignment_id})
end
end
if visibility == rejected_as_sample or visibility == _private
response_map_ids = ResponseMap.where(:reviewed_object_id => assignment_id).ids
response_ids = Response.where(:map_id => response_map_ids, :visibility => approved_as_sample)
if response_ids.empty?
SimilarAssignment.where(:assignment_id => assignment_id).destroy_all
end
end
end
</pre>

The power user visits a review response page expecting to mark some reviews as samples and then link or unlink the assignment associated with the review to his / her other assignments. To provide the linking functionality, we have provided a clickable text “ Use as Samples for More Assignments” at the top right corner of the page as shown below.

[[for use as sample for more assignment]]

The appearance or non-appearance of this text is conditional. It only appears when there is at least one sample review for the current assignment. So, to decide this, we have queried for those assignments for which this assignment is a similar one, and checked on the size of the query result. The size is then checked in popup_controller to set an instance variable popup_show to a boolean value. The view uses this to render or not render the clickable “Use as Samples for More Assignments” text.

Code snippet of get_similar_assignment_ids
<pre>
def get_similar_assignment_ids(assignment_id)
SimilarAssignment.where(:assignment_id => assignment_id).pluck(:is_similar_for)
end
</pre>

Code snippet of popup_controller line 84
<pre>
@page_size = popup_page_size
</pre>

On click of this text, we open a popup that lists out (with a checkbox alongside each list entry) the candidate assignments that this assignment can be similar for (these are unchecked), and assignments that it is already similar for (these are checked). For example, assume that the power user is viewing the response page of assignment X. Assume we have entries (X,Y,”review”) and (X,Z,”review”) in similar_assignments table. Then, the popup list will have the assignments Y and Z with a checkbox against each of them ticked, and all the other assignments that the current user has access to, with a checkbox against each of them unticked.

The popup and the data that go with it are fetched on demand. So, the assignment list need not be a part of the first render of the page itself, as the inherent querying would slow down page load time. Therefore, on click, we fetch the list by an AJAX request (we have given appropriate error messages below the clickable text for the rare eventuality of any server-side error or empty response).

This request GET “/similar_assignments/:id” is again authenticated in similar_assignments_controller, get method. Same validation ideas as explained earlier are used. Only the assignment’s course instructor and TAs, admin, and super-admin should be able to fetch this data, while others need not have access to it.

Code snippet of get method
<pre>
# GET /similar_assignments/:id
def get
@assignment_id = params[:id]
ids = Response.joins("INNER JOIN response_maps ON response_maps.id = responses.map_id
WHERE visibility=2 AND reviewed_object_id ="+@assignment_id.to_s).ids
if ids.empty?
render json: {"success"=>false, "error"=>"Please mark atleast one review as sample"}
return
end
begin
if current_user.role.id == Role.student.id
throw Exception.new
end
@similar_assignments = SimilarAssignment.where(:assignment_id => @assignment_id).
where.not(:is_similar_for=>@assignment_id).order("created_at DESC").pluck(:is_similar_for)
rescue ActiveRecord::RecordNotFound => e
render json: {"success" => false, "error" => "Resource not found"}
rescue Exception
render json: {"success" => false, "error" => "Unauthorized"}
else
@res = get_asssignments_set(@similar_assignments)
render json: {"success" => true, "values" => @res}
end
end
</pre>

The get method fetches similar assignment ids and passes them on to get_asssignments_set of similar_assignments_helper. This method queries for all assignments (except the ones passed in its parameter list) that the current user is allowed to access and returns a list of hash objects which are used by the caller (the on-success function of the AJAX request). Each hash object contains assignment name, id, it’s course name, and whether it’s a similar assignment or not. Following code snippets demonstrates this:

Code snippet of get_asssignments_set method
<pre>
def get_asssignments_set(selected)
all_assignments = get_assignments_based_on_role
assignment_array = []
courses = get_courses_based_on_role
all_assignments.each {
|assignment|
course_id = assignment.course_id
if(course_id.nil?)
next
end
if (selected.include? assignment.id)
hash1 = {:title => assignment.name, :course_name => courses[course_id], :checked => true, :id => assignment.id}
assignment_array.push(hash1)
else
hash2 = {:title => assignment.name, :course_name => courses[course_id], :checked => false, :id => assignment.id}
assignment_array.push(hash2)
end
}
return assignment_array
end
</pre>

Code snippet of get_assignments_based_on_role method

<pre>
def get_assignments_based_on_role()
role = current_user.role.id
page = params[:page]
assignment_id = params[:id].to_i
if page.nil?
page = 0
end
_offset = page.to_i * popup_page_size
case role
when Role.ta.id
course_ids = TaMapping.where(:ta_id => current_user.id).pluck(:course_id)
@all_assignments = Assignment.where(:course_id => course_ids).
where.not(:id=>assignment_id).limit(popup_page_size).offset(_offset).order("created_at DESC")
when Role.instructor.id
course_ids = Course.where(:instructor_id => current_user.id).pluck(:id)
@all_assignments = Assignment.where(:course_id => course_ids).
where.not(:id=>assignment_id).limit(popup_page_size).offset(_offset).order("created_at DESC")
else
@all_assignments = []
end
@all_assignments
end
</pre>

The query result can be prohibitively large. This calls for pagination.

Pagination at the server side is about performing the same query as a non-pagination implementation, with an addition: limit and offset. Limit denotes the size of a page, and offset denotes a start index, and is calculated as page size * page number. Page size is a constant defined in similar_assignments_constants.

We had two options for response and rendering:
Construct the popup list HTML from the query results and respond with this HTML.
Respond with JSON, and build the HTML client side.

Responding with HTML from server-side is expensive, as the byte size of the HTTP response would be significantly larger than JSON. Thus, we chose the second option.

Since HTTP is stateless, the server has no way to maintain a running counter of page number. Therefore, keeping track of page number must be the responsibility of the client (browser JavaScript) who must pass it as a request parameter while the server simply reads it and assumes its lack of existence as page number 0. The following snippet demonstrates this:

Snippet of response.js line 103-130
<pre>
fetchAssignments:function(){
var self = this;
var ajaxUrl = "/similar_assignments/"+assignmentId;
if(this.currentPageNumber > 0){
ajaxUrl += "?page="+this.currentPageNumber;
}
jQuery.ajax({
"url":ajaxUrl,
"type":"GET",
"dataType":"json",
"responseType":"json",
"beforeSend":function(){
self.hideSuccess();
self.hideError();
},
"success":function(result){
if(result.success && result.values.length){
self.onFetchSuccess(result.values);
}else if(result.success && self.currentPageNumber == 0){
self.onFetchFail("Cannot link this to any assignment!");
}else if(result.success){
self.onFetchSuccess(result.values);
}
else{
self.onFetchFail(result.error);
}
},
"failure": self.onFetchFail,
"error":self.onFetchFail
</pre>

We have avoided maintaining the constant value of page size once on server side (in similar_assignments_constants) and once on the client side (JS variable). The initial render of the page creates a hidden HTML element that contains the page size, and once the document is ready, response.js selects that element, reads its value into a variable, and deletes that HTML element. This prevents having a page size in the HTML page-source, and more importantly, complies with the DRY principle. Page size should be changed in one function only - and that is in similar_assignments_constants as explained earlier.

From the response JSON containing an array of objects (that are going to be rendered as list items), we have constructed the HTML list. Each list item maintains its assignment id in its HTML data attribute. The following snippet shows this.

Response.js lines 67-78
<pre>
addToList:function(assignment){
var assignmentId = assignment.id;
var title = assignment.title;
var course = assignment.course_name;
var displayText = "<strong>"+course+": </strong>" +title;
var checked = assignment.checked;
var newRow = this.template.clone();
newRow.removeClass("hide").find("input").attr("data-id",assignmentId).attr("checked",checked);
newRow.find("span").html(displayText).on("click",function(){
newRow.find("input").click();
});
this.list.append(newRow.removeAttr("id"));
},
</pre>

_________________________________________A snapshot of the popup is shown below.

The “More” button (shown in the snapshot above) is used to fetch the next set of results.

After a finite number of requests, the client receives a lesser number of results than expected. This is when pagination must stop (since there are no more results). This is achieved by the object AssignmentsPopup (in our response.js file) - it maintains the page size and current page number. The more button is now replaced by a text “No more results” and it’s on-click functionality is turned off.

______________________________________________Screenshot of popup with “No more results”

Further, we have implemented this as a plug-and-play service. By reusing the same popup HTML and the AssignmentsPopup variable, the entire popup can be made a part of any Expertiza page.

The page makes no requests on closing the popup, or on clicking Submit without checking any unchecked list item or unchecking any checked list item. It submits only if there is an overall difference in what items are checked and what are not.

Click of “Submit” makes another AJAX POST request to “/similar_assignments/create/:id” with two params in the post JSON data:
“checked” - an array of assignment ids that were checked in the list but unchecked while opening the popup
“unchecked” - an array of assignment ids that were unchecked in the list but checked while opening the popup

Either of these params may be empty, depending on the user’s actions, but not both (if both were empty, we simply close the popup without submitting). However, this optimization is only client side. Server side logic must still check for duplicates - that is, an assignment id under “checked” is already a part of similar_assignments.

Let current assignment id be X. For each of the checked assignment ids Ci in {C1,C2,...,Cn}, we have checked if there are entries (X,Ci) in similar_assignments table, and if not, then created that entry. Similarly, for each of the unchecked assignment ids Ui in {U1,U2,...,Um}, we have deleted the entry (X,Ui) from similar_assignments.

On a successful update, the client closes the popup and prints a success message.

_________________________________________________________________________________________Snapshot with success message

So far, power users have marked reviews as samples and linked assignments. Now, students need to view these samples. A student would view these sample reviews before writing their review on somebody else’s work. Therefore, we have added a link “View Sample Reviews” to view the list of sample reviews.

________________________________________________________________UI screenshot here.<pending>

Similarly, power users might also want to view samples. We have provided the same link on the following page too.

________________________________________________________________UI screenshot here

This page is rendered by the index method in sample_reviews_controller. It is a list of links to sample reviews. The layout of this page is common for users, as long as they are logged in. Non-logged-in or anonymous visitors are redirected to the Expertiza home page. ‘index’ calls a method redirect_anonymous_user in sample_reviews_helper to achieve this.

Snippet of sample_reviews_helper
<pre>
def redirect_anonymous_user
current_user = session[:user]
if current_user.nil?
redirect_to "/"
end
end
</pre>

The list of available samples has no upper bound on its size. Yet again, pagination solves this problem. But unlike the case of the popup discussed earlier, the response type differs. A request without a ‘page’ parameter in its URL is a request for the web-page and should, therefore, render HTML, while the same request URL with the ‘page’ parameter is a request for more content, and should, therefore, render JSON. The following snippet from the index method demonstrates this.

Sample_reviews_controller - index method - add the if-else just before return statement
<pre>
def index
redirect_anonymous_user
@assignment_id = params[:id].to_i
page_number = params[:page].to_i
if page_number.nil?
page_number = 0
end
@page_size = 8
similar_assignment_ids = get_similar_assignment_ids(@assignment_id)
@response_ids = []
similar_assignment_ids.each do |id|
_offset = page_number * @page_size
ids = Response.joins("INNER JOIN response_maps ON response_maps.id = responses.map_id
WHERE visibility=2 AND reviewed_object_id = "+id.to_s+
" ORDER BY responses.created_at LIMIT "+@page_size.to_s+" OFFSET "+_offset.to_s ).ids
@response_ids += ids
end
@links = generate_links(@response_ids)
if page_number == 0
@course_assignment_name = get_course_assignment_name(@assignment_id)
else
render json: {"success" => true, "sampleReviews" => @links}
end
end
</pre>

During this first render itself, we have also identified whether more results can exist. The “More” button only appears if the number of sample review links being rendered is equal to the page size, as shown in a snippet of views/sample_reviews/index.html.erb below.

Code snip of Lines 12-15
<pre>
<% if @links.size == @page_size %>
<h5 style="cursor:pointer;text-align: center;" id="more_button">More +</h5>
<% end %>
</pre>

Clicking the “More” button now makes the same request as the page’s URL, but with the parameter ‘page’. In that case, the response is JSON, which is used by the caller (JavaScript Ajax) to add more rows to the page. If the number of rows is lesser than expected, the More text is changed, its click listener is turned off, and no more requests are made, demonstrated by the snippet of sample_review.js below.

Code snip of Line 25-35
<pre>
for(var i in result.sampleReviews)
{
currentNumberOfRows++;
var review = result.sampleReviews[i];
var newRow = listTemplate.clone();
newRow.removeClass("hide").removeAttr("id").find("a").
html("Sample Review "+currentNumberOfRows).attr("href",review);
ulList.append(newRow);
}

if(responseSize < pageSize){
self.html("No more results!").off().css({"cursor":"default"});
}
else
{
pageNumber++;
}
</pre>

Each of the list items on the page is a link, which takes the user to /sample_reviews/:id. On this page, we fetch the question-answer pairs corresponding to the object having the id given in the URL and print it out in the form of a table.

== Test Plan ==
'''As a Power User (TA/Instructor/Admin/Super Admin)'''
# Log in
# Click on Manage->Assignments
# Displays a list of Assignments
# Click View Report/Review for a particular assignment.
# Displays a list of reviews submitted by students.
# Click on any review in "team reviewed" column for a particular student.
# Displays the summary of reviews submitted by that student, with a "Make as sample" button on the right of every review.
# Click on "Make as sample" for the intended reviews, which opens a popup that displays a list of all assignments that are a part of the instructor's courses.
# From this list select all assignments for which the review has to be shown as a sample.
# Click on 'Submit' after selection (this closes the popup).
# Navigate to view reviews of that particular assignment and click on "Sample Reviews".
# A new page is opened that lists out all the sample reviews of the assignment.

'''As a Student'''
# Log in.
# Click on Assignments
# List of assignments is displayed.
# Click on any assignment for which the review has to be submitted.
# Assignment task page is displayed.
# Click on "Other's work" to open the reviews summary page (at /student_review).
# Below the heading "Reviews for ...", click on the "Show sample reviews" link.
# This opens a page where the student can view all sample reviews for that assignment.
# Use the browser's back button to go back to the Assignment review page.
# Chose to review any of the teams' assignments that are displayed.
# Select a team for review and fill in the review.
# Before submitting the review, select the checkbox that says "I agree to share this review anonymously as an example to the entire class".
# After clicking on the submit button, the review submitted has been made public.

'''RSpec Tests'''

Below are the Rpsec tests that have been added to test the edge cases:
# If an anonymous user tries to view the sample reviews page he/she will be redirected to home page.
# If an anonymous user tries to view the details of a particular sample review, he/she will be redirected to home page.
# If a user tries to view the sample review of a particular assignment for which there are no sample reviews, he/she will be redirected to home page.
# If a student tries to fetch similar assignments, then he/she will be redirected to the assignments page
# If a student tries to update any similar assignment, then he/she will be redirected to the assignments page
# Performed some basic HTML validations -should always give the content-type as text/html"

=='''Additional Links and References'''==

#[https://github.com/expertiza/expertiza/pull/1291 Link to the Git Pull Request]
#[https://github.com/expertiza/expertiza Expertiza on GitHub]
#[https://github.com/chinmaiks/expertiza GitHub Project Repository Fork]
#[http://expertiza.ncsu.edu/ The Live Expertiza Website]

==Team==
[mailto:aagniho@ncsu.edu Amogh Agnihotri Subbanna]<br>
[mailto:ckaidab@ncsu.edu Chinmai Kaidabettu Srinivas]<br>
[mailto:smadhur@ncsu.edu Siddu Madhure Jayanna]<br>
[mailto:snaramb@ncsu.edu Suhas Naramballi Gururaja]

E1867 allow reviewer to say review can be shown to class as an example

2018-12-07T06:23:48Z

Smadhur:

== Problem Statement ==
The objective of this project is to:
# Add a feature for students to make their reviews 'public', that is, allow other students to view them.
# Add a feature for TA to select a subset of 'public' reviews, and make those reviews visible as sample reviews of the particular assignment.
# Add a feature for Instructor to select a subset of 'public' reviews and make those reviews visible as sample reviews of any of his/her assignments in the course.
# Create a view where the student can see a list of sample reviews of the assignment and have a detailed view of each.
# Allow the student to toggle the visibility of a review he/she has submitted.

== Approach & Design ==

# Consent to make the review public - add a checkbox and an oncheck event handlers (JS) that sets a new field 'visibility' to public of Response object.
# Change the schema of Responses table (add the new column) and write db migrations.
# Create new table, model, view, controller for "similar_assignments" and validate CRUD operations that access the table.
# Add HTML (checkbox) to uncheck the consent such that the reviews becomes private again.
# On the "popup/team_users_popup" page (where instructor/TA can view all reviews), we give a checkbox against every review with public visibility to allow instructors/TAs to select one or more reviews as sample reviews to be available for students.
# Once the instructor selects and submits some reviews as sample reviews, we give a popup containing a list of assignments with a checkbox against each of them and a submit button at the end to allow instructors to make sample reviews available for multiple assignments in one go. We perform validation checks also.
# On submit of the popup, we update the similar_assignments table.
# At the top of student_reviews/list page, we give an option for the student to preview all the available sample reviews.
# Create the MVC setup for this new page to list all the sample reviews. Students will be able to click on one particular review and preview it.

'''DB Design'''

Currently, the Expertiza database design does not maintain any link between different assignments. An assignment of the current semester is completely independent of any other assignment of any other course having similar or exact objectives. For example, in a course C, the assignment named A1 in a semester Sx has no association to the same assignment given in an earlier semester Sy.

Since our task involves using reviews from the past as samples for the present, we should create this association as a new table. Further, reviews may not be the only intention to associate assignments with each other, as future requirements might require associating them on other criteria too. Thus, we find it appropriate to name the table as "similar_assignments".

The table structure is defined [http://wiki.expertiza.ncsu.edu/index.php/Similar_assignments here].

This table can be visualized as a directed graph where vertices represent assignments. An edge (u,v) with a label L means u is similar to v for the intent of association, L.

Consider a row (id = x, assignment_id = Ak, is_similar_for = An, association_intent = "review"). This means, given the intent of association as "review", assignment Ak was chosen as a similar assignment for assignment An. That is, while marking some review for An as a sample, the instructor opted to have reviews of Ak as samples for An as well.

== Implementation Details ==

==== UML - Use Case Diagram ====

[[Image:UseCase.png]]

'''Power Users:''' Instructors, TAs, Admins and Super Admins

'''More details about each point mentioned in the approach section will be updated after the implementation.'''

== Test Plan ==
'''As a Power User (TA/Instructor/Admin/Super Admin)'''
# Log in
# Click on Manage->Assignments
# Displays list of Assignments
# Click View Report/Review for a particular assignment.
# Displays a list of reviews submitted by students.
# Click on any review in "team reviewed" column for a particular student.
# Displays the summary of reviews submitted by that student, with a "Make as sample" button on the right of every review.
# Click on "Make as sample" for the intended reviews, which opens a popup that displays a list of all assignments that are a part of the instructor's courses.
# From this list select all assignments for which the review has to be shown as a sample.
# Click on 'Submit' after selection (this closes the popup).
# Navigate to view reviews of that particular assignment and click on "Sample Reviews".
# A new page is opened that lists out all the sample reviews of the assignment.

'''As a Student'''
# Log in.
# Click on Assignments
# List of assignments is displayed.
# Click on any assignment for which the review has to be submitted.
# Assignment task page is displayed.
# Click on "Other's work" to open the reviews summary page (at /student_review).
# Below the heading "Reviews for ...", click on the "Show sample reviews" link.
# This opens a page where the student can view all sample reviews for that assignment.
# Use the browser's back button to go back to Assignment review page.
# Chose to review any of the teams' assignments that are displayed.
# Select a team for review and fill in the review.
# Before submitting the review, select the checkbox that says "I agree to share this review anonymously as an example to the entire class".
# After clicking on the submit button, the review submitted has been made public.

== Implementation ==

We have added a new column in the ‘responses’ table (in the database), namely, ‘visibility’.
Visibility can have 4 values as listed below:

{| class="wikitable"
|+ Table showing list of visibility values and the properties
! Visibility
! Properties
|-
| 0 || Response is private. This is the default value.
|-
| 1 || The response which was in the review has been approved as an example (that is, it has been marked as a sample)
|-
| 2 || The response which was in the review has been approved as an example (that is, it has been marked as a sample)
|-
| 3 || The response which was either in the review or approved earlier, has now been rejected as an example (it has been unmarked as a sample)
|-
|}

We have maintained these constants in a new file at helpers/response_constants.rb.

<pre>
module ResponseConstants
def _private
0
end

def in_review
1
end

def approved_as_sample
2
end

def rejected_as_sample
3
end
end
</pre>

In the existing implementation of reviews, when a student starts a review (but hasn’t filled any text or ratings yet), a response gets created in the database. This response has a default visibility of 0.

We have provided a checkbox (an HTML input node with attribute ‘type’ as ‘checkbox’) for the student to consent for his / her review to be used as an example, with values 0 and 1 for unchecked and checked respectively. This value is used to update the response object as part of the form submission.

However, a student might want to remove their consent or give their consent, for a review that is already submitted. So, in the page where student views his / her own response, we have added the same HTML checkbox. On checking or unchecking the checkbox, the visibility field in the corresponding response object in the database gets updated.Consider this as case 1.

Now when a power user looks at a review (at url , which is an HTML rendering of a ResponseMap containing Responses), he/she must be able to approve and reject responses which students have consented (offered) to be made visible to all. This is done by providing a button “Mark as Sample” or “Remove as Sample”. Responses without consent will not have any button.

These HTML changes appear in views/popup/team_users_popup.html.haml
<pre>
if instance_variable_get('@sample_button_'+round.to_s)
%div{:class=>'col-md-12 mark-delete-sample '+'round'+round.to_s}
%h3{:class=>'col-md-10'} "Reviewed by #{User.find(@reviewer_id).fullname} (Round #{round})"
%div{:class=>'col-md-2'}

%button{:class=>'col-md-12 mark-unmark-sample-button '+instance_variable_get('@mark_as_sample_'+round.to_s),
:data=>{'visibility':2, 'response_id':instance_variable_get('@response_id_round_' + round.to_s),'round':round} } Mark as Sample
%button{:class=>'col-md-12 mark-unmark-sample-button '+instance_variable_get('@remove_as_sample_'+round.to_s),
:data=>{'visibility':3, 'response_id':instance_variable_get('@response_id_round_' + round.to_s),'round':round} } Remove as Sample

%span{:class=>"hide col-md-12 mark-unmark-sample-result", :id=>"mark_unmark_fail_"+round.to_s}
%span{:class=>"hide col-md-12 mark-unmark-sample-result success", :id=>"mark_unmark_success_"+round.to_s}
</pre>

Clicking on “Mark as Sample” or “Unmark as Sample” changes the visibility of the response to 2 or 3 respectively. Like case 1 mentioned above, this is another situation where the visibility needs to be updated when there is a page event.

Both these cases are event-based and require to make an HTTP request from the browser and handle the response while staying on the same page. Therefore, according to standard practice, an AJAX request must be initiated on click of the button or checkbox. The request needs two parameters - response id, and the updated value of visibility. User-identifying data is sent by default in HTTP header cookies (as in any usual HTTP request).

To handle these requests, we have created a sample_reviews controller with a method update_visibility. Within the method, we first check whether the request parameters are valid, and then proceed to check whether the current user (identified by session id) should be allowed to edit the response object to the visibility value passed in the request.

We have validated requests in this manner since HTTP is stateless and requests can easily be cloned (a browser need not be the only client making requests). For example, one could simply copy the request as a cURL, change the session id in the HTTP header to a student’s session, and pass alternative values of visibility (say 2, meaning, approved as a sample) in the request. Such requests should be identified as unauthorized requests, while requests which want to update visibility to a value that’s not allowed need to be rejected as bad requests.

<pre>
def update_visibility
begin
visibility = params[:visibility] #response object consists of visibility in string format
if(visibility.nil?)
raise StandardError.new("Missing parameter 'visibility'")
end
visibility = visibility.to_i

if not (_private..rejected_as_sample).include? visibility
raise StandardError.new("Invalid value for parameter 'visibility'")
end
@@response_id = params[:id]
response_map_id = Response.find(@@response_id).map_id
response_map = ResponseMap.find(response_map_id)
assignment_id = response_map.reviewed_object_id
is_admin = [Role.administrator.id,Role.superadministrator.id].include? current_user.role.id
if is_admin
Response.update(@@response_id.to_i, :visibility => visibility)
update_similar_assignment(assignment_id, visibility)
render json:{"success" => true}
return
end
course_id = Assignment.find(assignment_id).course_id
instructor_id = Course.find(course_id).instructor_id
ta_ids = []
if current_user.role.id == Role.ta.id
ta_ids = TaMapping.where(course_id).ids # do this query only if current user is ta
elsif current_user.role.id == Role.student.id
# find if this student id is the same as the response reviewer id
# and that visiblity is 0 or 1 and nothing else.
# if anything fails, return failure
if visibility > in_review
render json:{"success" => false, "error"=>"Not allowed"}
return
end
reviewer_user_id = AssignmentParticipant.find(response_map.reviewer_id).user_id
if reviewer_user_id != current_user.id
render json:{"success" => false,"error" => "Unathorized"}
return
end

elsif not ([instructor_id] + ta_ids).include? current_user.id
render json:{"success" => false,"error" => "Unathorized"}
return
end
Response.update(@@response_id.to_i, :visibility => visibility)
update_similar_assignment(assignment_id, visibility)
rescue StandardError => e
render json:{"success" => false,"error" => e.message}
else
render json:{"success" => true}
end
end

</pre>

We have provided a success or error message text below the button to indicate to the user that the request is completed.

[[file: Mark unmark picssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss]]

We have used the same request mark_unmark/:id with POST data as {“visibility”:x}, in the student view as well.

This project also required that assignments be linked to each other, as explained in the sections above. To this end, we have created a controller, model, and a migration (to create the database table) for similar assignments.

By default, every assignment is similar to itself (assume it’s id is X). So, after updating a response’s visibility, we add a new entry in the similar_assignments table: (assignment_id = X, similar_for = X, association_intent = “Review”). This addition is done only after confirming for non-existence, as one can infer from the following code snippet:

<pre>
private
def update_similar_assignment(assignment_id, visibility)
if visibility == approved_as_sample
ids = SimilarAssignment.where(:is_similar_for => assignment_id, :association_intent => intent_review,
:assignment_id => assignment_id).ids
if ids.empty?
SimilarAssignment.create({:is_similar_for => assignment_id, :association_intent => intent_review,
:assignment_id => assignment_id})
end
end
if visibility == rejected_as_sample or visibility == _private
response_map_ids = ResponseMap.where(:reviewed_object_id => assignment_id).ids
response_ids = Response.where(:map_id => response_map_ids, :visibility => approved_as_sample)
if response_ids.empty?
SimilarAssignment.where(:assignment_id => assignment_id).destroy_all
end
end
end
</pre>

The power user visits a review response page expecting to mark some reviews as samples and then link or unlink the assignment associated with the review to his / her other assignments. To provide the linking functionality, we have provided a clickable text “ Use as Samples for More Assignments” at the top right corner of the page as shown below.

[[for use as sample for more assignment]]

The appearance or non-appearance of this text is conditional. It only appears when there is at least one sample review for the current assignment. So, to decide this, we have queried for those assignments for which this assignment is a similar one, and checked on the size of the query result. The size is then checked in popup_controller to set an instance variable popup_show to a boolean value. The view uses this to render or not render the clickable “Use as Samples for More Assignments” text.

Code snippet of get_similar_assignment_ids
<pre>
def get_similar_assignment_ids(assignment_id)
SimilarAssignment.where(:assignment_id => assignment_id).pluck(:is_similar_for)
end
</pre>

Code snippet of popup_controller line 84
<pre>
@page_size = popup_page_size
</pre>

On click of this text, we open a popup that lists out (with a checkbox alongside each list entry) the candidate assignments that this assignment can be similar for (these are unchecked), and assignments that it is already similar for (these are checked). For example, assume that the power user is viewing the response page of assignment X. Assume we have entries (X,Y,”review”) and (X,Z,”review”) in similar_assignments table. Then, the popup list will have the assignments Y and Z with a checkbox against each of them ticked, and all the other assignments that the current user has access to, with a checkbox against each of them unticked.

The popup and the data that go with it are fetched on demand. So, the assignment list need not be a part of the first render of the page itself, as the inherent querying would slow down page load time. Therefore, on click, we fetch the list by an AJAX request (we have given appropriate error messages below the clickable text for the rare eventuality of any server-side error or empty response).

This request GET “/similar_assignments/:id” is again authenticated in similar_assignments_controller, get method. Same validation ideas as explained earlier are used. Only the assignment’s course instructor and TAs, admin, and super-admin should be able to fetch this data, while others need not have access to it.

Code snippet of get method
<pre>
# GET /similar_assignments/:id
def get
@assignment_id = params[:id]
ids = Response.joins("INNER JOIN response_maps ON response_maps.id = responses.map_id
WHERE visibility=2 AND reviewed_object_id ="+@assignment_id.to_s).ids
if ids.empty?
render json: {"success"=>false, "error"=>"Please mark atleast one review as sample"}
return
end
begin
if current_user.role.id == Role.student.id
throw Exception.new
end
@similar_assignments = SimilarAssignment.where(:assignment_id => @assignment_id).
where.not(:is_similar_for=>@assignment_id).order("created_at DESC").pluck(:is_similar_for)
rescue ActiveRecord::RecordNotFound => e
render json: {"success" => false, "error" => "Resource not found"}
rescue Exception
render json: {"success" => false, "error" => "Unauthorized"}
else
@res = get_asssignments_set(@similar_assignments)
render json: {"success" => true, "values" => @res}
end
end
</pre>

The get method fetches similar assignment ids and passes them on to get_asssignments_set of similar_assignments_helper. This method queries for all assignments (except the ones passed in its parameter list) that the current user is allowed to access and returns a list of hash objects which are used by the caller (the on-success function of the AJAX request). Each hash object contains assignment name, id, it’s course name, and whether it’s a similar assignment or not. Following code snippets demonstrates this:

Code snippet of get_asssignments_set method
<pre>
def get_asssignments_set(selected)
all_assignments = get_assignments_based_on_role
assignment_array = []
courses = get_courses_based_on_role
all_assignments.each {
|assignment|
course_id = assignment.course_id
if(course_id.nil?)
next
end
if (selected.include? assignment.id)
hash1 = {:title => assignment.name, :course_name => courses[course_id], :checked => true, :id => assignment.id}
assignment_array.push(hash1)
else
hash2 = {:title => assignment.name, :course_name => courses[course_id], :checked => false, :id => assignment.id}
assignment_array.push(hash2)
end
}
return assignment_array
end
</pre>

Code snippet of get_assignments_based_on_role method

<pre>
def get_assignments_based_on_role()
role = current_user.role.id
page = params[:page]
assignment_id = params[:id].to_i
if page.nil?
page = 0
end
_offset = page.to_i * popup_page_size
case role
when Role.ta.id
course_ids = TaMapping.where(:ta_id => current_user.id).pluck(:course_id)
@all_assignments = Assignment.where(:course_id => course_ids).
where.not(:id=>assignment_id).limit(popup_page_size).offset(_offset).order("created_at DESC")
when Role.instructor.id
course_ids = Course.where(:instructor_id => current_user.id).pluck(:id)
@all_assignments = Assignment.where(:course_id => course_ids).
where.not(:id=>assignment_id).limit(popup_page_size).offset(_offset).order("created_at DESC")
else
@all_assignments = []
end
@all_assignments
end
</pre>

The query result can be prohibitively large. This calls for pagination.

Pagination at the server side is about performing the same query as a non-pagination implementation, with an addition: limit and offset. Limit denotes the size of a page, and offset denotes a start index, and is calculated as page size * page number. Page size is a constant defined in similar_assignments_constants.

We had two options for response and rendering:
Construct the popup list HTML from the query results and respond with this HTML.
Respond with JSON, and build the HTML client side.

Responding with HTML from server-side is expensive, as the byte size of the HTTP response would be significantly larger than JSON. Thus, we chose the second option.

Since HTTP is stateless, the server has no way to maintain a running counter of page number. Therefore, keeping track of page number must be the responsibility of the client (browser JavaScript) who must pass it as a request parameter while the server simply reads it and assumes its lack of existence as page number 0. The following snippet demonstrates this:

Snippet of response.js line 103-130
<pre>
fetchAssignments:function(){
var self = this;
var ajaxUrl = "/similar_assignments/"+assignmentId;
if(this.currentPageNumber > 0){
ajaxUrl += "?page="+this.currentPageNumber;
}
jQuery.ajax({
"url":ajaxUrl,
"type":"GET",
"dataType":"json",
"responseType":"json",
"beforeSend":function(){
self.hideSuccess();
self.hideError();
},
"success":function(result){
if(result.success && result.values.length){
self.onFetchSuccess(result.values);
}else if(result.success && self.currentPageNumber == 0){
self.onFetchFail("Cannot link this to any assignment!");
}else if(result.success){
self.onFetchSuccess(result.values);
}
else{
self.onFetchFail(result.error);
}
},
"failure": self.onFetchFail,
"error":self.onFetchFail
</pre>

We have avoided maintaining the constant value of page size once on server side (in similar_assignments_constants) and once on the client side (JS variable). The initial render of the page creates a hidden HTML element that contains the page size, and once the document is ready, response.js selects that element, reads its value into a variable, and deletes that HTML element. This prevents having a page size in the HTML page-source, and more importantly, complies with the DRY principle. Page size should be changed in one function only - and that is in similar_assignments_constants as explained earlier.

From the response JSON containing an array of objects (that are going to be rendered as list items), we have constructed the HTML list. Each list item maintains its assignment id in its HTML data attribute. The following snippet shows this.

Response.js lines 67-78
<pre>
addToList:function(assignment){
var assignmentId = assignment.id;
var title = assignment.title;
var course = assignment.course_name;
var displayText = "<strong>"+course+": </strong>" +title;
var checked = assignment.checked;
var newRow = this.template.clone();
newRow.removeClass("hide").find("input").attr("data-id",assignmentId).attr("checked",checked);
newRow.find("span").html(displayText).on("click",function(){
newRow.find("input").click();
});
this.list.append(newRow.removeAttr("id"));
},
</pre>

_________________________________________A snapshot of the popup is shown below.

The “More” button (shown in the snapshot above) is used to fetch the next set of results.

After a finite number of requests, the client receives a lesser number of results than expected. This is when pagination must stop (since there are no more results). This is achieved by the object AssignmentsPopup (in our response.js file) - it maintains the page size and current page number. The more button is now replaced by a text “No more results” and it’s on-click functionality is turned off.

______________________________________________Screenshot of popup with “No more results”

Further, we have implemented this as a plug-and-play service. By reusing the same popup HTML and the AssignmentsPopup variable, the entire popup can be made a part of any Expertiza page.

The page makes no requests on closing the popup, or on clicking Submit without checking any unchecked list item or unchecking any checked list item. It submits only if there is an overall difference in what items are checked and what are not.

Click of “Submit” makes another AJAX POST request to “/similar_assignments/create/:id” with two params in the post JSON data:
“checked” - an array of assignment ids that were checked in the list but unchecked while opening the popup
“unchecked” - an array of assignment ids that were unchecked in the list but checked while opening the popup

Either of these params may be empty, depending on the user’s actions, but not both (if both were empty, we simply close the popup without submitting). However, this optimization is only client side. Server side logic must still check for duplicates - that is, an assignment id under “checked” is already a part of similar_assignments.

Let current assignment id be X. For each of the checked assignment ids Ci in {C1,C2,...,Cn}, we have checked if there are entries (X,Ci) in similar_assignments table, and if not, then created that entry. Similarly, for each of the unchecked assignment ids Ui in {U1,U2,...,Um}, we have deleted the entry (X,Ui) from similar_assignments.

On a successful update, the client closes the popup and prints a success message.

_________________________________________________________________________________________Snapshot with success message

So far, power users have marked reviews as samples and linked assignments. Now, students need to view these samples. A student would view these sample reviews before writing their review on somebody else’s work. Therefore, we have added a link “View Sample Reviews” to view the list of sample reviews.

________________________________________________________________UI screenshot here.<pending>

Similarly, power users might also want to view samples. We have provided the same link on the following page too.

________________________________________________________________UI screenshot here

This page is rendered by the index method in sample_reviews_controller. It is a list of links to sample reviews. The layout of this page is common for users, as long as they are logged in. Non-logged-in or anonymous visitors are redirected to the Expertiza home page. ‘index’ calls a method redirect_anonymous_user in sample_reviews_helper to achieve this.

Snippet of sample_reviews_helper
<pre>
def redirect_anonymous_user
current_user = session[:user]
if current_user.nil?
redirect_to "/"
end
end
</pre>

The list of available samples has no upper bound on its size. Yet again, pagination solves this problem. But unlike the case of the popup discussed earlier, the response type differs. A request without a ‘page’ parameter in its URL is a request for the web-page and should, therefore, render HTML, while the same request URL with the ‘page’ parameter is a request for more content, and should, therefore, render JSON. The following snippet from the index method demonstrates this.

Sample_reviews_controller - index method - add the if-else just before return statement
<pre>
def index
redirect_anonymous_user
@assignment_id = params[:id].to_i
page_number = params[:page].to_i
if page_number.nil?
page_number = 0
end
@page_size = 8
similar_assignment_ids = get_similar_assignment_ids(@assignment_id)
@response_ids = []
similar_assignment_ids.each do |id|
_offset = page_number * @page_size
ids = Response.joins("INNER JOIN response_maps ON response_maps.id = responses.map_id
WHERE visibility=2 AND reviewed_object_id = "+id.to_s+
" ORDER BY responses.created_at LIMIT "+@page_size.to_s+" OFFSET "+_offset.to_s ).ids
@response_ids += ids
end
@links = generate_links(@response_ids)
if page_number == 0
@course_assignment_name = get_course_assignment_name(@assignment_id)
else
render json: {"success" => true, "sampleReviews" => @links}
end
end
</pre>

During this first render itself, we have also identified whether more results can exist. The “More” button only appears if the number of sample review links being rendered is equal to the page size, as shown in a snippet of views/sample_reviews/index.html.erb below.

Code snip of Lines 12-15
<pre>
<% if @links.size == @page_size %>
<h5 style="cursor:pointer;text-align: center;" id="more_button">More +</h5>
<% end %>
</pre>

Clicking the “More” button now makes the same request as the page’s URL, but with the parameter ‘page’. In that case, the response is JSON, which is used by the caller (JavaScript Ajax) to add more rows to the page. If the number of rows is lesser than expected, the More text is changed, its click listener is turned off, and no more requests are made, demonstrated by the snippet of sample_review.js below.

Code snip of Line 25-35
<pre>
for(var i in result.sampleReviews)
{
currentNumberOfRows++;
var review = result.sampleReviews[i];
var newRow = listTemplate.clone();
newRow.removeClass("hide").removeAttr("id").find("a").
html("Sample Review "+currentNumberOfRows).attr("href",review);
ulList.append(newRow);
}

if(responseSize < pageSize){
self.html("No more results!").off().css({"cursor":"default"});
}
else
{
pageNumber++;
}
</pre>

Each of the list items on the page is a link, which takes the user to /sample_reviews/:id. On this page, we fetch the question-answer pairs corresponding to the object having the id given in the URL and print it out in the form of a table.

=='''Additional Links and References'''==

#[https://github.com/expertiza/expertiza/pull/1291 Link to the Git Pull Request]
#[https://github.com/expertiza/expertiza Expertiza on GitHub]
#[https://github.com/chinmaiks/expertiza GitHub Project Repository Fork]
#[http://expertiza.ncsu.edu/ The Live Expertiza Website]

==Team==
[mailto:aagniho@ncsu.edu Amogh Agnihotri Subbanna]<br>
[mailto:ckaidab@ncsu.edu Chinmai Kaidabettu Srinivas]<br>
[mailto:smadhur@ncsu.edu Siddu Madhure Jayanna]<br>
[mailto:snaramb@ncsu.edu Suhas Naramballi Gururaja]

E1867 allow reviewer to say review can be shown to class as an example

2018-12-07T05:43:48Z

Smadhur:

== Problem Statement ==
The objective of this project is to:
# Add a feature for students to make their reviews 'public', that is, allow other students to view them.
# Add a feature for TA to select a subset of 'public' reviews, and make those reviews visible as sample reviews of the particular assignment.
# Add a feature for Instructor to select a subset of 'public' reviews and make those reviews visible as sample reviews of any of his/her assignments in the course.
# Create a view where the student can see a list of sample reviews of the assignment and have a detailed view of each.
# Allow the student to toggle the visibility of a review he/she has submitted.

== Approach & Design ==

# Consent to make the review public - add a checkbox and an oncheck event handlers (JS) that sets a new field 'visibility' to public of Response object.
# Change the schema of Responses table (add the new column) and write db migrations.
# Create new table, model, view, controller for "similar_assignments" and validate CRUD operations that access the table.
# Add HTML (checkbox) to uncheck the consent such that the reviews becomes private again.
# On the "popup/team_users_popup" page (where instructor/TA can view all reviews), we give a checkbox against every review with public visibility to allow instructors/TAs to select one or more reviews as sample reviews to be available for students.
# Once the instructor selects and submits some reviews as sample reviews, we give a popup containing a list of assignments with a checkbox against each of them and a submit button at the end to allow instructors to make sample reviews available for multiple assignments in one go. We perform validation checks also.
# On submit of the popup, we update the similar_assignments table.
# At the top of student_reviews/list page, we give an option for the student to preview all the available sample reviews.
# Create the MVC setup for this new page to list all the sample reviews. Students will be able to click on one particular review and preview it.

'''DB Design'''

Currently, the Expertiza database design does not maintain any link between different assignments. An assignment of the current semester is completely independent of any other assignment of any other course having similar or exact objectives. For example, in a course C, the assignment named A1 in a semester Sx has no association to the same assignment given in an earlier semester Sy.

Since our task involves using reviews from the past as samples for the present, we should create this association as a new table. Further, reviews may not be the only intention to associate assignments with each other, as future requirements might require associating them on other criteria too. Thus, we find it appropriate to name the table as "similar_assignments".

The table structure is defined [http://wiki.expertiza.ncsu.edu/index.php/Similar_assignments here].

This table can be visualized as a directed graph where vertices represent assignments. An edge (u,v) with a label L means u is similar to v for the intent of association, L.

Consider a row (id = x, assignment_id = Ak, is_similar_for = An, association_intent = "review"). This means, given the intent of association as "review", assignment Ak was chosen as a similar assignment for assignment An. That is, while marking some review for An as a sample, the instructor opted to have reviews of Ak as samples for An as well.

== Implementation Details ==

==== UML - Use Case Diagram ====

[[Image:UseCase.png]]

'''Power Users:''' Instructors, TAs, Admins and Super Admins

'''More details about each point mentioned in the approach section will be updated after the implementation.'''

== Test Plan ==
'''As a Power User (TA/Instructor/Admin/Super Admin)'''
# Log in
# Click on Manage->Assignments
# Displays list of Assignments
# Click View Report/Review for a particular assignment.
# Displays a list of reviews submitted by students.
# Click on any review in "team reviewed" column for a particular student.
# Displays the summary of reviews submitted by that student, with a "Make as sample" button on the right of every review.
# Click on "Make as sample" for the intended reviews, which opens a popup that displays a list of all assignments that are a part of the instructor's courses.
# From this list select all assignments for which the review has to be shown as a sample.
# Click on 'Submit' after selection (this closes the popup).
# Navigate to view reviews of that particular assignment and click on "Sample Reviews".
# A new page is opened that lists out all the sample reviews of the assignment.

'''As a Student'''
# Log in.
# Click on Assignments
# List of assignments is displayed.
# Click on any assignment for which the review has to be submitted.
# Assignment task page is displayed.
# Click on "Other's work" to open the reviews summary page (at /student_review).
# Below the heading "Reviews for ...", click on the "Show sample reviews" link.
# This opens a page where the student can view all sample reviews for that assignment.
# Use the browser's back button to go back to Assignment review page.
# Chose to review any of the teams' assignments that are displayed.
# Select a team for review and fill in the review.
# Before submitting the review, select the checkbox that says "I agree to share this review anonymously as an example to the entire class".
# After clicking on the submit button, the review submitted has been made public.

== Implementation ==

We have added a new column in the ‘responses’ table (in the database), namely, ‘visibility’.
Visibility can have 4 values as listed below:

{| class="wikitable"
|+ Table showing list of visibility values and the properties
! Visibility
! Properties
|-
| 0 || Response is private. This is the default value.
|-
| 1 || The response which was in the review has been approved as an example (that is, it has been marked as a sample)
|-
| 2 || The response which was in the review has been approved as an example (that is, it has been marked as a sample)
|-
| 3 || The response which was either in the review or approved earlier, has now been rejected as an example (it has been unmarked as a sample)
|-
|}

We have maintained these constants in a new file at helpers/response_constants.rb.

<pre>
module ResponseConstants
def _private
0
end

def in_review
1
end

def approved_as_sample
2
end

def rejected_as_sample
3
end
end
</pre>

In the existing implementation of reviews, when a student starts a review (but hasn’t filled any text or ratings yet), a response gets created in the database. This response has a default visibility of 0.

We have provided a checkbox (an HTML input node with attribute ‘type’ as ‘checkbox’) for the student to consent for his / her review to be used as an example, with values 0 and 1 for unchecked and checked respectively. This value is used to update the response object as part of the form submission.

However, a student might want to remove their consent or give their consent, for a review that is already submitted. So, in the page where student views his / her own response, we have added the same HTML checkbox. On checking or unchecking the checkbox, the visibility field in the corresponding response object in the database gets updated.

Now when a power user looks at a review (at url , which is an HTML rendering of a ResponseMap containing Responses), he/she must be able to approve and reject responses which students have consented (offered) to be made visible to all. This is done by providing a button “Mark as Sample” or “Remove as Sample”. Responses without consent will not have any button.

These HTML changes appear in views/popup/team_users_popup.html.haml
<pre>
if instance_variable_get('@sample_button_'+round.to_s)
%div{:class=>'col-md-12 mark-delete-sample '+'round'+round.to_s}
%h3{:class=>'col-md-10'} "Reviewed by #{User.find(@reviewer_id).fullname} (Round #{round})"
%div{:class=>'col-md-2'}

%button{:class=>'col-md-12 mark-unmark-sample-button '+instance_variable_get('@mark_as_sample_'+round.to_s),
:data=>{'visibility':2, 'response_id':instance_variable_get('@response_id_round_' + round.to_s),'round':round} } Mark as Sample
%button{:class=>'col-md-12 mark-unmark-sample-button '+instance_variable_get('@remove_as_sample_'+round.to_s),
:data=>{'visibility':3, 'response_id':instance_variable_get('@response_id_round_' + round.to_s),'round':round} } Remove as Sample

%span{:class=>"hide col-md-12 mark-unmark-sample-result", :id=>"mark_unmark_fail_"+round.to_s}
%span{:class=>"hide col-md-12 mark-unmark-sample-result success", :id=>"mark_unmark_success_"+round.to_s}
</pre>

Clicking on “Mark as Sample” or “Unmark as Sample” changes the visibility of the response to 2 or 3 respectively. Like case 1 mentioned above, this is another situation where the visibility needs to be updated when there is a page event.

Both these cases are event based, and require to make a HTTP request from the browser and handle the response while staying on the same page. Therefore, according to standard practice, an AJAX request must be initiated on click of the button or checkbox. The request needs two parameters - response id, and updated value of visibility. User-identifying data is sent by default in HTTP header cookies (as in any usual HTTP request).

To handle these requests, we have created a sample_reviews controller with a method update_visibility. Within the method, we first check whether the request parameters are valid, and then proceed to check whether the current user (identified by session id) should be allowed to edit the response object to the visibility value passed in the request.

We have validated requests in this manner since HTTP is stateless and requests can easily be cloned (a browser need not be the only client making requests). For example, one could simply copy the request as a cURL, change the session id in the HTTP header to a student’s session, and pass alternative values of visibility (say 2, meaning, approved as sample) in the request. Such requests should be identified as unauthorized requests, while requests which want to update visibility to a value that’s not allowed need to be rejected as bad requests.

<pre>
def update_visibility
begin
visibility = params[:visibility] #response object consists of visibility in string format
if(visibility.nil?)
raise StandardError.new("Missing parameter 'visibility'")
end
visibility = visibility.to_i

if not (_private..rejected_as_sample).include? visibility
raise StandardError.new("Invalid value for parameter 'visibility'")
end
@@response_id = params[:id]
response_map_id = Response.find(@@response_id).map_id
response_map = ResponseMap.find(response_map_id)
assignment_id = response_map.reviewed_object_id
is_admin = [Role.administrator.id,Role.superadministrator.id].include? current_user.role.id
if is_admin
Response.update(@@response_id.to_i, :visibility => visibility)
update_similar_assignment(assignment_id, visibility)
render json:{"success" => true}
return
end
course_id = Assignment.find(assignment_id).course_id
instructor_id = Course.find(course_id).instructor_id
ta_ids = []
if current_user.role.id == Role.ta.id
ta_ids = TaMapping.where(course_id).ids # do this query only if current user is ta
elsif current_user.role.id == Role.student.id
# find if this student id is the same as the response reviewer id
# and that visiblity is 0 or 1 and nothing else.
# if anything fails, return failure
if visibility > in_review
render json:{"success" => false, "error"=>"Not allowed"}
return
end
reviewer_user_id = AssignmentParticipant.find(response_map.reviewer_id).user_id
if reviewer_user_id != current_user.id
render json:{"success" => false,"error" => "Unathorized"}
return
end

elsif not ([instructor_id] + ta_ids).include? current_user.id
render json:{"success" => false,"error" => "Unathorized"}
return
end
Response.update(@@response_id.to_i, :visibility => visibility)
update_similar_assignment(assignment_id, visibility)
rescue StandardError => e
render json:{"success" => false,"error" => e.message}
else
render json:{"success" => true}
end
end

</pre>

We have provided a success or error message text below the button to indicate to the user that the request is completed.

[[file: Mark unmark picssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss]]

We have used the same request mark_unmark/:id with POST data as {“visibility”:x}, in the student view as well.

This project also required that assignments be linked to each other, as explained in the sections above. To this end, we have created a controller, model, and a migration (to create the database table) for similar assignments.

By default, every assignment is similar to itself (assume it’s id is X). So, after updating a response’s visibility, we add a new entry in the similar_assignments table: (assignment_id = X, similar_for = X, association_intent = “Review”). This addition is done only after confirming for non-existence, as one can infer from the following code snippet:

<pre>
private
def update_similar_assignment(assignment_id, visibility)
if visibility == approved_as_sample
ids = SimilarAssignment.where(:is_similar_for => assignment_id, :association_intent => intent_review,
:assignment_id => assignment_id).ids
if ids.empty?
SimilarAssignment.create({:is_similar_for => assignment_id, :association_intent => intent_review,
:assignment_id => assignment_id})
end
end
if visibility == rejected_as_sample or visibility == _private
response_map_ids = ResponseMap.where(:reviewed_object_id => assignment_id).ids
response_ids = Response.where(:map_id => response_map_ids, :visibility => approved_as_sample)
if response_ids.empty?
SimilarAssignment.where(:assignment_id => assignment_id).destroy_all
end
end
end
</pre>

The power user visits a review response page expecting to mark some reviews as samples and then link or unlink the assignment associated with the review to his / her other assignments. To provide the linking functionality, we have provided a clickable text “ Use as Samples for More Assignments” at the top right corner of the page as shown below.

[[for use as sample for more assignment]]

The appearance or non-appearance of this text is conditional. It only appears when there is at least one sample review for the current assignment. So, to decide this, we have queried for those assignments for which this assignment is a similar one, and checked on the size of the query result. The size is then checked in popup_controller to set an instance variable popup_show to a boolean value. The view uses this to render or not render the clickable “Use as Samples for More Assignments” text.

Code snippet of get_similar_assignment_ids
<pre>
def get_similar_assignment_ids(assignment_id)
SimilarAssignment.where(:assignment_id => assignment_id).pluck(:is_similar_for)
end
</pre>

Code snippet of popup_controller line 84
<pre>
@page_size = popup_page_size
</pre>

On click of this text, we open a popup that lists out (with a checkbox alongside each list entry) the candidate assignments that this assignment can be similar for (these are unchecked), and assignments that it is already similar for (these are checked). For example, assume that the power user is viewing the response page of assignment X. Assume we have entries (X,Y,”review”) and (X,Z,”review”) in similar_assignments table. Then, the popup list will have the assignments Y and Z with a checkbox against each of them ticked, and all the other assignments that the current user has access to, with a checkbox against each of them unticked.

The popup and the data that go with it are fetched on demand. So, the assignment list need not be a part of the first render of the page itself, as the inherent querying would slow down page load time. Therefore, on click, we fetch the list by an AJAX request (we have given appropriate error messages below the clickable text for the rare eventuality of any server side error or empty response).

This request GET “/similar_assignments/:id” is again authenticated in similar_assignments_controller, get method. Same validation ideas as explained earlier are used. Only the assignment’s course instructor and TAs, admin and super-admin should be able to fetch this data, while others need not have access to it.

Code snippet of get method
<pre>
# GET /similar_assignments/:id
def get
@assignment_id = params[:id]
ids = Response.joins("INNER JOIN response_maps ON response_maps.id = responses.map_id WHERE visibility=2 AND reviewed_object_id = "+@assignment_id.to_s).ids
if ids.empty?
render json: {"success"=>false, "error"=>"Please mark atleast one review as sample"}
return
end
begin
if current_user.role.id == Role.student.id
throw Exception.new
end
@similar_assignments = SimilarAssignment.where(:assignment_id => @assignment_id).where.not(:is_similar_for=>@assignment_id).order("created_at DESC").pluck(:is_similar_for)
rescue ActiveRecord::RecordNotFound => e
render json: {"success" => false, "error" => "Resource not found"}
rescue Exception
render json: {"success" => false, "error" => "Unauthorized"}
else
@res = get_asssignments_set(@similar_assignments)
render json: {"success" => true, "values" => @res}
end
end
</pre>

The get method fetches similar assignment ids and passes them on to get_asssignments_set of similar_assignments_helper. This method queries for all assignments (except the ones passed in it’s parameter list) that the current user is allowed to access and returns a list of hash objects which are used by the caller (the on-success function of the AJAX request). Each hash object contains assignment name, id, it’s course name, and whether it’s a similar assignment or not. Following code snippets demonstrates this:

Code snippet of get_asssignments_set method
<pre>
def get_asssignments_set(selected)
all_assignments = get_assignments_based_on_role
assignment_array = []
courses = get_courses_based_on_role
all_assignments.each {
|assignment|
course_id = assignment.course_id
if(course_id.nil?)
next
end
if (selected.include? assignment.id)
hash1 = {:title => assignment.name, :course_name => courses[course_id], :checked => true, :id => assignment.id}
assignment_array.push(hash1)
else
hash2 = {:title => assignment.name, :course_name => courses[course_id], :checked => false, :id => assignment.id}
assignment_array.push(hash2)
end
}
return assignment_array
end
</pre>

Code snippet of get_assignments_based_on_role method

<pre>
def get_assignments_based_on_role()
role = current_user.role.id
page = params[:page]
assignment_id = params[:id].to_i
if page.nil?
page = 0
end
_offset = page.to_i * popup_page_size
case role
when Role.ta.id
course_ids = TaMapping.where(:ta_id => current_user.id).pluck(:course_id)
@all_assignments = Assignment.where(:course_id => course_ids).
where.not(:id=>assignment_id).limit(popup_page_size).offset(_offset).order("created_at DESC")
when Role.instructor.id
course_ids = Course.where(:instructor_id => current_user.id).pluck(:id)
@all_assignments = Assignment.where(:course_id => course_ids).
where.not(:id=>assignment_id).limit(popup_page_size).offset(_offset).order("created_at DESC")
else
@all_assignments = []
end
@all_assignments
end
</pre>

The query result can be prohibitively large. This calls for pagination.

Pagination at the server side is about performing the same query as a non-pagination implementation, with an addition: limit and offset. Limit denotes the size of a page, and offset denotes a start index, and is calculated as page size * page number. Page size is a constant defined in similar_assignments_constants.

We had two options for response and rendering:
Construct the popup list HTML from the query results and respond with this HTML.
Respond with JSON, and build the HTML client side.

Responding with HTML from server-side is expensive, as the byte size of the HTTP response would be significantly larger than JSON. Thus, we chose the second option.

Since HTTP is stateless, the server has no way to maintain a running counter of page number. Therefore, keeping track of page number must be the responsibility of the client (browser JavaScript) who must pass it as a request parameter while the server simply reads it and assumes its lack of existence as page number 0. The following snippet demonstrates this:

Snippet of response.js line 103-130
<pre>
fetchAssignments:function(){
var self = this;
var ajaxUrl = "/similar_assignments/"+assignmentId;
if(this.currentPageNumber > 0){
ajaxUrl += "?page="+this.currentPageNumber;
}
jQuery.ajax({
"url":ajaxUrl,
"type":"GET",
"dataType":"json",
"responseType":"json",
"beforeSend":function(){
self.hideSuccess();
self.hideError();
},
"success":function(result){
if(result.success && result.values.length){
self.onFetchSuccess(result.values);
}else if(result.success && self.currentPageNumber == 0){
self.onFetchFail("Cannot link this to any assignment!");
}else if(result.success){
self.onFetchSuccess(result.values);
}
else{
self.onFetchFail(result.error);
}
},
"failure": self.onFetchFail,
"error":self.onFetchFail
</pre>

We have avoided maintaining the constant value of page size once on server side (in similar_assignments_constants) and once on client side (JS variable). The initial render of the page creates a hidden HTML element that contains the page size, and once the document is ready, response.js selects that element, reads its value into a variable, and deletes that HTML element. This prevents having page size in the HTML page-source, and more importantly, complies with the DRY principle. Page size should be changed in one function only - and that is in similar_assignments_constants as explained earlier.

From the response JSON containing an array of objects (that are going to be rendered as list items), we have constructed the HTML list. Each list item maintains its assignment id in its HTML data attribute. The following snippet shows this.

Response.js lines 67-78
<pre>
addToList:function(assignment){
var assignmentId = assignment.id;
var title = assignment.title;
var course = assignment.course_name;
var displayText = "<strong>"+course+": </strong>" +title;
var checked = assignment.checked;
var newRow = this.template.clone();
newRow.removeClass("hide").find("input").attr("data-id",assignmentId).attr("checked",checked);
newRow.find("span").html(displayText).on("click",function(){
newRow.find("input").click();
});
this.list.append(newRow.removeAttr("id"));
},
</pre>

_________________________________________A snapshot of the popup is shown below.

The “More” button (shown in the snapshot above) is used to fetch the next set of results.

After a finite number of requests, the client receives a lesser number of results than expected. This is when pagination must stop (since there are no more results). This is achieved by the object AssignmentsPopup (in our response.js file) - it maintains the page size and current page number. The more button is now replaced by a text “No more results” and it’s on-click functionality is turned off.

______________________________________________Screenshot of popup with “No more results”

Further, we have implemented this as a plug-and-play service. By reusing the same popup HTML and the AssignmentsPopup variable, the entire popup can be made a part of any Expertiza page.

The page makes no requests on closing the popup, or on clicking Submit without checking any unchecked list item or unchecking any checked list item. It submits only if there is an overall difference in what items are checked and what are not.

Click of “Submit” makes another AJAX POST request to “/similar_assignments/create/:id” with two params in the post JSON data:
“checked” - an array of assignment ids that were checked in the list but unchecked while opening the popup
“unchecked” - an array of assignment ids that were unchecked in the list but checked while opening the popup

Either of these params may be empty, depending on the user’s actions, but not both (if both were empty, we simply close the popup without submitting). However, this optimization is only client side. Server side logic must still check for duplicates - that is, an assignment id under “checked” is already a part of similar_assignments.

Let current assignment id be X. For each of the checked assignment ids Ci in {C1,C2,...,Cn}, we have checked if there are entries (X,Ci) in similar_assignments table, and if not, then created that entry. Similarly, for each of the unchecked assignment ids Ui in {U1,U2,...,Um}, we have deleted the entry (X,Ui) from similar_assignments.

On successful update, the client closes the popup and prints a success message.

_________________________________________________________________________________________Snapshot with success message

So far, power users have marked reviews as samples and linked assignments. Now, students need to view these samples. A student would view these sample reviews before writing their review on somebody else’s work. Therefore, we have added a link “View Sample Reviews” to view the list of sample reviews.

________________________________________________________________UI screenshot here.<pending>

Similarly, power users might also want to view samples. We have provided the same link on the following page too.

________________________________________________________________UI screenshot here

This page is rendered by the index method in sample_reviews_controller. It is a list of links to sample reviews. The layout of this page is common for users, as long as they are logged in. Non logged-in, or anonymous visitors are redirected to the Expertiza home page. ‘index’ calls a method redirect_anonymous_user in sample_reviews_helper to achieve this.

Snippet of sample_reviews_helper
<pre>
def redirect_anonymous_user
current_user = session[:user]
if current_user.nil?
redirect_to "/"
end
end
</pre>

The list of available samples has no upper bound on its size. Yet again, pagination solves this problem. But unlike the case of the popup discussed earlier, the response type differs. A request without a ‘page’ parameter in its URL is a request for the web-page and should therefore render HTML, while the same request URL with the ‘page’ parameter is a request for more content, and should therefore, render JSON. Following snippet from the index method demonstrates this.

Sample_reviews_controller - index method - add the if-else just before return statement
<pre>
def index
redirect_anonymous_user
@assignment_id = params[:id].to_i
page_number = params[:page].to_i
if page_number.nil?
page_number = 0
end
@page_size = 8
similar_assignment_ids = get_similar_assignment_ids(@assignment_id)
@response_ids = []
similar_assignment_ids.each do |id|
_offset = page_number * @page_size
ids = Response.joins("INNER JOIN response_maps ON response_maps.id = responses.map_id
WHERE visibility=2 AND reviewed_object_id = "+id.to_s+
" ORDER BY responses.created_at LIMIT "+@page_size.to_s+" OFFSET "+_offset.to_s ).ids
@response_ids += ids
end
@links = generate_links(@response_ids)
if page_number == 0
@course_assignment_name = get_course_assignment_name(@assignment_id)
else
render json: {"success" => true, "sampleReviews" => @links}
end
end
</pre>

During this first render itself, we have also identified whether more results can exist. The “More” button only appears if the number of sample review links being rendered is equal to the page size, as shown in a snippet of views/sample_reviews/index.html.erb below.

Code snip of Lines 12-15
<pre>
<% if @links.size == @page_size %>
<h5 style="cursor:pointer;text-align: center;" id="more_button">More +</h5>
<% end %>
</pre>

Clicking the “More” button now makes the same request as the page’s URL, but with the parameter ‘page’. In that case, the response is JSON, which is used by the caller (JavaScript Ajax) to add more rows to the page. If the number of rows is lesser than expected, the More text is changed, its click listener is turned off, and no more requests are made, demonstrated by the snippet of sample_review.js below.

Code snip of Line 25-35
<pre>
for(var i in result.sampleReviews)
{
currentNumberOfRows++;
var review = result.sampleReviews[i];
var newRow = listTemplate.clone();
newRow.removeClass("hide").removeAttr("id").find("a").
html("Sample Review "+currentNumberOfRows).attr("href",review);
ulList.append(newRow);
}

if(responseSize < pageSize){
self.html("No more results!").off().css({"cursor":"default"});
}
else
{
pageNumber++;
}
</pre>

Each of the list items on the page is a link, which takes the user to /sample_reviews/:id. On this page, we fetch the question-answer pairs corresponding to the object having the id given in the URL and print it out in the form of a table.

=='''Additional Links and References'''==

#[https://github.com/expertiza/expertiza/pull/1291 Link to the Git Pull Request]
#[https://github.com/expertiza/expertiza Expertiza on GitHub]
#[https://github.com/chinmaiks/expertiza GitHub Project Repository Fork]
#[http://expertiza.ncsu.edu/ The Live Expertiza Website]

==Team==
[mailto:aagniho@ncsu.edu Amogh Agnihotri Subbanna]<br>
[mailto:ckaidab@ncsu.edu Chinmai Kaidabettu Srinivas]<br>
[mailto:smadhur@ncsu.edu Siddu Madhure Jayanna]<br>
[mailto:snaramb@ncsu.edu Suhas Naramballi Gururaja]

E1867 allow reviewer to say review can be shown to class as an example

2018-11-21T00:29:07Z

Smadhur: /* Implementation Details */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-21T00:28:43Z

Smadhur: /* Implementation Details */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-21T00:20:36Z

Smadhur: /* Design */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-21T00:20:23Z

Smadhur: /* DB Design */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-21T00:20:08Z

Smadhur: /* Approach & Design */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-21T00:19:45Z

Smadhur: /* Approach & Design */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-21T00:18:45Z

Smadhur: /* Approach */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-20T23:48:54Z

Smadhur: /* Test Plan */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-20T23:47:42Z

Smadhur: /* UML - Use Case Diagram */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-20T23:47:16Z

Smadhur: /* UML - Use Case Diagram */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-20T23:46:30Z

Smadhur: /* UML - Use Case Diagram */

File:UseCase.png

2018-11-20T23:45:58Z

Smadhur: uploaded a new version of "File:UseCase.png"

E1867 allow reviewer to say review can be shown to class as an example

2018-11-16T18:26:23Z

Smadhur: /* Approach */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-16T02:40:00Z

Smadhur: /* Implementation Details */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-16T02:39:44Z

Smadhur: /* Implementation Details */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-16T02:21:02Z

Smadhur: /* Implementation Details */

File:Use Case Dia.png

2018-11-16T02:20:42Z

Smadhur:

E1867 allow reviewer to say review can be shown to class as an example

2018-11-16T02:19:05Z

Smadhur: /* Implementation Details */

File:Use Case Diag.png

2018-11-16T02:18:48Z

Smadhur:

E1867 allow reviewer to say review can be shown to class as an example

2018-11-16T02:17:35Z

Smadhur: /* Implementation Details */

File:Use Case Diagram.png

2018-11-16T02:16:27Z

Smadhur: uploaded a new version of "File:Use Case Diagram.png"

E1867 allow reviewer to say review can be shown to class as an example

2018-11-16T01:43:48Z

Smadhur: /* Implementation Details */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-16T01:43:11Z

Smadhur: /* Implementation Details */

File:Use Case Diagram.png

2018-11-16T01:40:40Z

Smadhur:

E1867 allow reviewer to say review can be shown to class as an example

2018-11-16T01:20:03Z

Smadhur: /* Project Tasks */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T04:09:36Z

Smadhur: /* Project Tasks */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T04:09:19Z

Smadhur: /* Project Tasks */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T04:07:54Z

Smadhur: /* Project Tasks */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T04:06:47Z

Smadhur: /* Project Tasks */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T04:04:08Z

Smadhur: /* Additional Links and References */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T04:02:42Z

Smadhur: /* References */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T04:02:08Z

Smadhur: /* Additional Links and References */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T03:55:09Z

Smadhur: /* External Links */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T03:51:16Z

Smadhur: /* Test Plan */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T03:50:09Z

Smadhur: /* Expected Flow */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T03:45:33Z

Smadhur: /* Implem */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T03:45:23Z

Smadhur: /* Test Plan */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T03:43:36Z

Smadhur: /* Current status of Development */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T03:42:42Z

Smadhur: /* External Links */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T03:40:28Z

Smadhur: /* Project Tasks */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T03:35:57Z

Smadhur: /* Future Scope */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T03:35:38Z

Smadhur: /* Test Plan */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T03:35:09Z

Smadhur: /* Sample Submissions View */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T03:34:51Z

Smadhur: /* Developed Code */

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T03:34:33Z

Smadhur: /* Current status of Development */

== Introduction ==
[http://expertiza.ncsu.edu/ Expertiza] is a web based open source peer reviewing tool developed and maintained by current and past students of [https://en.wikipedia.org/wiki/North_Carolina_State_University North Carolina State University]. Peer review is a great way for a student to learn how to approach a project and get ideas for their own projects. Currently, there is no way for a student to view another student's work, unless they are reviewing the other student's work.

== Problem Statement ==
The objective of this project is to:
# Add a feature for students to make their reviews 'public', that is, allow other students to view them.
# Add a feature for TA to select a subset of 'public' reviews, and make those reviews visible as sample reviews of the particular assignment.
# Add a feature for Instructor to select a subset of 'public' reviews and make those reviews visible as sample reviews of any of his/her assignments in the course.
# Create a view where the student can see a list of sample reviews of the assignment and have a detailed view of each.
# Allow the student to toggle the visibility of a review he/she has submitted.

== Proposed Flow ==

During each review, there will be a checkbox that says "I agree to share this review anonymously as an example to the entire class", and students can decide to check this box or not just before they submit reviews. Behind the scenes, we need to set a "status" field to “public”of the Response object.

== Project Tasks ==
The tasks that need to be completed as part of this project can be listed as follows:
# Add checkbox against each assignment in student_tasks/list view to allow student to publish their work
# Add column make_public to table teams for storing user permission (published or not) for each project.
# Add controller for Sample submissions and implement corresponding methods.
# Add views for sample submissions
# Make changes to page student_task/view which would have link to sample submissions for each project.
# Add drop down in assignments/edit/_general view.
# Add controller code for the drop down.
# Add column sample_assignment_id to table assignment.
# Add test scripts for all the functionality.

== Current status of Development ==
In progress

== Developed Code ==
1. Add checkbox against each assignment in student_tasks/list view to allow student to publish their work
<pre>
<% if !participant.team.nil? %>
<td align=center>
<input id="makeSubPublic" teamid="<%= participant.team.id %>" type="checkbox" onclick="publishConfirmation(this)" <% if participant.team.make_public %>checked<% end %>>
</td>
<% end %>
</pre>

2. Add column make_public to table teams for storing user permission (published or not) for each project.
<pre>
class AddSampleAssignmentToAssignments < ActiveRecord::Migration
def change
add_column :assignments, :sample_assignment_id, :integer, index: true
add_foreign_key :assignments, :assignments, column: :sample_assignment_id
end
end
</pre>
3. Add controller for Sample submissions and implement corresponding methods.
<pre>
# To give permission for making a submission available to others
def make_public
@team = Team.find(params[:id])
@team.make_public = params[:status]
@team.save
respond_to do |format|
format.html { head :no_content }
end
end
</pre>
4. Add views for sample submissions
<pre>

<h2>Sample Submissions for <%= @assignment.name%>:</h2>
<br>

<h3>Submissions made public by peers:</h3>
<% if @assignment_due_date==nil or @assignment_due_date>Time.new() %>
<br><i>Will be available once the assignment submission is completed</i>
<% elsif @assignment_teams==[] %>
<br><i>No sample submissions from current assignment made public yet</i>
<% else %>
<ul>
<% @assignment_teams.each do |assignment_team| %>
<% if assignment_team.hyperlinks != [] %>
<li>
<ul>
<h4>Team name : <%=assignment_team.name%></h4>
<% assignment_team.hyperlinks.each do |assignment_link| %>
<li><a href="<%=assignment_link%>"><%=assignment_link%></a></li>
<%end%>
</ul>
</li>
<%end%>
<% end%>
</ul>
<% end %>
<br>
<hr/>
<br>


<h3>Submissions made public by instructor:</h3>
<% if @assignment_teams_professor == [] %>
<br><i>No sample submissions from previous assignments made available yet</i>
<% else %>
<ul>
<% @assignment_teams_professor.each do |assignment_team| %>
<% if assignment_team.hyperlinks != [] %>
<ul>
<li>
<h4>Team name : <%=assignment_team.name%></h4>
<% assignment_team.hyperlinks.each do |assignment_link| %>
<li><a href="<%=assignment_link%>"><%=assignment_link%></a></li>
<%end%>
</li>
</ul>
<%end%>
<% end%>
</ul>
<% end %>
<br><br>

<a href="javascript:window.history.back()">Back</a>
</pre>
5. Make changes to page student_task/view which would have link to sample submissions for each project.
<pre>
<li>
<%= link_to "Sample Submissions", controller: 'sample_submissions', :action => 'index', :id => @assignment.id %>
(View sample work submitted by other participants/teams)
</li>
</pre>
6. Add drop down in assignments/edit/_general view.
<pre>

<tr>
<td style='padding:5px'><%= label_tag('assignment_form[assignment][sample_assignment_id]', 'Sample Assignment:') %>
<img src="/assets/info.png" title='- Select an assignment that students can refer sample submission from.'>
</td>
<td style='padding:5px'><%= select('assignment_form[assignment]', 'sample_assignment_id', sample_sub_options, :selected => @assignment_form.assignment.sample_assignment_id) %>
</td>
</tr>
</pre>
7. Add controller code for the drop down.
<pre>
def sample_sub_options
assignments = Assignment.all
options = []
assignments.each do |assignment|
course_name = ""
if assignment.course_id and assignment.course_id != 0 and !Course.find(assignment.course_id).nil?
course_name = Course.find(assignment.course_id).name
end
options << [course_name + '- ' + assignment.name, assignment.id]
end
options.uniq.sort
options.unshift(['-----------', nil])
end
</pre>
8. Add column sample_assignment_id to table assignment.
<pre>
class AddSampleAssignmentToAssignments < ActiveRecord::Migration
def change
add_column :assignments, :sample_assignment_id, :integer, index: true
add_foreign_key :assignments, :assignments, column: :sample_assignment_id
end
end
</pre>
9. Add test scripts for all the functionality.
<pre>
def create_assignment_team(assignment_name, parent_id)
assignment_team = AssignmentTeam.new
assignment_team.name = assignment_name
assignment_team.parent_id = parent_id
assignment_team.save!
end

def init_test
# create assignment and topic
assignment = build(Assignment)
course = Course.new
course.name = "SampleSubmissionTestCourse"
course.save
assignment.course_id = course.id
assignment.save

create_assignemnt_team("ss_assignment_team_1", assignment.id)
create_assignemnt_team("ss_assignment_team_2", assignment.id)
end

def visit_sample_submissions_page
visit '/student_task/list'
click_on "Example Assignment"
click_on "Sample Submissions"
end

describe "sample submission test" do
before(:each) { init_test }

it "is able to make an assignment public" do
visit '/student_task/list'
find(:css, "#makeSubPublic[teamid='6050']").trigger("click")
click_button 'OK'
expect(page).to have_http_status(200)
end

it "should not see current assignment submissions if deadline is not met" do # Set deadline after current time.
visit_sample_submissions_page
expect(page).to have_content "No sample submissions from current assignment made public yet"
end

it "should see current assignment submissions if deadline is met" do # Set deadline before current time.
visit_sample_submissions_page
expect(page).to_not have_content "No sample submissions from current assignment made public yet"
end

it "should not see instructor selected submissions if instructor has not selected them" do
visit_sample_submissions_page
expect(page).to have_content "No sample submissions from previous assignment made available yet"
end

it "should see instructor selected submissions if instructor has selected them" do # Instructor makes submission available.
visit_sample_submissions_page
expect(page).to_not have_content "No sample submissions from previous assignment made available yet"
end
end
</pre>

== Sample Submissions View ==

1. The first screenshot of the application is taken when the deadline for the current assignment has not crossed and the instructor also has not given any sample assignment for this assignment.

[[Image:Assignments not made public.PNG]]

2. The second screenshot of the application is taken when the deadline for the current assignment has not crossed but the instructor has selected a sample assignment for viewing against this assignment.

[[Image:Assignment submission date not passed.PNG]]

3. The third screenshot of the application is taken when both the deadline for the current assignment has crossed and the instructor has selected a sample assignment for viewing.

[[Image:Assignments available.PNG]]

== Test Plan ==

Many of our changes are reflected on views (user interface). So we build tests with rspec/capybara. Following is the list of tests that conduct:

# it "is able to make an assignment public"
# it "is able to view sample submissions page"
# it "should not see current assignment submissions if deadline is not met"
# it "should see current assignment submissions if deadline is met"
# it "should not see instructor selected submissions if instructor has not selected them"
# it "should see instructor selected submissions if instructor has selected them"

<pre>
def create_assignment_team(assignment_name, parent_id)
assignment_team = AssignmentTeam.new
assignment_team.name = assignment_name
assignment_team.parent_id = parent_id
assignment_team.save!
end

def init_test
# create assignment and topic
assignment = build(Assignment)
course = Course.new
course.name = "SampleSubmissionTestCourse"
course.save
assignment.course_id = course.id
assignment.save

create_assignemnt_team("ss_assignment_team_1", assignment.id)
create_assignemnt_team("ss_assignment_team_2", assignment.id)
end

def visit_sample_submissions_page
visit '/student_task/list'
click_on "Example Assignment"
click_on "Sample Submissions"
end

describe "sample submission test" do
before(:each) { init_test }

it "is able to make an assignment public" do
visit '/student_task/list'
find(:css, "#makeSubPublic[teamid='6050']").trigger("click")
click_button 'OK'
expect(page).to have_http_status(200)
end

it "should not see current assignment submissions if deadline is not met" do # Set deadline after current time.
visit_sample_submissions_page
expect(page).to have_content "No sample submissions from current assignment made public yet"
end

it "should see current assignment submissions if deadline is met" do # Set deadline before current time.
visit_sample_submissions_page
expect(page).to_not have_content "No sample submissions from current assignment made public yet"
end

it "should not see instructor selected submissions if instructor has not selected them" do
visit_sample_submissions_page
expect(page).to have_content "No sample submissions from previous assignment made available yet"
end

it "should see instructor selected submissions if instructor has selected them" do # Instructor makes submission available.
visit_sample_submissions_page
expect(page).to_not have_content "No sample submissions from previous assignment made available yet"
end
end
</pre>

== Future Scope ==
# Publishing sample reviews made by students: This feature will require students to allow their review to be published as a sample review. This can then be made available to future students.

== External Links ==
# link to forked repository [https://github.com/ashiskumar123/expertiza]
# link to the git pull request [https://github.com/expertiza/expertiza/pull/1169]
# link to the deployed application [http://ec2-13-59-7-94.us-east-2.compute.amazonaws.com:3000]

== References ==
# Link to expertiza website: [https://expertiza.ncsu.edu/]

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T03:33:40Z

Smadhur: /* Proposed Design */

== Introduction ==
[http://expertiza.ncsu.edu/ Expertiza] is a web based open source peer reviewing tool developed and maintained by current and past students of [https://en.wikipedia.org/wiki/North_Carolina_State_University North Carolina State University]. Peer review is a great way for a student to learn how to approach a project and get ideas for their own projects. Currently, there is no way for a student to view another student's work, unless they are reviewing the other student's work.

== Problem Statement ==
The objective of this project is to:
# Add a feature for students to make their reviews 'public', that is, allow other students to view them.
# Add a feature for TA to select a subset of 'public' reviews, and make those reviews visible as sample reviews of the particular assignment.
# Add a feature for Instructor to select a subset of 'public' reviews and make those reviews visible as sample reviews of any of his/her assignments in the course.
# Create a view where the student can see a list of sample reviews of the assignment and have a detailed view of each.
# Allow the student to toggle the visibility of a review he/she has submitted.

== Proposed Flow ==

During each review, there will be a checkbox that says "I agree to share this review anonymously as an example to the entire class", and students can decide to check this box or not just before they submit reviews. Behind the scenes, we need to set a "status" field to “public”of the Response object.

== Project Tasks ==
The tasks that need to be completed as part of this project can be listed as follows:
# Add checkbox against each assignment in student_tasks/list view to allow student to publish their work
# Add column make_public to table teams for storing user permission (published or not) for each project.
# Add controller for Sample submissions and implement corresponding methods.
# Add views for sample submissions
# Make changes to page student_task/view which would have link to sample submissions for each project.
# Add drop down in assignments/edit/_general view.
# Add controller code for the drop down.
# Add column sample_assignment_id to table assignment.
# Add test scripts for all the functionality.

== Current status of Development ==
All tasks mentioned in Project tasks are completed.

== Developed Code ==
1. Add checkbox against each assignment in student_tasks/list view to allow student to publish their work
<pre>
<% if !participant.team.nil? %>
<td align=center>
<input id="makeSubPublic" teamid="<%= participant.team.id %>" type="checkbox" onclick="publishConfirmation(this)" <% if participant.team.make_public %>checked<% end %>>
</td>
<% end %>
</pre>

2. Add column make_public to table teams for storing user permission (published or not) for each project.
<pre>
class AddSampleAssignmentToAssignments < ActiveRecord::Migration
def change
add_column :assignments, :sample_assignment_id, :integer, index: true
add_foreign_key :assignments, :assignments, column: :sample_assignment_id
end
end
</pre>
3. Add controller for Sample submissions and implement corresponding methods.
<pre>
# To give permission for making a submission available to others
def make_public
@team = Team.find(params[:id])
@team.make_public = params[:status]
@team.save
respond_to do |format|
format.html { head :no_content }
end
end
</pre>
4. Add views for sample submissions
<pre>

<h2>Sample Submissions for <%= @assignment.name%>:</h2>
<br>

<h3>Submissions made public by peers:</h3>
<% if @assignment_due_date==nil or @assignment_due_date>Time.new() %>
<br><i>Will be available once the assignment submission is completed</i>
<% elsif @assignment_teams==[] %>
<br><i>No sample submissions from current assignment made public yet</i>
<% else %>
<ul>
<% @assignment_teams.each do |assignment_team| %>
<% if assignment_team.hyperlinks != [] %>
<li>
<ul>
<h4>Team name : <%=assignment_team.name%></h4>
<% assignment_team.hyperlinks.each do |assignment_link| %>
<li><a href="<%=assignment_link%>"><%=assignment_link%></a></li>
<%end%>
</ul>
</li>
<%end%>
<% end%>
</ul>
<% end %>
<br>
<hr/>
<br>


<h3>Submissions made public by instructor:</h3>
<% if @assignment_teams_professor == [] %>
<br><i>No sample submissions from previous assignments made available yet</i>
<% else %>
<ul>
<% @assignment_teams_professor.each do |assignment_team| %>
<% if assignment_team.hyperlinks != [] %>
<ul>
<li>
<h4>Team name : <%=assignment_team.name%></h4>
<% assignment_team.hyperlinks.each do |assignment_link| %>
<li><a href="<%=assignment_link%>"><%=assignment_link%></a></li>
<%end%>
</li>
</ul>
<%end%>
<% end%>
</ul>
<% end %>
<br><br>

<a href="javascript:window.history.back()">Back</a>
</pre>
5. Make changes to page student_task/view which would have link to sample submissions for each project.
<pre>
<li>
<%= link_to "Sample Submissions", controller: 'sample_submissions', :action => 'index', :id => @assignment.id %>
(View sample work submitted by other participants/teams)
</li>
</pre>
6. Add drop down in assignments/edit/_general view.
<pre>

<tr>
<td style='padding:5px'><%= label_tag('assignment_form[assignment][sample_assignment_id]', 'Sample Assignment:') %>
<img src="/assets/info.png" title='- Select an assignment that students can refer sample submission from.'>
</td>
<td style='padding:5px'><%= select('assignment_form[assignment]', 'sample_assignment_id', sample_sub_options, :selected => @assignment_form.assignment.sample_assignment_id) %>
</td>
</tr>
</pre>
7. Add controller code for the drop down.
<pre>
def sample_sub_options
assignments = Assignment.all
options = []
assignments.each do |assignment|
course_name = ""
if assignment.course_id and assignment.course_id != 0 and !Course.find(assignment.course_id).nil?
course_name = Course.find(assignment.course_id).name
end
options << [course_name + '- ' + assignment.name, assignment.id]
end
options.uniq.sort
options.unshift(['-----------', nil])
end
</pre>
8. Add column sample_assignment_id to table assignment.
<pre>
class AddSampleAssignmentToAssignments < ActiveRecord::Migration
def change
add_column :assignments, :sample_assignment_id, :integer, index: true
add_foreign_key :assignments, :assignments, column: :sample_assignment_id
end
end
</pre>
9. Add test scripts for all the functionality.
<pre>
def create_assignment_team(assignment_name, parent_id)
assignment_team = AssignmentTeam.new
assignment_team.name = assignment_name
assignment_team.parent_id = parent_id
assignment_team.save!
end

def init_test
# create assignment and topic
assignment = build(Assignment)
course = Course.new
course.name = "SampleSubmissionTestCourse"
course.save
assignment.course_id = course.id
assignment.save

create_assignemnt_team("ss_assignment_team_1", assignment.id)
create_assignemnt_team("ss_assignment_team_2", assignment.id)
end

def visit_sample_submissions_page
visit '/student_task/list'
click_on "Example Assignment"
click_on "Sample Submissions"
end

describe "sample submission test" do
before(:each) { init_test }

it "is able to make an assignment public" do
visit '/student_task/list'
find(:css, "#makeSubPublic[teamid='6050']").trigger("click")
click_button 'OK'
expect(page).to have_http_status(200)
end

it "should not see current assignment submissions if deadline is not met" do # Set deadline after current time.
visit_sample_submissions_page
expect(page).to have_content "No sample submissions from current assignment made public yet"
end

it "should see current assignment submissions if deadline is met" do # Set deadline before current time.
visit_sample_submissions_page
expect(page).to_not have_content "No sample submissions from current assignment made public yet"
end

it "should not see instructor selected submissions if instructor has not selected them" do
visit_sample_submissions_page
expect(page).to have_content "No sample submissions from previous assignment made available yet"
end

it "should see instructor selected submissions if instructor has selected them" do # Instructor makes submission available.
visit_sample_submissions_page
expect(page).to_not have_content "No sample submissions from previous assignment made available yet"
end
end
</pre>

== Sample Submissions View ==

1. The first screenshot of the application is taken when the deadline for the current assignment has not crossed and the instructor also has not given any sample assignment for this assignment.

[[Image:Assignments not made public.PNG]]

2. The second screenshot of the application is taken when the deadline for the current assignment has not crossed but the instructor has selected a sample assignment for viewing against this assignment.

[[Image:Assignment submission date not passed.PNG]]

3. The third screenshot of the application is taken when both the deadline for the current assignment has crossed and the instructor has selected a sample assignment for viewing.

[[Image:Assignments available.PNG]]

== Test Plan ==

Many of our changes are reflected on views (user interface). So we build tests with rspec/capybara. Following is the list of tests that conduct:

# it "is able to make an assignment public"
# it "is able to view sample submissions page"
# it "should not see current assignment submissions if deadline is not met"
# it "should see current assignment submissions if deadline is met"
# it "should not see instructor selected submissions if instructor has not selected them"
# it "should see instructor selected submissions if instructor has selected them"

<pre>
def create_assignment_team(assignment_name, parent_id)
assignment_team = AssignmentTeam.new
assignment_team.name = assignment_name
assignment_team.parent_id = parent_id
assignment_team.save!
end

def init_test
# create assignment and topic
assignment = build(Assignment)
course = Course.new
course.name = "SampleSubmissionTestCourse"
course.save
assignment.course_id = course.id
assignment.save

create_assignemnt_team("ss_assignment_team_1", assignment.id)
create_assignemnt_team("ss_assignment_team_2", assignment.id)
end

def visit_sample_submissions_page
visit '/student_task/list'
click_on "Example Assignment"
click_on "Sample Submissions"
end

describe "sample submission test" do
before(:each) { init_test }

it "is able to make an assignment public" do
visit '/student_task/list'
find(:css, "#makeSubPublic[teamid='6050']").trigger("click")
click_button 'OK'
expect(page).to have_http_status(200)
end

it "should not see current assignment submissions if deadline is not met" do # Set deadline after current time.
visit_sample_submissions_page
expect(page).to have_content "No sample submissions from current assignment made public yet"
end

it "should see current assignment submissions if deadline is met" do # Set deadline before current time.
visit_sample_submissions_page
expect(page).to_not have_content "No sample submissions from current assignment made public yet"
end

it "should not see instructor selected submissions if instructor has not selected them" do
visit_sample_submissions_page
expect(page).to have_content "No sample submissions from previous assignment made available yet"
end

it "should see instructor selected submissions if instructor has selected them" do # Instructor makes submission available.
visit_sample_submissions_page
expect(page).to_not have_content "No sample submissions from previous assignment made available yet"
end
end
</pre>

== Future Scope ==
# Publishing sample reviews made by students: This feature will require students to allow their review to be published as a sample review. This can then be made available to future students.

== External Links ==
# link to forked repository [https://github.com/ashiskumar123/expertiza]
# link to the git pull request [https://github.com/expertiza/expertiza/pull/1169]
# link to the deployed application [http://ec2-13-59-7-94.us-east-2.compute.amazonaws.com:3000]

== References ==
# Link to expertiza website: [https://expertiza.ncsu.edu/]

E1867 allow reviewer to say review can be shown to class as an example

2018-11-14T03:20:20Z

Smadhur: /* Problem Statement */

== Introduction ==
[http://expertiza.ncsu.edu/ Expertiza] is a web based open source peer reviewing tool developed and maintained by current and past students of [https://en.wikipedia.org/wiki/North_Carolina_State_University North Carolina State University]. Peer review is a great way for a student to learn how to approach a project and get ideas for their own projects. Currently, there is no way for a student to view another student's work, unless they are reviewing the other student's work.

== Problem Statement ==
The objective of this project is to:
# Add a feature for students to make their reviews 'public', that is, allow other students to view them.
# Add a feature for TA to select a subset of 'public' reviews, and make those reviews visible as sample reviews of the particular assignment.
# Add a feature for Instructor to select a subset of 'public' reviews and make those reviews visible as sample reviews of any of his/her assignments in the course.
# Create a view where the student can see a list of sample reviews of the assignment and have a detailed view of each.
# Allow the student to toggle the visibility of a review he/she has submitted.

== Proposed Design ==
The proposed features will involve two kinds of users : Students and Instructors.
Students will use the application to make their submissions public and view published reviews.

[[File:Application Flow Student.png]]

Instructors will use the application to make submissions from a previous assignment available as sample submissions for a current assignment. Only those submissions will be visible which were previously made public by the students.

[[Image:Application Flow Instructor.png]]

== Project Tasks ==
The tasks that need to be completed as part of this project can be listed as follows:
# Add checkbox against each assignment in student_tasks/list view to allow student to publish their work
# Add column make_public to table teams for storing user permission (published or not) for each project.
# Add controller for Sample submissions and implement corresponding methods.
# Add views for sample submissions
# Make changes to page student_task/view which would have link to sample submissions for each project.
# Add drop down in assignments/edit/_general view.
# Add controller code for the drop down.
# Add column sample_assignment_id to table assignment.
# Add test scripts for all the functionality.

== Current status of Development ==
All tasks mentioned in Project tasks are completed.

== Developed Code ==
1. Add checkbox against each assignment in student_tasks/list view to allow student to publish their work
<pre>
<% if !participant.team.nil? %>
<td align=center>
<input id="makeSubPublic" teamid="<%= participant.team.id %>" type="checkbox" onclick="publishConfirmation(this)" <% if participant.team.make_public %>checked<% end %>>
</td>
<% end %>
</pre>

2. Add column make_public to table teams for storing user permission (published or not) for each project.
<pre>
class AddSampleAssignmentToAssignments < ActiveRecord::Migration
def change
add_column :assignments, :sample_assignment_id, :integer, index: true
add_foreign_key :assignments, :assignments, column: :sample_assignment_id
end
end
</pre>
3. Add controller for Sample submissions and implement corresponding methods.
<pre>
# To give permission for making a submission available to others
def make_public
@team = Team.find(params[:id])
@team.make_public = params[:status]
@team.save
respond_to do |format|
format.html { head :no_content }
end
end
</pre>
4. Add views for sample submissions
<pre>

<h2>Sample Submissions for <%= @assignment.name%>:</h2>
<br>

<h3>Submissions made public by peers:</h3>
<% if @assignment_due_date==nil or @assignment_due_date>Time.new() %>
<br><i>Will be available once the assignment submission is completed</i>
<% elsif @assignment_teams==[] %>
<br><i>No sample submissions from current assignment made public yet</i>
<% else %>
<ul>
<% @assignment_teams.each do |assignment_team| %>
<% if assignment_team.hyperlinks != [] %>
<li>
<ul>
<h4>Team name : <%=assignment_team.name%></h4>
<% assignment_team.hyperlinks.each do |assignment_link| %>
<li><a href="<%=assignment_link%>"><%=assignment_link%></a></li>
<%end%>
</ul>
</li>
<%end%>
<% end%>
</ul>
<% end %>
<br>
<hr/>
<br>


<h3>Submissions made public by instructor:</h3>
<% if @assignment_teams_professor == [] %>
<br><i>No sample submissions from previous assignments made available yet</i>
<% else %>
<ul>
<% @assignment_teams_professor.each do |assignment_team| %>
<% if assignment_team.hyperlinks != [] %>
<ul>
<li>
<h4>Team name : <%=assignment_team.name%></h4>
<% assignment_team.hyperlinks.each do |assignment_link| %>
<li><a href="<%=assignment_link%>"><%=assignment_link%></a></li>
<%end%>
</li>
</ul>
<%end%>
<% end%>
</ul>
<% end %>
<br><br>

<a href="javascript:window.history.back()">Back</a>
</pre>
5. Make changes to page student_task/view which would have link to sample submissions for each project.
<pre>
<li>
<%= link_to "Sample Submissions", controller: 'sample_submissions', :action => 'index', :id => @assignment.id %>
(View sample work submitted by other participants/teams)
</li>
</pre>
6. Add drop down in assignments/edit/_general view.
<pre>

<tr>
<td style='padding:5px'><%= label_tag('assignment_form[assignment][sample_assignment_id]', 'Sample Assignment:') %>
<img src="/assets/info.png" title='- Select an assignment that students can refer sample submission from.'>
</td>
<td style='padding:5px'><%= select('assignment_form[assignment]', 'sample_assignment_id', sample_sub_options, :selected => @assignment_form.assignment.sample_assignment_id) %>
</td>
</tr>
</pre>
7. Add controller code for the drop down.
<pre>
def sample_sub_options
assignments = Assignment.all
options = []
assignments.each do |assignment|
course_name = ""
if assignment.course_id and assignment.course_id != 0 and !Course.find(assignment.course_id).nil?
course_name = Course.find(assignment.course_id).name
end
options << [course_name + '- ' + assignment.name, assignment.id]
end
options.uniq.sort
options.unshift(['-----------', nil])
end
</pre>
8. Add column sample_assignment_id to table assignment.
<pre>
class AddSampleAssignmentToAssignments < ActiveRecord::Migration
def change
add_column :assignments, :sample_assignment_id, :integer, index: true
add_foreign_key :assignments, :assignments, column: :sample_assignment_id
end
end
</pre>
9. Add test scripts for all the functionality.
<pre>
def create_assignment_team(assignment_name, parent_id)
assignment_team = AssignmentTeam.new
assignment_team.name = assignment_name
assignment_team.parent_id = parent_id
assignment_team.save!
end

def init_test
# create assignment and topic
assignment = build(Assignment)
course = Course.new
course.name = "SampleSubmissionTestCourse"
course.save
assignment.course_id = course.id
assignment.save

create_assignemnt_team("ss_assignment_team_1", assignment.id)
create_assignemnt_team("ss_assignment_team_2", assignment.id)
end

def visit_sample_submissions_page
visit '/student_task/list'
click_on "Example Assignment"
click_on "Sample Submissions"
end

describe "sample submission test" do
before(:each) { init_test }

it "is able to make an assignment public" do
visit '/student_task/list'
find(:css, "#makeSubPublic[teamid='6050']").trigger("click")
click_button 'OK'
expect(page).to have_http_status(200)
end

it "should not see current assignment submissions if deadline is not met" do # Set deadline after current time.
visit_sample_submissions_page
expect(page).to have_content "No sample submissions from current assignment made public yet"
end

it "should see current assignment submissions if deadline is met" do # Set deadline before current time.
visit_sample_submissions_page
expect(page).to_not have_content "No sample submissions from current assignment made public yet"
end

it "should not see instructor selected submissions if instructor has not selected them" do
visit_sample_submissions_page
expect(page).to have_content "No sample submissions from previous assignment made available yet"
end

it "should see instructor selected submissions if instructor has selected them" do # Instructor makes submission available.
visit_sample_submissions_page
expect(page).to_not have_content "No sample submissions from previous assignment made available yet"
end
end
</pre>

== Sample Submissions View ==

1. The first screenshot of the application is taken when the deadline for the current assignment has not crossed and the instructor also has not given any sample assignment for this assignment.

[[Image:Assignments not made public.PNG]]

2. The second screenshot of the application is taken when the deadline for the current assignment has not crossed but the instructor has selected a sample assignment for viewing against this assignment.

[[Image:Assignment submission date not passed.PNG]]

3. The third screenshot of the application is taken when both the deadline for the current assignment has crossed and the instructor has selected a sample assignment for viewing.

[[Image:Assignments available.PNG]]

== Test Plan ==

Many of our changes are reflected on views (user interface). So we build tests with rspec/capybara. Following is the list of tests that conduct:

# it "is able to make an assignment public"
# it "is able to view sample submissions page"
# it "should not see current assignment submissions if deadline is not met"
# it "should see current assignment submissions if deadline is met"
# it "should not see instructor selected submissions if instructor has not selected them"
# it "should see instructor selected submissions if instructor has selected them"

<pre>
def create_assignment_team(assignment_name, parent_id)
assignment_team = AssignmentTeam.new
assignment_team.name = assignment_name
assignment_team.parent_id = parent_id
assignment_team.save!
end

def init_test
# create assignment and topic
assignment = build(Assignment)
course = Course.new
course.name = "SampleSubmissionTestCourse"
course.save
assignment.course_id = course.id
assignment.save

create_assignemnt_team("ss_assignment_team_1", assignment.id)
create_assignemnt_team("ss_assignment_team_2", assignment.id)
end

def visit_sample_submissions_page
visit '/student_task/list'
click_on "Example Assignment"
click_on "Sample Submissions"
end

describe "sample submission test" do
before(:each) { init_test }

it "is able to make an assignment public" do
visit '/student_task/list'
find(:css, "#makeSubPublic[teamid='6050']").trigger("click")
click_button 'OK'
expect(page).to have_http_status(200)
end

it "should not see current assignment submissions if deadline is not met" do # Set deadline after current time.
visit_sample_submissions_page
expect(page).to have_content "No sample submissions from current assignment made public yet"
end

it "should see current assignment submissions if deadline is met" do # Set deadline before current time.
visit_sample_submissions_page
expect(page).to_not have_content "No sample submissions from current assignment made public yet"
end

it "should not see instructor selected submissions if instructor has not selected them" do
visit_sample_submissions_page
expect(page).to have_content "No sample submissions from previous assignment made available yet"
end

it "should see instructor selected submissions if instructor has selected them" do # Instructor makes submission available.
visit_sample_submissions_page
expect(page).to_not have_content "No sample submissions from previous assignment made available yet"
end
end
</pre>

== Future Scope ==
# Publishing sample reviews made by students: This feature will require students to allow their review to be published as a sample review. This can then be made available to future students.

== External Links ==
# link to forked repository [https://github.com/ashiskumar123/expertiza]
# link to the git pull request [https://github.com/expertiza/expertiza/pull/1169]
# link to the deployed application [http://ec2-13-59-7-94.us-east-2.compute.amazonaws.com:3000]

== References ==
# Link to expertiza website: [https://expertiza.ncsu.edu/]