Score Calculation - Revision history

Admin: /* Layer 2: ResponseMap (Round Weights) */

2026-07-07T00:36:24Z

Layer 2: ResponseMap (Round Weights)

← Older revision		Revision as of 00:36, 7 July 2026
Line 11:		Line 11:
	== Layer 2: ResponseMap (Round Weights) ==		== Layer 2: ResponseMap (Round Weights) ==

	<code>ResponseMap#review_grade</code> ~~normalises~~ each round's score (<code>aggregate_questionnaire_score / maximum_score</code>) and computes a weighted average across rounds using <code>AssignmentQuestionnaire#questionnaire_weight</code>.		<code>ResponseMap#review_grade</code> normalizes each round's score (<code>aggregate_questionnaire_score / maximum_score</code>) and computes a weighted average across rounds using <code>AssignmentQuestionnaire#questionnaire_weight</code>.

	Only the latest submitted response per round is used. Rounds with no submitted response are excluded from both the numerator and denominator.		Only the latest submitted response per round is used. Rounds with no submitted response are excluded from both the numerator and denominator.

Admin: /* Layer 1: Response (Item Weights) */

2026-07-07T00:35:22Z

Layer 1: Response (Item Weights)

← Older revision		Revision as of 00:35, 7 July 2026
Line 5:		Line 5:
	== Layer 1: Response (Item Weights) ==		== Layer 1: Response (Item Weights) ==

	<code>Response#aggregate_questionnaire_score</code> sums <code>answer * item.weight</code> for all answered, scored items in a single submitted review. Section header items are excluded (they carry no weight).		<code>Response#aggregate_questionnaire_score</code> sums <code>answer * item.weight</code> for all answered, scored items in a single submitted review. Section-header items, text-area items, etc., are excluded (they carry no weight).

	<code>Response#maximum_score</code> computes the maximum possible score for the same set of answered items: <code>sum(item.weight) * questionnaire.max_question_score</code>.		<code>Response#maximum_score</code> computes the maximum possible score for the same set of answered items: <code>sum(item.weight) * questionnaire.max_question_score</code>.

Blalu: /* Score Calculation */

2026-07-07T00:34:02Z

Score Calculation

← Older revision		Revision as of 00:34, 7 July 2026
Line 1:		Line 1:
	= Score Calculation =		= Score Calculation =

	Peer review grades in Expertiza are computed in three models~~, each handled by a separate model~~.		Peer review grades in Expertiza are computed in three models.

	== Layer 1: Response (Item Weights) ==		== Layer 1: Response (Item Weights) ==

Blalu: /* Score Calculation */

2026-07-07T00:33:41Z

Score Calculation

← Older revision		Revision as of 00:33, 7 July 2026
Line 1:		Line 1:
	= Score Calculation =		= Score Calculation =

	Peer review grades in Expertiza are computed in three ~~layers~~, each handled by a separate model.		Peer review grades in Expertiza are computed in three models, each handled by a separate model.

	== Layer 1: Response (Item Weights) ==		== Layer 1: Response (Item Weights) ==

Blalu: Created page with "= Score Calculation = Peer review grades in Expertiza are computed in three layers, each handled by a separate model. == Layer 1: Response (Item Weights) == `Response#aggregate_questionnaire_score` sums `answer * item.weight` for all answered, scored items in a single submitted review. Section header items are excluded (they carry no weight). `Response#maximum_score` computes the maximum possible score for the same set of answered ite..."

2026-07-03T17:03:29Z

Created page with "= Score Calculation = Peer review grades in Expertiza are computed in three layers, each handled by a separate model. == Layer 1: Response (Item Weights) == <code>Response#aggregate_questionnaire_score</code> sums <code>answer * item.weight</code> for all answered, scored items in a single submitted review. Section header items are excluded (they carry no weight). <code>Response#maximum_score</code> computes the maximum possible score for the same set of answered ite..."

New page

= Score Calculation =

Peer review grades in Expertiza are computed in three layers, each handled by a separate model.

== Layer 1: Response (Item Weights) ==

<code>Response#aggregate_questionnaire_score</code> sums <code>answer * item.weight</code> for all answered, scored items in a single submitted review. Section header items are excluded (they carry no weight).

<code>Response#maximum_score</code> computes the maximum possible score for the same set of answered items: <code>sum(item.weight) * questionnaire.max_question_score</code>.

== Layer 2: ResponseMap (Round Weights) ==

<code>ResponseMap#review_grade</code> normalises each round's score (<code>aggregate_questionnaire_score / maximum_score</code>) and computes a weighted average across rounds using <code>AssignmentQuestionnaire#questionnaire_weight</code>.

Only the latest submitted response per round is used. Rounds with no submitted response are excluded from both the numerator and denominator.

== Layer 3: AssignmentTeam (Reviewer Reputation) ==

<code>AssignmentTeam#aggregate_reviewer_score</code> averages <code>ResponseMap#review_grade</code> across all reviewers of the team, weighted by each reviewer's reputation score (currently defaulting to 1.0 — placeholder for future Uchswas integration).

The same computation is used by <code>AssignmentParticipant#aggregate_teammate_review_grade</code> for teammate reviews.

== Validation ==

<code>AssignmentQuestionnaire</code> validates that <code>questionnaire_weight</code> is 0 when the linked rubric contains no scored items (only <code>SectionHeader</code> items), since a non-zero weight on an unscored rubric would produce meaningless grades.