Reply To: Rules Accreditation – Test Reform

September 25, 2024 at 2:03 am #5908
Holly
Participant

I completely agree with this. To be clear, I’m not suggesting that we avoid being tested on the rules, but it’s important that the test actually assesses rule comprehension, rather than just a person’s ability to navigate complex English. The focus should be on how well players understand and can apply the rules, not how well they can decipher tricky wording.

Current areas of concern

Confusing Wording and Complexity

Many questions in the quiz rely on highly specific wording and minor details, which test reading comprehension more than actual understanding of the rules.The use of True/False questions, especially when they hinge on very subtle differences, makes it easy to misinterpret or be “tripped up” by small changes in phrasing.

Lack of Visual/Contextual Clarity

The quiz relies heavily on written descriptions of plays, which can be hard to follow or visualise. For players unfamiliar with certain scenarios, it’s difficult to picture the exact sequence of events being described, making it harder to answer accurately.

Barrier for Less Experienced Players

Players with less experience, especially those in Division II, may struggle with the current quiz format, as it assumes a deep familiarity with the rules and nuances of play. The quiz becomes a significant barrier for players with limited exposure to the game or who have not fully developed rule comprehension, especially when open-book access still leaves them confused.

Limited Engagement

The quiz lacks interactivity and doesn’t engage users beyond simple question-answer mechanics. There is no feedback loop to explain why an answer was correct or incorrect, which leaves learners without a clear understanding of their mistakes.

Suggestions for Improvement

Use of Visuals and Videos

Replace or complement text-based questions with diagrams, images, or videos of actual game scenarios. For example:
Show a short video clip of a player catching the disc near the sideline, then ask a follow-up question about whether they established possession.

Provide images that highlight field positions, asking players to determine if a rule has been violated based on a clear visual.

Why it helps: This approach helps test comprehension of rules in context, making it easier for players to visualise real-game scenarios and apply the rules to what they’re seeing.

Multiple-Choice Format with Context

Instead of relying on True/False questions, use multiple-choice options that test understanding without leaving players guessing about small details.

For example:
A question might describe a scenario and then present 3-4 options that include different ways the play could resolve according to the rules. This encourages deeper thinking and avoids the issue of trick questions.

Why it helps: Multiple-choice questions offer a clearer structure and ensure that players aren’t misled by confusing language. It also provides more nuanced scenarios with explanations as feedback.

Clear and Simple Wording

Simplify the wording of questions to ensure that players are being tested on rule comprehension, not their ability to understand complex sentences.

Avoid adding extra definitions or over-explaining minor details that confuse rather than clarify.

Why it helps: Straightforward language makes it easier for players to focus on the rule being tested without feeling overwhelmed by convoluted phrasing.

Adaptive Feedback for Learners

Provide feedback after each question that explains why the correct answer is correct and why the other options are wrong. This helps players learn from mistakes rather than just guessing.

Why it helps: Immediate feedback reinforces learning by helping players understand what they got wrong and why. This is especially useful for players new to the sport or unfamiliar with advanced rule applications.