Skip to content
This repository was archived by the owner on Jan 10, 2023. It is now read-only.

Buggy output tests currently take into account the output for all tasks, whereas they should only consider the output for the task they're defined in. #633

@seanlip

Description

@seanlip

Suppose a question has two tasks, task1 and task2. If a student's code matches a reference buggy-output code for all test suites in task1, but not all test suites in task2, then the code is deemed not to match the buggy-output code in general, and will not get the targeted feedback in task1.

This is incorrect behaviour. The "matches buggy-output" criterion should only consider the code from the given task.

(This bug was discovered as part of the audit of the ConversationManagerService integration tests in #632.)

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions