Problem Profiles Report

The problem profile allows the user to view the details of a problem or a specific step within a problem and helps provide important context for the rest of the reports.

Each feature is listed out below, but to summarize, we've presented a value / difficulty matrix here to summarize each feature. Details are provided under each feature below.

Summary Listing



On the summary page, there would be a listing of problems and their problem text, as well as the students performance on each problem in the dataset. The user would be able to see at a glance, where the highlight areas are in the performance. The user can also switch from the summary to a specific problem on the controls list on the left, or get into a specific problem by directly selecting them in the list. Our user tests affirmed that that the problems profile summary page was useful in helping provide the users information to help understand the other reports. (U27_TA02, U30_TA02)

Importance: High
Difficulty: Low

Problem and Step Breakdown



Upon selecting a problem, the user would be able to see the data directly relevant to a problem, and would also be able to see a quick listing of all the steps within the problems and an overview of the students' performance on those steps. The user can select these steps to display the step breakdowns that would contain the detailed information, such as problem text, expected answer for the step, and number of attempts at this step.

Importance: High
Difficulty: dependent on how much context is brought into the problem/steps breakdowns)

Future

This report was an area of discussion during our final presentation. Our proposal for this report was based on what we assessed what our client suggested was implementable and expected future users to provide feedback (during later use) as to whether there was more information needed. We were attempting to balance our cultural impressions of the organization with the needs uncovered in our Contextual Inquiries. When we were introduced at a PSLC luncheon one of the members said something to the effect of: "I'm excited to see what you come up with. Don't make me do anything different."

Some of the suggestions made during the presentations for this report as well as how tutor systems can be modified to support integration with the DataShop are as follows:-