Skip to content

Conversation

@qimcis
Copy link
Collaborator

@qimcis qimcis commented Jan 18, 2026

Description

Add the CS350 Fall 2018 Midterm exam dataset and associated solution file to the course exam benchmark.

Changes

  • Add exam directory at /home/qi/system-intelligence-benchmark/benchmarks/courseexam_bench/data/raw/cs350_fall_2018_midterm
  • Include solutions file F18-midterm-sol.pdf in the exam directory
  • Add exam metadata with ID cs350_fall_2018_midterm and note that there are no reference files

Testing

Prepared the dataset and verified processing by running: python3 courseexam/prepare.py

Checklist

  • Tests pass locally
  • Code follows project style guidelines
  • Documentation updated (if needed)

Copy link
Collaborator

@777lefty 777lefty left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some missing issues and format issues


## Question 2 [3 point(s)]

Explain why the following implementation of semaphore P is incorrect. Provide an example interaction between two threads that illustrates the problem.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The code snippet for this question seems to be totally missed

n /= d;
printf("%d\n", d);
return 0;
}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Better use table and code block to wrap them


## Question 7 [2 point(s)]

What concurrency problem does this program suffer from?
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code snippet provided in the background for all the subproblems of the problem is missed

```

---

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Question 3 is skipped, but it seems to be feasible because it doesn't contain figure, and we can ask the agents to output table to represent stack


---

## Question 10 [2 point(s)]
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Background information for all subproblems in problem 4 is missed

copy trapframe to stack
modify trapframe
enter usermode
}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

code block better?

```

---

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Question 5 is skipped, seems to be feasible as well


---

## Question 15 [3 point(s)]
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Background information for Question 6 is missed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants