Computer algebra, compared

math.osp.no compares computer algebra systems on a large suite of problems with known answers: integrals, differential equations, sums, recurrences, limits, series, transforms, equations, simplification, polynomials, linear algebra and special functions. Anyone may run the suite on a system, upload its answers, and see them graded next to the others'.

math.osp.no is edited by the editor of samara, one of the systems compared. The suite is generated by samara, and the answers are graded by samara's checker, samara's own like everyone else's. Every problem, every public answer and every grade is shown, and the checker's output can be downloaded, to verify a grade.

How it works

1. Download the suite, or its quick subset, and the runner of your system. Each problem is built from a known answer, by a number of rewriting steps, which give its level: textbook, medium or gnarly.
2. Run it. The runner times each problem, and first a fixed calibration subset, so that the times of different machines compare.
3. Register with your email, and upload the answers, by the web form or by the runner, with your upload token.
4. The answers are graded by our checker: solved, unsolved, wrong, timeout or error. The upload says nothing of grades.
5. Browse the problems, with every system's answer, and the systems, with their versions and runs.

Now

The first version of the suite is not published yet.

Registration is open to everyone, also for systems not listed yet. The email address is kept private, and is there so that we can get in touch; the answers you upload are shown publicly.