EvalError - Tinker Documentation
tinker_cookbook.exceptions.EvalError
class tinker_cookbook.exceptions.EvalError( TinkerCookbookError, RuntimeError)
An error during benchmark evaluation.
Base class for eval-related errors. Inherits from RuntimeError because eval errors are operational failures (network, timeout, sandbox) rather than configuration issues.
Eval errors are non-fatal by default: the benchmark runner catches them per-example, records them as scored failures (reward=0), and continues with remaining examples. The error details are preserved in StoredTrajectory.error for post-hoc analysis.