# tinker_cookbook.eval.SamplingClientEvaluator

## _class_ [**tinker_cookbook.eval.SamplingClientEvaluator**](https://github.com/thinking-machines-lab/tinker-cookbook/blob/main/tinker_cookbook/eval/evaluators.py#L35)()

An evaluator that uses a SamplingClient to compute metrics (e.g., accuracy).

```python
class AccuracyEval(SamplingClientEvaluator):
    async def __call__(self, sampling_client):
        acc = await measure_accuracy(sampling_client, self.test_set)
        return {"eval/accuracy": acc}
```

### [**__call__**](https://github.com/thinking-machines-lab/tinker-cookbook/blob/main/tinker_cookbook/eval/evaluators.py#L46)( _sampling_client_)

Run evaluation and return a dict of metric names to values.

**Parameters:**

- [**sampling_client**](https://github.com/thinking-machines-lab/tinker-cookbook/blob/main/tinker_cookbook/eval/evaluators.py#L46) ( _tinker. [SamplingClient](https://tinker-docs.thinkingmachines.ai/tinker/api-reference/samplingclient/)_) – The Tinker sampling client to evaluate with.

**Returns:** A dict mapping metric names to float values.