# composer.datasets.evaluator#

Specifies an instance of an Evaluator, which wraps a dataloader to include metrics that apply to a specific dataset.

Hparams

These classes are used with yahp for YAML-based configuration.

 EvaluatorHparams Params for the Evaluator.
class composer.datasets.evaluator.EvaluatorHparams(label, eval_dataset, eval_interval=None, subset_num_batches=None, metric_names=None)[source]#

Params for the Evaluator.

Also see the documentation for the Evaluator.

Parameters

Initialize an Evaluator

If the Evaluator metric_names is empty or None is provided, the function returns a copy of all the model’s default evaluation metrics.

Parameters
• model (ComposerModel) – The model, which is used to retrieve metric names.

• batch_size (int) – The device batch size to use for the evaluation dataset.