ensure_evaluator

composer.core.ensure_evaluator(evaluator, default_metric_names)

Ensure that evaluator is an Evaluator.

Parameters

• evaluator (Evaluator | DataSpec | Iterable | dict[str, Any]) – A dataloader, DataSpec instance, dictionary of DataSpec kwargs, or existing evaluator.

• default_metric_names (list[str]) – The names of the metrics for the evaluator, if a dataloader was specified.

Returns

Evaluator – An evaluator.