ExperimentItemEvaluator TCase,TOutput (ExperimentItemEvaluationContext TCase,TOutput ,CancellationToken)

NexusLabs.Foundry.Evaluation

NexusLabs.Foundry.Evaluation.Experiments

ExperimentItemEvaluator<TCase,TOutput>(ExperimentItemEvaluationContext<TCase,TOutput>, CancellationToken) Delegate

Evaluates one terminal successful experiment item exactly once.

public delegate System.Threading.Tasks.ValueTask<Microsoft.Extensions.AI.Evaluation.EvaluationResult> ExperimentItemEvaluator<TCase,TOutput>(NexusLabs.Foundry.Evaluation.Experiments.ExperimentItemEvaluationContext<TCase,TOutput> context, System.Threading.CancellationToken cancellationToken);

Type parameters

TCase

The caller-owned case value type.

TOutput

The caller-owned output type.

Parameters

context NexusLabs.Foundry.Evaluation.Experiments.ExperimentItemEvaluationContext<TCase,TOutput>

The case, trial, output, and attempt history.

cancellationToken System.Threading.CancellationToken

The caller cancellation token.

Returns

System.Threading.Tasks.ValueTask<Microsoft.Extensions.AI.Evaluation.EvaluationResult>
The MEAI evaluation result.