IExperimentRunEvaluator TCase,TOutput

NexusLabs.Foundry.Evaluation

NexusLabs.Foundry.Evaluation.Experiments

IExperimentRunEvaluator<TCase,TOutput> Interface

Measures a complete ordered experiment run.

public interface IExperimentRunEvaluator<TCase,TOutput>

Type parameters

TCase

The caller-owned case value type.

TOutput

The caller-owned output type.

Derived
↳ ExperimentRunEvaluator<TCase,TOutput>

Properties

IExperimentRunEvaluator<TCase,TOutput>.Name Property

Gets the stable evaluator name.

string Name { get; }

Property Value

System.String

Methods

IExperimentRunEvaluator<TCase,TOutput>.EvaluateAsync(ExperimentRunEvaluationContext<TCase,TOutput>, CancellationToken) Method

Evaluates every ordered item in the run.

System.Threading.Tasks.ValueTask<Microsoft.Extensions.AI.Evaluation.EvaluationResult> EvaluateAsync(NexusLabs.Foundry.Evaluation.Experiments.ExperimentRunEvaluationContext<TCase,TOutput> context, System.Threading.CancellationToken cancellationToken);

Parameters

context NexusLabs.Foundry.Evaluation.Experiments.ExperimentRunEvaluationContext<TCase,TOutput>

The complete ordered run context.

cancellationToken System.Threading.CancellationToken

The caller cancellation token.

Returns

System.Threading.Tasks.ValueTask<Microsoft.Extensions.AI.Evaluation.EvaluationResult>
The run-level MEAI evaluation result.