ExperimentRunEvaluator TCase,TOutput

NexusLabs.Foundry.Evaluation ¶

NexusLabs.Foundry.Evaluation.Experiments ¶

ExperimentRunEvaluator<TCase,TOutput> Class¶

Adapts a named run-evaluation delegate to IExperimentRunEvaluator<TCase,TOutput>.

public sealed class ExperimentRunEvaluator<TCase,TOutput> : NexusLabs.Foundry.Evaluation.Experiments.IExperimentRunEvaluator<TCase, TOutput>

Type parameters¶

TCase

The caller-owned case value type.

TOutput

The caller-owned output type.

Inheritance System.Object 🡒 ExperimentRunEvaluator\<TCase,TOutput>

Implements NexusLabs.Foundry.Evaluation.Experiments.IExperimentRunEvaluator<TCase ,TOutput >

Constructors¶

ExperimentRunEvaluator(string, ExperimentRunEvaluationHandler<TCase,TOutput>) Constructor¶

Initializes a named run evaluator.

public ExperimentRunEvaluator(string name, NexusLabs.Foundry.Evaluation.Experiments.ExperimentRunEvaluationHandler<TCase,TOutput> handler);

Parameters¶

name System.String

The stable evaluator name.

handler NexusLabs.Foundry.Evaluation.Experiments.ExperimentRunEvaluationHandler<TCase ,TOutput >

The evaluation handler.

Properties¶

ExperimentRunEvaluator<TCase,TOutput>.Name Property¶

Gets the stable evaluator name.

public string Name { get; }

Implements Name

Property Value¶

System.String

Methods¶

ExperimentRunEvaluator<TCase,TOutput>.EvaluateAsync(ExperimentRunEvaluationContext<TCase,TOutput>, CancellationToken) Method¶

Evaluates every ordered item in the run.

public System.Threading.Tasks.ValueTask<Microsoft.Extensions.AI.Evaluation.EvaluationResult> EvaluateAsync(NexusLabs.Foundry.Evaluation.Experiments.ExperimentRunEvaluationContext<TCase,TOutput> context, System.Threading.CancellationToken cancellationToken);