IExperimentRunner
NexusLabs.Foundry.Evaluation¶
NexusLabs.Foundry.Evaluation.Experiments¶
IExperimentRunner Interface¶
Runs finite provider-neutral experiments with bounded task concurrency.
Derived
↳ ExperimentRunner
Methods¶
IExperimentRunner.RunAsync<TCase,TOutput>(ExperimentDefinition<TCase,TOutput>, ExperimentRunOptions) Method¶
Materializes, validates, expands, and executes one experiment without caller cancellation.
System.Threading.Tasks.Task<NexusLabs.Foundry.Evaluation.Experiments.ExperimentRunOutcome<TCase,TOutput>> RunAsync<TCase,TOutput>(NexusLabs.Foundry.Evaluation.Experiments.ExperimentDefinition<TCase,TOutput> definition, NexusLabs.Foundry.Evaluation.Experiments.ExperimentRunOptions options);
Type parameters¶
TCase
The caller-owned case value type.
TOutput
The caller-owned output type.
Parameters¶
definition NexusLabs.Foundry.Evaluation.Experiments.ExperimentDefinition<TCase,TOutput>
The experiment definition.
options ExperimentRunOptions
The run options.
Returns¶
System.Threading.Tasks.Task<NexusLabs.Foundry.Evaluation.Experiments.ExperimentRunOutcome<TCase,TOutput>>
The canonical quality result plus independent publication outcomes.
IExperimentRunner.RunAsync<TCase,TOutput>(ExperimentDefinition<TCase,TOutput>, ExperimentRunOptions, CancellationToken) Method¶
Materializes, validates, expands, and executes one experiment with caller cancellation.
System.Threading.Tasks.Task<NexusLabs.Foundry.Evaluation.Experiments.ExperimentRunOutcome<TCase,TOutput>> RunAsync<TCase,TOutput>(NexusLabs.Foundry.Evaluation.Experiments.ExperimentDefinition<TCase,TOutput> definition, NexusLabs.Foundry.Evaluation.Experiments.ExperimentRunOptions options, System.Threading.CancellationToken cancellationToken);
Type parameters¶
TCase
The caller-owned case value type.
TOutput
The caller-owned output type.
Parameters¶
definition NexusLabs.Foundry.Evaluation.Experiments.ExperimentDefinition<TCase,TOutput>
The experiment definition.
options ExperimentRunOptions
The run options.
cancellationToken System.Threading.CancellationToken
A caller cancellation token.
Returns¶
System.Threading.Tasks.Task<NexusLabs.Foundry.Evaluation.Experiments.ExperimentRunOutcome<TCase,TOutput>>
The canonical quality result plus independent publication outcomes.