MeaiReportingExperimentExtensions

NexusLabs.Foundry.Evaluation.Reporting

MeaiReportingExperimentExtensions Class

Adds coordinated MEAI Reporting lifecycle and evaluation to provider-neutral experiments.

public static class MeaiReportingExperimentExtensions

Inheritance System.Object 🡒 MeaiReportingExperimentExtensions

Methods

MeaiReportingExperimentExtensions.WithMeaiReporting<TCase,TOutput>(this ExperimentDefinition<TCase,TOutput>, ReportingConfiguration, MeaiReportingEvaluationInputFactory<TCase,TOutput>, MeaiReportingExperimentOptions<TCase,TOutput>) Method

Adds one MEAI Reporting scenario per statistical trial and occupies the definition's single item-evaluator slot.

public static NexusLabs.Foundry.Evaluation.Experiments.ExperimentDefinition<TCase,TOutput> WithMeaiReporting<TCase,TOutput>(this NexusLabs.Foundry.Evaluation.Experiments.ExperimentDefinition<TCase,TOutput> definition, Microsoft.Extensions.AI.Evaluation.Reporting.ReportingConfiguration configuration, NexusLabs.Foundry.Evaluation.Reporting.MeaiReportingEvaluationInputFactory<TCase,TOutput> inputFactory, NexusLabs.Foundry.Evaluation.Reporting.MeaiReportingExperimentOptions<TCase,TOutput> options);

Type parameters

TCase

The caller-owned case value type.

TOutput

The caller-owned output type.

Parameters

definition NexusLabs.Foundry.Evaluation.Experiments.ExperimentDefinition<TCase,TOutput>

The experiment definition to copy and configure.

configuration Microsoft.Extensions.AI.Evaluation.Reporting.ReportingConfiguration

The Reporting configuration whose execution name must match the Foundry run ID.

inputFactory NexusLabs.Foundry.Evaluation.Reporting.MeaiReportingEvaluationInputFactory<TCase,TOutput>

The projection from a terminal successful output to MEAI messages and model response.

options NexusLabs.Foundry.Evaluation.Reporting.MeaiReportingExperimentOptions<TCase,TOutput>

The required response reuse and publication behavior.

Returns

NexusLabs.Foundry.Evaluation.Experiments.ExperimentDefinition<TCase,TOutput>
A copy of definition with the coordinated Reporting scope and evaluator.

Exceptions

System.ArgumentNullException
definition, configuration, inputFactory, or options is null.

System.ArgumentException
The Reporting configuration is inconsistent with the selected response reuse mode.

System.InvalidOperationException
The definition already has an item evaluator or MEAI Reporting item scope.

System.ArgumentOutOfRangeException
The configured response reuse or item-scope failure mode is undefined.