Skip to content

ExperimentPairedComparisonEvidence

NexusLabs.Foundry.Evaluation

NexusLabs.Foundry.Evaluation.Experiments

ExperimentPairedComparisonEvidence Class

Creates paired X-minus-Y comparison evidence for binary and continuous case-level analyses.

public static class ExperimentPairedComparisonEvidence

Inheritance System.Object 🡒 ExperimentPairedComparisonEvidence

Methods

ExperimentPairedComparisonEvidence.CreateBinary(string, string, IReadOnlyList<ExperimentPairedBinaryCaseOutcome>, ExperimentUnknownSampleTreatment, double) Method

Creates paired binary evidence using the X-minus-Y orientation from the supplied case pairs.

public static NexusLabs.Foundry.Evaluation.Experiments.ExperimentPairedBinaryComparisonEvidence CreateBinary(string xLabel, string yLabel, System.Collections.Generic.IReadOnlyList<NexusLabs.Foundry.Evaluation.Experiments.ExperimentPairedBinaryCaseOutcome> cases, NexusLabs.Foundry.Evaluation.Experiments.ExperimentUnknownSampleTreatment unknownSampleTreatment, double confidenceLevel);

Parameters

xLabel System.String

The stable label for arm X.

yLabel System.String

The stable label for arm Y.

cases System.Collections.Generic.IReadOnlyList<ExperimentPairedBinaryCaseOutcome>

The paired case outcomes to analyze.

unknownSampleTreatment ExperimentUnknownSampleTreatment

The treatment for comparable case pairs whose binary outcome is unscorable for one or both arms.

confidenceLevel System.Double

The two-sided interval confidence level.

Returns

ExperimentPairedBinaryComparisonEvidence
Validated paired binary comparison evidence.

ExperimentPairedComparisonEvidence.CreateContinuous(string, string, IReadOnlyList<ExperimentPairedContinuousCaseMeasurement>, ulong, double) Method

Creates paired continuous evidence using the X-minus-Y orientation from the supplied case pairs.

public static NexusLabs.Foundry.Evaluation.Experiments.ExperimentPairedContinuousComparisonEvidence CreateContinuous(string xLabel, string yLabel, System.Collections.Generic.IReadOnlyList<NexusLabs.Foundry.Evaluation.Experiments.ExperimentPairedContinuousCaseMeasurement> cases, ulong bootstrapSeed, double confidenceLevel);

Parameters

xLabel System.String

The stable label for arm X.

yLabel System.String

The stable label for arm Y.

cases System.Collections.Generic.IReadOnlyList<ExperimentPairedContinuousCaseMeasurement>

The paired continuous case measurements to analyze.

bootstrapSeed System.UInt64

The deterministic seed for the internal 10,000-resample case-level bootstrap.

confidenceLevel System.Double

The two-sided interval confidence level.

Returns

ExperimentPairedContinuousComparisonEvidence
Validated paired continuous comparison evidence.

ExperimentPairedComparisonEvidence.CreateContinuousPessimisticSensitivity(string, string, IReadOnlyList<ExperimentPairedContinuousPessimisticCaseMeasurement>, ulong, double) Method

Creates the required pessimistic sensitivity evidence for a paired continuous comparison.

public static NexusLabs.Foundry.Evaluation.Experiments.ExperimentPairedContinuousPessimisticSensitivityEvidence CreateContinuousPessimisticSensitivity(string xLabel, string yLabel, System.Collections.Generic.IReadOnlyList<NexusLabs.Foundry.Evaluation.Experiments.ExperimentPairedContinuousPessimisticCaseMeasurement> cases, ulong bootstrapSeed, double confidenceLevel);

Parameters

xLabel System.String

The stable label for arm X.

yLabel System.String

The stable label for arm Y.

cases System.Collections.Generic.IReadOnlyList<ExperimentPairedContinuousPessimisticCaseMeasurement>

Fully scheduled case-level measurements after substituting each arm's predeclared pessimistic bound for scheduled failed or unscorable trials. Cases that were not fully scheduled remain explicit and are excluded without substitution.

bootstrapSeed System.UInt64

The deterministic seed for the internal 10,000-resample case-level bootstrap.

confidenceLevel System.Double

The two-sided interval confidence level.

Returns

ExperimentPairedContinuousPessimisticSensitivityEvidence
Validated pessimistic continuous sensitivity evidence.