Circle V2 API Docs
    Preparing search index...

    Type Alias PushAuditRunToEvalDatasetResult

    type PushAuditRunToEvalDatasetResult = {
        datasetName: string;
        humanCorrected: number;
        pushed: number;
        skippedExisting: number;
        splits: string[];
        total: number;
    }
    Index

    Properties

    datasetName: string
    humanCorrected: number

    Pushed examples whose gold status came from a human correction. Each ships with an empty reference answer, so this is the number a curator still has to write answers for.

    pushed: number
    skippedExisting: number

    This question already in the dataset FOR THIS PATIENT — left untouched.

    splits: string[]

    Splits the new examples were added to: incoming + the patient and template axis splits.

    total: number

    Questions on the run, after latest-response-per-question dedupe.