Circle V2 API Docs
    Preparing search index...

    Function noFabricatedDocumentsEvaluator

    • Deterministic hallucination check for find_documents, evaluated on the intermediate steps of a chart-review experiment run: every document ID the selection LLM picked must be one it was actually offered — an ID absent from the span's available_documents listing is fabricated. Reference-free: pure set membership, no gold labels. Unscored (comment only) when no find_documents span can be found (tracing disabled, or a path that skips document selection).

      Parameters

      • __namedParameters: { example: Example; run: Run }

      Returns Promise<
          | { comment: string; key: string; score?: undefined }
          | { comment: string; key: string; score: number },
      >