Interface: EvaluateOptions
evaluation.EvaluateOptions
Properties
data
• data: DataT
The dataset to evaluate on. Can be a dataset name, a list of examples, or a generator of examples.
Defined in
client
• Optional client: Client
The LangSmith client to use.
Default
undefined
Defined in
evaluators
• Optional evaluators: EvaluatorT[]
A list of evaluators to run on each example.
Default
undefined
Defined in
experimentPrefix
• Optional experimentPrefix: string
A prefix to provide for your experiment name.
Default
undefined
Defined in
maxConcurrency
• Optional maxConcurrency: number
The maximum number of concurrent evaluations to run.
Default
undefined
Defined in
metadata
• Optional metadata: KVMap
Metadata to attach to the experiment.
Default
undefined
Defined in
summaryEvaluators
• Optional summaryEvaluators: SummaryEvaluatorT[]
A list of summary evaluators to run on the entire dataset.
Default
undefined