You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Feb 25, 2026. It is now read-only.
So each sample in the benchmark contains input(query) and output(reference, expected_steps, order_matters) which is visible in the langsmith UI, but when i try to download the same task benchmarks locally using this code
[
{
"created_at": "2024-08-29T18:00:33.682146+00:00",
"dataset_id": "3f29798f-5939-4643-bd99-008ca66b72ed",
"id": "1620401b-f41f-4dcc-a2a4-a9026504b2c9",
"inputs": {
"question": "What are the benefits of using LangChain for building chatbots?"
},
"metadata": {
"dataset_split": [
"base"
],
"source": "synthetic"
},
"modified_at": "2024-08-29T18:00:33.682146+00:00",
"outputs": {
"answer": "LangChain offers several benefits for building chatbots, including modular components for handling various tasks, easy integration with multiple language models, built-in support for memory and state management, and a flexible architecture that allows for customization and scalability."
},
"runs": [],
"source_run_id": null
}
]
It doesn't contain all the output variables like intermediate_steps. Is there any other way to download the complete benchmark dataset for a task locally?