structured_output support

[ArtemisDicoTiar]

from langchain_core.prompts import ChatPromptTemplate
from langchain_core.pydantic_v1 import BaseModel, Field
from langchain_openai import ChatOpenAI


# Data model
class GradeDocuments(BaseModel):
    """Binary score for relevance check on retrieved documents."""

    binary_score: str = Field(
        description="Documents are relevant to the question, 'yes' or 'no'"
    )


# LLM with function call
structured_llm_grader = llm.with_structured_output(GradeDocuments)

[ArtemisDicoTiar]

문제가

1. snowflake 클래스가 with_structured_output을 오버라이드 해야한다.
2. llama3.1-8b 정도 되는 작은 모델로는 잘안됨...
   일단 스킵