LangSmith is a service provided by LangChain that supports experimentation, evaluation, debugging, and systematic development workflows for designing and iterating on LLM-based applications.
While LangFuse focuses on operational logging and monitoring of LLM applications, LangSmith is a dedicated end-to-end tool for LangChain that supports the entire development cycle of LLM applications.
LangSmith Usages
LangSmith
- [Project = Session] Sessions are also referred to as "Projects" in the UI
- Trace - an execution composed of a set of runs (UI-only, no fixed scheme)
- Run - a unit of LLM call or function
- Message - a unit of conversation request & answer
LangFuse
- (Session) optional trace grouping from user side
- Trace - a unit of
- Observation - a unit of LLM call or function
LangSmith Run = LangFuse Observation
LangSmith Trace = LangFuse Session
Rate Limit
Setup
Usage chart example
Hub
