Orchestration¶
Interaction and Orchestration Frameworks and SDKs¶
Handling the inputs/outputs to GenAI in a consistent and reliable manner has spurred the creation of software libraries that can work with GenAI that is called as a service, or hosted locally.
LangChain¶
LangChain is an open source SDK that allows for creation and management of chat and RAG based interactions. It has a large user community emphasizing extensions to multiple types of models and documents. It has enterprise offerings with LangSmith for observability, LangServe for serving. It also can enable multi-agent interactions with LangGraph.
A thorough python and javascript orchestration language for adaptable, memory and tooling-equipped calls that can enable agentic AI.
Provides a hosted version of LangServe for one-click deployments of LangChain applications.
Open-source effort to integrate multiple LLMs, building upon LangChain, LangServe, and LangSmith.
LangChain Stack
Low-code solutions for agentic needs.
The first agent IDE for visual development.
Visual programming interface for LangChain.
Curated list of LangChain tools and resources.
Tutorials:
Tutorial on working with PDFs using GPT-4 and LangChain.
Guide to using prompt templates effectively.
Comprehensive course on LangChain development.
Other SDKs¶
Microsoft's framework for integrating AI with software applications.
Framework to easily create LLM powered bots over any dataset.
All-in-one embeddings database for semantic search, LLM orchestration and language model workflows.
Language-like Interfaces¶
Query language that enables simplified representations of chats and agents with minimal code.
Control Libraries¶
- Guidance
- RELM
- Outlines
Retrieval Augmentation¶
Framework for evaluating Retrieval Augmented Generation (RAG) pipelines.
Llama Index¶
CLI tool for quickly starting new LlamaIndex applications.
Orchestration framework with multiple connectors.
Flexible tools for using and indexing various data sources.
Open-source toolkit for pretraining, finetuning and deployment of LLMs.
Enterprise Solutions¶
E2E LLM orchestration framework by DeepSet: - Scalable search and retrieval - Evaluation pipelines - REST API deployment
Enterprise alternative to LangChain: - Commercial support - Cloud optimization - Security features
Monitoring and Observability¶
Open Source LLM Engineering platform with traces, evals, and prompt management.
Monitoring and analytics for AI agents.
Debugging and monitoring for LangChain applications.
Usage tracking and analytics for LLM applications.
Additional Tools¶
Visual workflow builder for LLM applications.
Data flow prompt engineering environment.
Drop-in replacement REST API compatible with OpenAI specifications.
Microservices approach to AGI development.
Framework for solving advanced tasks with language models.