Skip to main content

Specification

This chapter introduces the basics of Generative AI, Prompting, Prompt Engineering, Chatbots, and more.

๐Ÿ“„๏ธ 4. Orchestrator & ToolDriver

When using multiple MCS drivers in a chain, each driver must autonomously determine if a function call in the LLM response is intended for it, assuming drivers maintain an internal representation of their tools (implemented in varying ways without a strict convention). The LLM's output is passed sequentially through all processllmresponse methods, and the system prompts from all drivers are combined and fed to the LLM. This can lead to side effects, especially with numerous drivers offering different formats. The LLM may struggle to cleanly separate and handle them, resulting in parsing errors or unreliable calls.