Society of Minds: To Enable Societal Interactions to Improve Output
The foundation of the multi-agent debate approach involves pitting multiple LLM instances against each other, where each proposes and argues a response to a given prompt. Through rounds of exchange, the objective is to collectively review and refine answers, ultimately reaching a well-reviewed, accurate final response.
Also Marvin Minsky YouTube "Society of Mind"
From Medium article…
In his 1986 book The Society of Mind, Minksy, the founder of MIT’s AI laboratory, presented his theory of how the mind works. He proposed that it is not a single entity but rather a complex system composed of many smaller, simpler processes that Minsky called “agents”. These agents, each simple in itself, work together to create intelligent behavior, the behavior that AI is every day trying to imitate from us humans. Now, this fascinating theory has inspired a select group of MIT and Google Brain researchers to present the next breakthrough in Generative AI, a new way to fight the largest enemy of Large Language Models (LLMs) like ChatGPT.
The proposed method works by creating a “society of minds” where multiple instances of a language model propose and debate their individual responses and reasoning processes over multiple rounds to arrive at a single common answer.
Here’s a more detailed breakdown:
- Given a query, multiple instances of a language model (or several ones) first generate individual candidate answers.
- Each individual model instance reads and critiques the responses of all other models and uses this content to update its own answer.
- This step is then repeated over several rounds until we reach a final answer.
This process induces models to construct answers that are consistent with both their internal critic as well as sensible in light of the responses of other agents.
The resulting quorum of models can hold and maintain multiple chains of reasoning and possible answers simultaneously before proposing the final answer.