Jump to content

Vicuna LLM

From Wikipedia, the free encyclopedia

Vicuna LLM is a large language model (LLM) released by LMSYS.[1] Based on Llama 2,[2][3] it is an open source project,[4][5] that has been used in AI research.[6][7] A non-commercial, public demo of the Vicuna-13b model is available to access using LMSYS.[8]

The methodology of LMSYS's Chatbot Arena is to enable the public at large to contrast and compare the accuracy of LLMs "in the wild" (an example of citizen science) and to vote on their output; a question-and-answer chat format is used. At the beginning of each round two LLM chatbots from a diverse pool of nine are presented randomly and anonymously, their identities only being revealed upon voting on their answers. The user has the option of either replaying ("regenerating") a round, or beginning an entirely fresh one with new LLMs.[9] (The user also has the option of choosing which LLMs to do battle.)[relevant?]

References

[edit]
  1. ↑ "Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality | LMSYS Org". lmsys.org. 30 March 2023.
  2. ↑ "lmsys/vicuna-13b-v1.5 · Hugging Face". huggingface.co. 18 July 2023.
  3. ↑ "The LLM Index: Vicuna | Sapling". sapling.ai.
  4. ↑ "FastChat". October 29, 2023 – via GitHub.
  5. ↑ "How to Train and Deploy Vicuna and FastChat LLMs | Width.ai". www.width.ai.
  6. ↑ Peng, Baolin; Li, Chunyuan; He, Pengcheng; Galley, Michel; Gao, Jianfeng (2023). "Instruction Tuning with GPT-4". arXiv:2304.03277 [cs.CL].
  7. ↑ Zheng, Lianmin; Chiang, Wei-Lin; Sheng, Ying; Zhuang, Siyuan; Wu, Zhanghao; Zhuang, Yonghao; Lin, Zi; Li, Zhuohan; Li, Dacheng; Xing, Eric P.; Zhang, Hao; Gonzalez, Joseph E.; Stoica, Ion (2023). "Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena". arXiv:2306.05685 [cs.CL].
  8. ↑ "Vicuna - Open-Source AI Chatbot".
  9. ↑ "Vicuna LLM Commercially Available, New v1.5 Update Improves Context Length".
[edit]