요약

• 2023년 2월에 출시된 LLaMA는 이미 다양한 파인튜닝 모델이 출시됨
• 각 모델을 살펴보고 비교
  • LLaMA : (7B, 13B, 33B, 65B), CommonCrawl/C4/GitHub/Wikipedia/Gutenberg & Book3/ArXiv/StackExchange
  • Alpaca : 52k GPT-3 instructions
  • Vicuna : 70k ChatGPT conversations
  • Koala : 117k cleaned ChatGPT conversations
  • GPT4-x-Alpaca : 20k GPT4 instructions
  • WizardLM : 70k instructions synthesized with ChatGPT/GPT-3
  • OpenAssistant : 600k human interactions (OpenAssistant Conversations)
• LLaMA 모델을 로컬에서 돌리기 위한 소프트웨어들

소개하는 말

뿌리기 좋게 다듬기

진짜 든 생각

인용

A brief history of LLaMA models - AGI Sphere

The LLaMA base model was released in February 2023. Now we have seen a handful of new fine-tuned LLaMA models released.

It is literally a brief history, but a lot has happened for sure. So let’s do a brief review.

I will cover some developments in models and briefly touch on tools.

• LLaMA base model
• Alpaca model