OpenThaiGPT
  • 🏠ยินดีต้อนรับสู่ OpenThaiGPT 1.5
  • 📚OpenThaiRAG
  • 🎇Web Demo!
  • ▶️Colab Demo!
  • 🔥OpenThaiGPT 1.0.0 <8 Apr 2024>
  • ❤️องค์กรที่ร่วมสนับสนุน (Sponsors)
  • 🤟ทีมอาสาสมัคร (Volunteer)
  • กฎกติกาความร่วมมือ (Rules)
  • ร่วมกับเรา (Join Us)
  • License
  • Previous Versions and Resources
    • 💻Released Code / Colabs
      • Pretraining LLM
      • 🆕InstructGPT Finetuning
      • Reinforcement Learning with Human Feedback (RLHF)
    • 😍การช่วยกันสร้าง Dataset สนทนา Chat ภาษาไทย!
    • 📄Released Datasets (14/04/23)
    • 📦Released OpenThaiGPT Pip Python Library <0.1.1> (26/05/23)
    • 🔥Released OpenThaiGPT 7b <1.0.0-beta> (16/08/23)
    • 🔥Released OpenThaiGPT 13b <1.0.0-beta> (20/12/23)
    • แผนการดำเนินงาน Roadmap
    • Open Resources
      • 🆕Free Working Datasets
      • Related Paper / Knowledge
      • Computing Resources
    • Previous Events
      • 🥳OpenThaiGPT Meet Up #2
      • 🆕อัพเดท! จากทีม Finetune (8 Apr)
      • Core-team Volunteer Meeting 19 March 15:30
      • Finetuning / RLHF Volunteer Event (18 March)
      • Safety Net Volunteer Event (12 March 19:00-19:45)
      • Pre-training Volunteer Event (11 March 19:00-20:15)
      • Volunteer Meetup #1 (Zoom) 5 March 13:00
      • First Meet Up (25 Feb 2023)!
      • 🔥Released Models Version <0.1.0-beta> (16/05/23)
      • 🔥Released Models Version <1.0.0-alpha> (03/08/23)
    • ChatGPT สร้างขึ้นมาได้อย่างไร (How to build ChatGPT?)
    • OpenThaiGPT Version 1.0
Powered by GitBook
On this page
  • Change Logs
  • 🇹🇭 OpenThaiGPT 13b Version 1.0.0-beta (Llama v2 + 15 billion Thai tokens pretrain + 10,000 Thai word extension)
  • License
  • Code and Weight

Was this helpful?

Export as PDF
  1. Previous Versions and Resources

Released OpenThaiGPT 13b <1.0.0-beta> (20/12/23)

PreviousReleased OpenThaiGPT 7b <1.0.0-beta> (16/08/23)Nextแผนการดำเนินงาน Roadmap

Last updated 11 months ago

Was this helpful?

🇹🇭 OpenThaiGPT 13b 1.0.0-beta (20 December 2023)

🇹🇭 OpenThaiGPT 13b Version 1.0.0-beta is a Thai language 13b-parameter LLaMA v2 Chat model further pretrained on Thai cleaned 15 billion tokens textual dataset, finetuned to follow Thai translated instructions and extend more than 10,000 most popular Thai words vocabularies into LLM's dictionary for turbo speed,

Change Logs

🇹🇭 OpenThaiGPT 13b Version 1.0.0-beta (Llama v2 + 15 billion Thai tokens pretrain + 10,000 Thai word extension)

Release date: 20 December 2023

License

Source Code: License Apache Software License 2.0. Weight: Research and Commercial uses.

Code and Weight

Colab demo: https://colab.research.google.com/drive/1dKNjLhOl1alBezcPdLihwqEOwJhcNAum?usp=sharing Finetune Code: https://github.com/OpenThaiGPT/openthaigpt-finetune-010beta Inference Code: https://github.com/OpenThaiGPT/openthaigpt Weights: (16 bits, Huggingface format) https://huggingface.co/openthaigpt/openthaigpt-1.0.0-beta-13b-chat-hf (16 bits and 4 bits, GGUF format) https://huggingface.co/openthaigpt/openthaigpt-1.0.0-beta-13b-chat-gguf

Sponsors

Authors

  • Kobkrit Viriyayudhakorn (kobkrit@aieat.or.th)

  • Sumeth Yuenyong (sumeth.yue@mahidol.edu)

  • Prachya Boonkwan (prachya.boonkwan@nectec.or.th, kaamanita@gmail.com)

  • Thaweewat Rugsujarit (thaweewr@scg.com)

  • Jillaphat Jaroenkantasima (autsadang41@gmail.com)

  • Norapat Buppodom (new@norapat.com)

  • Koravich Sangkaew (kwankoravich@gmail.com)

  • Peerawat Rojratchadakorn (peerawat.roj@gmail.com)

  • Chanon Utupon (chanon.utupon@gmail.com)

  • Sadhis Wongprayoon (sadhis.tae@gmail.com)

  • Nucharee Thongthungwong (nuchhub@hotmail.com)

  • Chawakorn Phiantham (mondcha1507@gmail.com)

  • Patteera Triamamornwooth (patt.patteera@gmail.com)

  • Kriangkrai Saetan (kraitan.ss21@gmail.com)

  • Pitikorn Khlaisamniang (pitikorn32@gmail.com)

  • Jarupoj Tanomrak (jarupoj.t@openthai.or.th)

  • Phoochit Witchutanon (phoochit.w@openthai.or.th)

  • Pattareeya Piravechsakul (pattareeya.p@openthai.or.th)

🔥