🔥Released OpenThaiGPT 13b <1.0.0-beta> (20/12/23)

🇹🇭 OpenThaiGPT 13b 1.0.0-beta (20 December 2023)

🇹🇭 OpenThaiGPT 13b Version 1.0.0-beta is a Thai language 13b-parameter LLaMA v2 Chat model further pretrained on Thai cleaned 15 billion tokens textual dataset, finetuned to follow Thai translated instructions and extend more than 10,000 most popular Thai words vocabularies into LLM's dictionary for turbo speed,

Change Logs

🇹🇭 OpenThaiGPT 13b Version 1.0.0-beta (Llama v2 + 15 billion Thai tokens pretrain + 10,000 Thai word extension)

Release date: 20 December 2023

License

Source Code: License Apache Software License 2.0. Weight: Research and Commercial uses.

Code and Weight

Colab demo: https://colab.research.google.com/drive/1dKNjLhOl1alBezcPdLihwqEOwJhcNAum?usp=sharing Finetune Code: https://github.com/OpenThaiGPT/openthaigpt-finetune-010beta Inference Code: https://github.com/OpenThaiGPT/openthaigpt Weights: (16 bits, Huggingface format) https://huggingface.co/openthaigpt/openthaigpt-1.0.0-beta-13b-chat-hf (16 bits and 4 bits, GGUF format) https://huggingface.co/openthaigpt/openthaigpt-1.0.0-beta-13b-chat-gguf

Sponsors

Authors

• Kobkrit Viriyayudhakorn ([e-mail])

• Sumeth Yuenyong ([e-mail])

• Prachya Boonkwan ([e-mail], [e-mail])

• Thaweewat Rugsujarit ([e-mail])

• Jillaphat Jaroenkantasima ([e-mail])

• Norapat Buppodom ([e-mail])

• Koravich Sangkaew ([e-mail])

• Peerawat Rojratchadakorn ([e-mail])

• Chanon Utupon ([e-mail])

• Sadhis Wongprayoon ([e-mail])

• Nucharee Thongthungwong ([e-mail])

• Chawakorn Phiantham ([e-mail])

• Patteera Triamamornwooth ([e-mail])

• Kriangkrai Saetan ([e-mail])

• Pitikorn Khlaisamniang ([e-mail])

• Jarupoj Tanomrak ([e-mail])

• Phoochit Witchutanon ([e-mail])

• Pattareeya Piravechsakul ([e-mail])