ColossalChat

ColossalChat is a free and open-source alternative to ChatGPT , launched by Colossal-AI . Its GitHub project has already garnered 26,000 stars.

As a leading open-source solution for large-scale artificial intelligence models, Colossal AI is the first company to open-source a complete RLHF mechanism based on LLaMA pre-trained models. This mechanism includes supervised data collection, supervised fine-tuning, rewarded model training, and reinforcement learning fine-tuning, and shares ColossalChat—an open-source project very similar to the original ChatGPT technical solution.

This open-source project includes the following:

• Demo: An interactive demo that you can try online without registering or joining a waiting list.
• Training code: Open source complete RLHF training code, including models with 7 billion and 13 billion training times.
• Dataset: Open source 104K Chinese-English bilingual dataset.
• Inference: Only 4GB of GPU memory is required for 4-bit quantized inference of a 7 billion parameter model.
• Model weights: Rapid replication can be achieved with only a small amount of computing power on a single server.