Inceptionai
Models by this creator
🔎
jais-13b
139
The jais-13b is a 13 billion parameter pre-trained bilingual large language model for both Arabic and English, developed by Inception, Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), and Cerebras Systems. It was trained on a dataset containing 72 billion Arabic tokens and 279 billion English/code tokens. The model is based on a transformer-based decoder-only (GPT-3) architecture and uses SwiGLU non-linearity, as well as ALiBi position embeddings to enable the model to handle long sequence lengths and provide improved context handling. The jais-13b model achieves state-of-the-art performance on a comprehensive Arabic test suite, outperforming other leading models like BLOOM, LLaMA2, AraT5, and AraBART across a range of tasks including question answering, common sense reasoning, and language understanding. In comparison, the similar jais-13b-chat model has been fine-tuned for chatbot and instruction-following capabilities. Model inputs and outputs Inputs Text data**: The jais-13b model accepts text data as input, supporting both Arabic and English. Outputs Generated text**: The model generates text output in response to the input. This can include answers to questions, continuations of prompts, or any other form of open-ended text generation. Capabilities The jais-13b model demonstrates strong performance on a variety of Arabic and English language tasks, including question answering, common sense reasoning, and language understanding. For example, it achieved an average score of 46.5% on the comprehensive EXAMS benchmark, outperforming other large language models like BLOOM (40.9%), LLaMA2 (38.1%), AraT5 (32.0%), and AraBART (36.7%). The model's ability to handle long sequence lengths and provide improved context handling also makes it well-suited for tasks like multi-turn dialogue, knowledge-intensive question answering, and text summarization. What can I use it for? The jais-13b model can be used for a wide range of applications targeting Arabic and English speakers, such as: Research**: Researchers can use the model as a base for further fine-tuning and development of Arabic and bilingual language models. Commercial use**: The model can be used as a starting point for building chatbots, virtual assistants, and other customer service applications targeting Arabic-speaking audiences. The similar jais-13b-chat model is specifically designed for this purpose. The model's open-source license and support for free commercial use make it an attractive option for developers and businesses looking to incorporate advanced Arabic and bilingual language capabilities into their products and services. Things to try One interesting aspect of the jais-13b model is its ability to handle long sequence lengths and provide improved context handling, thanks to the use of ALiBi position embeddings. This could be leveraged for tasks like multi-turn dialogue, where the model needs to maintain context and coherence over an extended conversation. Researchers and developers could also explore fine-tuning the jais-13b model on specialized datasets or tasks, such as domain-specific question answering or summarization, to further enhance its capabilities for targeted applications.
Updated 9/12/2024
❗
jais-13b-chat
135
The jais-13b-chat model is a text-to-text AI model developed by inceptionai. This model is similar to other large language models like jais-13b-chat-core42, DeepSeek-V2-Lite-Chat, DeepSeek-V2-Chat, Inkbot-13B-8k-0.2, and longchat-7b-v1.5-32k, which are also large language models focused on text generation and conversational tasks. Model inputs and outputs The jais-13b-chat model takes text as input and generates human-like responses. It can be used for a variety of text-to-text tasks, such as question answering, summarization, and dialogue generation. Inputs Text prompts for the model to generate a response to Outputs Generated text responses to the input prompts Capabilities The jais-13b-chat model can engage in open-ended conversation, answer questions, and generate coherent and relevant text on a wide range of topics. It demonstrates strong language understanding and generation abilities that can be useful for various applications. What can I use it for? The jais-13b-chat model can be used for tasks such as customer service chatbots, creative writing assistants, and language learning tools. Its broad knowledge and conversational capabilities make it a versatile model that could be integrated into a variety of products and services. Things to try Users could experiment with providing the model with different types of prompts, such as open-ended questions, creative writing prompts, or task-oriented instructions, to see the variety of responses it can generate. They could also fine-tune the model on specific datasets or applications to further enhance its capabilities for their needs.
Updated 9/12/2024