Brilla AI: AI Contestant for the National Science and Maths Quiz
0
Sign in to get full access
Overview
- This paper presents Brilla AI, an AI system designed to compete in the National Science and Maths Quiz (NSMQ) in Ghana.
- Brilla AI aims to showcase the potential of artificial intelligence in educational contexts, particularly in science and mathematics education.
- The paper discusses the system's architecture, training, and performance in the NSMQ competition.
Plain English Explanation
The researchers have developed an AI system called Brilla AI that is capable of competing in Ghana's National Science and Maths Quiz (NSMQ). The NSMQ is a prestigious academic competition that tests students' knowledge of science and mathematics. By designing an AI system to participate in this competition, the researchers are demonstrating how artificial intelligence can be leveraged to enhance science and mathematics education.
Brilla AI: AI Contestant for the National Science and Maths Quiz
The Brilla AI system is built using advanced natural language processing techniques, such as the BERT language model, to understand and respond to the quiz questions. The system is trained on a large corpus of scientific and mathematical knowledge, allowing it to draw upon a vast amount of information to formulate its answers.
Leveraging AI to Advance Science & Computing Education
By participating in the NSMQ, Brilla AI aims to showcase the potential of AI in educational settings. The researchers believe that AI-powered systems like Brilla AI can be used to supplement and enhance traditional teaching methods, providing students with personalized learning experiences and access to a wealth of knowledge.
AI Tutoring Software for Engineering Education
Technical Explanation
The Brilla AI system is built on a BERT-based architecture, which is a state-of-the-art language model that has demonstrated strong performance on a variety of natural language processing tasks. The researchers fine-tuned the BERT model on a large corpus of scientific and mathematical content, including textbooks, research papers, and online resources, to equip the system with the necessary knowledge to answer questions in the NSMQ.
MediFact at MEDIQA-CORR 2024: Why AI
The system is designed to process the quiz questions, retrieve relevant information from its knowledge base, and formulate coherent responses. The researchers have also implemented various strategies to enhance the system's performance, such as incorporating domain-specific knowledge, leveraging ensemble techniques, and optimizing the system's architecture.
Mathify: Evaluating Large Language Models for Mathematical Problem Solving
Critical Analysis
The paper provides a comprehensive overview of the Brilla AI system and its performance in the NSMQ competition. However, the researchers acknowledge that the system is not without its limitations. For instance, the system may struggle with questions that require deeper reasoning or the integration of multiple concepts, as its knowledge is primarily based on textual information.
Additionally, the researchers note that the system's performance is heavily dependent on the quality and breadth of the training data. Expanding the knowledge base and improving the system's ability to handle more complex questions could be areas for future research.
It will also be important to carefully consider the ethical implications of deploying AI systems in educational settings, particularly regarding issues of fairness, transparency, and human-AI interaction.
Conclusion
The Brilla AI system represents a significant step forward in the application of AI technology to science and mathematics education. By participating in the prestigious NSMQ competition, the researchers have demonstrated the potential of AI to enhance learning and engagement in these crucial subjects.
While the system has shown promising results, further research and development will be necessary to address its limitations and expand its capabilities. Nonetheless, the Brilla AI project serves as an inspiring example of how AI can be leveraged to support and transform educational practices, ultimately benefiting students and advancing scientific and mathematical knowledge.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Brilla AI: AI Contestant for the National Science and Maths Quiz
George Boateng, Jonathan Abrefah Mensah, Kevin Takyi Yeboah, William Edor, Andrew Kojo Mensah-Onumah, Naafi Dasana Ibrahim, Nana Sam Yeboah
The African continent lacks enough qualified teachers which hampers the provision of adequate learning support. An AI could potentially augment the efforts of the limited number of teachers, leading to better learning outcomes. Towards that end, this work describes and evaluates the first key output for the NSMQ AI Grand Challenge, which proposes a robust, real-world benchmark for such an AI: Build an AI to compete live in Ghana's National Science and Maths Quiz (NSMQ) competition and win - performing better than the best contestants in all rounds and stages of the competition. The NSMQ is an annual live science and mathematics competition for senior secondary school students in Ghana in which 3 teams of 2 students compete by answering questions across biology, chemistry, physics, and math in 5 rounds over 5 progressive stages until a winning team is crowned for that year. In this work, we built Brilla AI, an AI contestant that we deployed to unofficially compete remotely and live in the Riddles round of the 2023 NSMQ Grand Finale, the first of its kind in the 30-year history of the competition. Brilla AI is currently available as a web app that livestreams the Riddles round of the contest, and runs 4 machine learning systems: (1) speech to text (2) question extraction (3) question answering and (4) text to speech that work together in real-time to quickly and accurately provide an answer, and then say it with a Ghanaian accent. In its debut, our AI answered one of the 4 riddles ahead of the 3 human contesting teams, unofficially placing second (tied). Improvements and extensions of this AI could potentially be deployed to offer science tutoring to students and eventually enable millions across Africa to have one-on-one learning interactions, democratizing science education.
Read more5/2/2024
🤷
0
AfricAIED 2024: 2nd Workshop on Artificial Intelligence in Education in Africa
George Boateng, Victor Kumbol
Recent AI advancements offer transformative potential for global education, yet their application often overlooks Africa's unique educational landscape. AfricAIED 2024 will address this gap, spotlighting efforts to develop AI in Education (AIED) systems tailored to Africa's needs. Building on the success of the inaugural workshop, AfricAIED 2024 will feature an online AI Hackathon focused on democratizing preparation for Ghana's National Science & Maths Quiz (NSMQ). Participants will create open-source AI tools leveraging resources from the Brilla AI project to level the academic playing field and enhance science and math education across Africa. The workshop will showcase top competitors' solutions, invite discussions on AIED opportunities and challenges in Africa, and highlight the latest advancements in AI education integration. AfricAIED 2024 aims to foster collaboration and innovation, amplifying African voices in the AIED community and driving positive change in African education through AI.
Read more5/2/2024
🤖
0
Real-World Deployment and Evaluation of Kwame for Science, An AI Teaching Assistant for Science Education in West Africa
George Boateng, Samuel John, Samuel Boateng, Philemon Badu, Patrick Agyeman-Budu, Victor Kumbol
Africa has a high student-to-teacher ratio which limits students' access to teachers for learning support such as educational question answering. In this work, we extended Kwame, a bilingual AI teaching assistant for coding education, adapted it for science education, and deployed it as a web app. Kwame for Science provides passages from well-curated knowledge sources and related past national exam questions as answers to questions from students based on the Integrated Science subject of the West African Senior Secondary Certificate Examination (WASSCE). Furthermore, students can view past national exam questions along with their answers and filter by year, question type, and topics that were automatically categorized by a topic detection model which we developed (91% unweighted average recall). We deployed Kwame for Science in the real world over 8 months and had 750 users across 32 countries (15 in Africa) and 1.5K questions asked. Our evaluation showed an 87.2% top 3 accuracy (n=109 questions) implying that Kwame for Science has a high chance of giving at least one useful answer among the 3 displayed. We categorized the reasons the model incorrectly answered questions to provide insights for future improvements. We also share challenges and lessons with the development, deployment, and human-computer interaction component of such a tool to enable other researchers to deploy similar tools. With a first-of-its-kind tool within the African context, Kwame for Science has the potential to enable the delivery of scalable, cost-effective, and quality remote education to millions of people across Africa.
Read more4/30/2024
🤖
0
Leveraging AI to Advance Science and Computing Education across Africa: Challenges, Progress and Opportunities
George Boateng
Across the African continent, students grapple with various educational challenges, including limited access to essential resources such as computers, internet connectivity, reliable electricity, and a shortage of qualified teachers. Despite these challenges, recent advances in AI such as BERT, and GPT-4 have demonstrated their potential for advancing education. Yet, these AI tools tend to be deployed and evaluated predominantly within the context of Western educational settings, with limited attention directed towards the unique needs and challenges faced by students in Africa. In this chapter, we discuss challenges with using AI to advance education across Africa. Then, we describe our work developing and deploying AI in Education tools in Africa for science and computing education: (1) SuaCode, an AI-powered app that enables Africans to learn to code using their smartphones, (2) AutoGrad, an automated grading, and feedback tool for graphical and interactive coding assignments, (3) a tool for code plagiarism detection that shows visual evidence of plagiarism, (4) Kwame, a bilingual AI teaching assistant for coding courses, (5) Kwame for Science, a web-based AI teaching assistant that provides instant answers to students' science questions and (6) Brilla AI, an AI contestant for the National Science and Maths Quiz competition. Finally, we discuss potential opportunities to leverage AI to advance education across Africa.
Read more4/30/2024