A Genetic Algorithm-Based Support Vector Machine Approach for Intelligent Usability Assessment of m-Learning Applications

2404.16043

YC

0

Reddit

0

Published 4/26/2024 by Muhammad Asghar, Imran Sarwar Bajwa, Shabana Ramzan, Hina Afreen, Saima Abdullah

🌐

Abstract

In the field of human-computer interaction (HCI), the usability assessment of m-learning (mobile-learning) applications is a real challenge. Such assessment typically involves extraction of the best features of an application like efficiency, effectiveness, learnability, cognition, memorability, etc., and further ranking of those features for an overall assessment of the quality of the mobile application. In the previous literature, it is found that there is neither any theory nor any tool available to measure or assess a user perception and assessment of usability features of a m-learning application for the sake of ranking the graphical user interface of a mobile application in terms of a user acceptance and satisfaction. In this paper, a novel approach is presented by performing a mobile applications quantitative and qualitative analysis. Based on user requirements and perception, a criterion is defined based on a set of important features. Afterward, for the qualitative analysis, a genetic algorithm (GA) is used to score prescribed features for the usability assessment of a mobile application. The used approach assigns a score to each usability feature according to the user requirement and weight of each feature. GA performs the rank assessment process initially by performing feature selection and scoring the best features of the application. A comparison of assessment analysis of GA and various machine learning models, K-nearest neighbours, Naive Bayes, and Random Forests is performed. It was found that a GA-based support vector machine (SVM) provides more accuracy in the extraction of the best features of a mobile application and further ranking of those features.

Create account to get full access

or

If you already have an account, we'll log you in

Overview

  • The paper focuses on assessing the usability of mobile learning (m-learning) applications using a novel approach.
  • The researchers define a set of important usability features based on user requirements and perceptions.
  • A genetic algorithm (GA) is used to score these features and rank the usability of the mobile application.
  • The GA-based approach is compared to other machine learning models like K-nearest neighbors, Naive Bayes, and Random Forests.
  • The results show that the GA-based support vector machine (SVM) provides more accuracy in extracting and ranking the best usability features of a mobile application.

Plain English Explanation

When it comes to mobile learning (m-learning) apps, assessing their usability can be a real challenge. Usability is about how easy and effective an app is to use. The researchers in this paper wanted to find a better way to evaluate the usability of m-learning apps.

They started by defining a set of important usability features, like how efficient the app is, how effective it is at helping users learn, and how easy it is to remember how to use. Then, they used a technique called a genetic algorithm (GA) to score and rank these usability features.

The GA works a bit like evolution - it tries different combinations of features and scores them, then keeps the best ones and tries new variations. This helps the GA find the most important usability features for a particular m-learning app.

The researchers compared the GA's results to other machine learning models, like K-nearest neighbors, Naive Bayes, and Random Forests. They found that the GA-based support vector machine (SVM) was the most accurate at identifying and ranking the best usability features.

This new approach could help designers and developers create more usable and effective m-learning apps, which is important as mobile learning continues to grow in popularity.

Technical Explanation

The researchers in this paper addressed the challenge of assessing the usability of mobile learning (m-learning) applications. Typical usability assessments involve identifying and ranking key features like efficiency, effectiveness, learnability, cognition, and memorability.

However, the researchers noted that there was a lack of both theory and tools to measure user perception and assess the usability of m-learning apps. To address this, they proposed a novel approach that combines quantitative and qualitative analysis.

First, the researchers defined a set of important usability features based on user requirements and perceptions. Then, they used a genetic algorithm (GA) to score and rank these features. The GA performs feature selection and scores the best features, assigning weights based on user requirements.

The researchers compared the GA-based approach to other machine learning models, including K-nearest neighbors, Naive Bayes, and Random Forests. They found that the GA-based support vector machine (SVM) model provided the most accurate results in terms of extracting and ranking the best usability features of a mobile application.

Critical Analysis

The researchers in this paper have presented a novel approach to assessing the usability of m-learning applications, which is an important and challenging problem in the field of human-computer interaction (HCI).

One potential limitation of the study is that the usability features were defined based on user requirements and perceptions, which may not capture all the relevant factors for assessing usability. There may be other important usability aspects that were not considered in the study.

Additionally, the researchers only compared their GA-based approach to a few machine learning models (K-nearest neighbors, Naive Bayes, and Random Forests). It would be interesting to see how the GA-based SVM performs compared to a wider range of models, including more advanced techniques like deep learning NN models or ensemble methods.

The paper also does not provide much detail on the specific implementation of the GA or the feature selection process. More information on these technical aspects would be helpful for readers interested in replicating or building upon the research.

Overall, the researchers have made a valuable contribution to the field of HCI by proposing a novel approach to assessing m-learning app usability. The GA-based SVM model appears promising, but further research and validation would be needed to fully establish its effectiveness and generalizability.

Conclusion

This paper presents a novel approach to assessing the usability of mobile learning (m-learning) applications using a genetic algorithm (GA) and support vector machine (SVM) model. The researchers defined a set of important usability features based on user requirements and perceptions, and then used the GA to score and rank these features.

The GA-based SVM model was found to be more accurate than other machine learning approaches, such as K-nearest neighbors, Naive Bayes, and Random Forests, in extracting and ranking the best usability features of a mobile application.

This research contributes to the field of human-computer interaction (HCI) by providing a more robust and systematic way to evaluate the usability of m-learning apps. As mobile learning continues to grow in popularity, tools like the one developed in this paper could help designers and developers create more effective and user-friendly learning experiences.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Related Papers

🔍

Fast Genetic Algorithm for feature selection -- A qualitative approximation approach

Mohammed Ghaith Altarabichi, S{l}awomir Nowaczyk, Sepideh Pashami, Peyman Sheikholharam Mashhadi

YC

0

Reddit

0

Evolutionary Algorithms (EAs) are often challenging to apply in real-world settings since evolutionary computations involve a large number of evaluations of a typically expensive fitness function. For example, an evaluation could involve training a new machine learning model. An approximation (also known as meta-model or a surrogate) of the true function can be used in such applications to alleviate the computation cost. In this paper, we propose a two-stage surrogate-assisted evolutionary approach to address the computational issues arising from using Genetic Algorithm (GA) for feature selection in a wrapper setting for large datasets. We define 'Approximation Usefulness' to capture the necessary conditions to ensure correctness of the EA computations when an approximation is used. Based on this definition, we propose a procedure to construct a lightweight qualitative meta-model by the active selection of data instances. We then use a meta-model to carry out the feature selection task. We apply this procedure to the GA-based algorithm CHC (Cross generational elitist selection, Heterogeneous recombination and Cataclysmic mutation) to create a Qualitative approXimations variant, CHCQX. We show that CHCQX converges faster to feature subset solutions of significantly higher accuracy (as compared to CHC), particularly for large datasets with over 100K instances. We also demonstrate the applicability of the thinking behind our approach more broadly to Swarm Intelligence (SI), another branch of the Evolutionary Computation (EC) paradigm with results of PSOQX, a qualitative approximation adaptation of the Particle Swarm Optimization (PSO) method. A GitHub repository with the complete implementation is available.

Read more

4/8/2024

🧪

Establishing Heuristics for Improving the Usability of GUI Machine Learning Tools for Novice Users

Asma Yamani, Haifa Alshammare, Malak Baslyman

YC

0

Reddit

0

Machine learning (ML) tools with graphical user interfaces (GUI) are facing demand from novice users who do not have the background of their underlying concepts. These tools are frequently complex and pose unique challenges in terms of interaction and comprehension by novice users. There is yet to be an established set of usability heuristics to guide and assess GUI ML tool design. To address this gap, in this paper, we extend Nielsen's heuristics for evaluating GUI ML Tools through a set of empirical evaluations. To validate the proposed heuristics, user testing was conducted by novice users on a prototype that reflects those heuristics. Based on the results of the evaluations, our new heuristics set improves upon existing heuristics in the context of ML tools. It can serve as a resource for practitioners designing and evaluating these tools.

Read more

5/15/2024

🤖

Predicting the usability of mobile applications using AI tools: the rise of large user interface models, opportunities, and challenges

Abdallah Namoun, Ahmed Alrehaili, Zaib Un Nisa, Hani Almoamari, Ali Tufail

YC

0

Reddit

0

This article proposes the so-called large user interface models (LUIMs) to enable the generation of user interfaces and prediction of usability using artificial intelligence in the context of mobile applications.

Read more

5/8/2024

🛸

Fitness Approximation through Machine Learning

Itai Tzruia, Tomer Halperin, Moshe Sipper, Achiya Elyasaf

YC

0

Reddit

0

We present a novel approach to performing fitness approximation in genetic algorithms (GAs) using machine-learning (ML) models, through dynamic adaptation to the evolutionary state. Maintaining a dataset of sampled individuals along with their actual fitness scores, we continually update a fitness-approximation ML model throughout an evolutionary run. We compare different methods for: 1) switching between actual and approximate fitness, 2) sampling the population, and 3) weighting the samples. Experimental findings demonstrate significant improvement in evolutionary runtimes, with fitness scores that are either identical or slightly lower than that of the fully run GA -- depending on the ratio of approximate-to-actual-fitness computation. Although we focus on evolutionary agents in Gymnasium (game) simulators -- where fitness computation is costly -- our approach is generic and can be easily applied to many different domains.

Read more

5/22/2024