Exploring Crowdworkers' Perceptions, Current Practices, and Desired Practices Regarding Using Non-Workstation Devices for Crowdwork
0
Sign in to get full access
Overview
- Explores crowdworkers' perceptions, current practices, and desired practices regarding the use of non-workstation devices for crowdwork
- Provides insights into how crowdworkers currently utilize devices like smartphones and tablets for crowdsourcing tasks, and what they hope to see in the future
- Aims to inform the design of more inclusive and accessible crowdsourcing platforms
Plain English Explanation
Crowdsourcing platforms like Amazon Mechanical Turk allow people to earn money by completing small tasks or "microtasks" online. Typically, these tasks are done on desktop or laptop computers.
However, many crowdworkers may not always have access to a computer and may instead use mobile devices like smartphones or tablets to do their work. This paper explores how crowdworkers currently use these non-workstation devices and what they would like to see in the future to make the experience better.
The researchers interviewed crowdworkers to understand their perceptions, current practices, and desired practices. They found that while many crowdworkers do use mobile devices, the experience is not always ideal. Crowdworkers expressed a desire for features and tools that would make it easier to do tasks on smartphones and tablets.
The insights from this study could help crowdsourcing platforms and task designers create more inclusive and accessible experiences for all types of crowdworkers, regardless of the device they use.
Technical Explanation
The researchers conducted semi-structured interviews with 20 crowdworkers to understand their perceptions, current practices, and desired practices regarding the use of non-workstation devices for crowdwork. Participants were recruited from Amazon Mechanical Turk and were asked about their experiences using smartphones, tablets, and other mobile devices to complete crowdsourcing tasks.
The interviews revealed several key findings:
- Crowdworkers use mobile devices for convenience, flexibility, and to fill idle time
- However, the mobile experience is often challenging, with difficulties like small screens, limited input methods, and compatibility issues
- Crowdworkers desire features like better task formatting, support for voice input, and the ability to save and resume tasks across devices
Based on these findings, the researchers provide design recommendations for crowdsourcing platforms and task creators to better support the use of non-workstation devices. These include optimizing task layouts for mobile, integrating voice controls, and enabling task syncing across devices.
Critical Analysis
The study provides valuable insights into an important but often overlooked aspect of crowdsourcing - the use of non-workstation devices. By understanding crowdworkers' current practices and desired features, platform designers can work to create more inclusive and accessible experiences.
However, the study has a few limitations. The sample size is relatively small, and all participants were recruited from a single platform (Amazon Mechanical Turk). It would be beneficial to gather feedback from a more diverse pool of crowdworkers, including those who use other platforms or may have different device preferences or accessibility needs.
Additionally, the study focuses on the user experience and does not delve into potential technical or logistical challenges that platforms may face in implementing the recommended features. Further research could explore the feasibility and tradeoffs of these design recommendations from the platform perspective.
Conclusion
This study provides valuable insights into how crowdworkers currently use non-workstation devices and what they hope to see in the future. By addressing the needs of crowdworkers who rely on smartphones, tablets, and other mobile devices, crowdsourcing platforms can create more inclusive and accessible experiences. The findings and design recommendations from this research can help inform the development of next-generation crowdsourcing tools and platforms.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Exploring Crowdworkers' Perceptions, Current Practices, and Desired Practices Regarding Using Non-Workstation Devices for Crowdwork
Senjuti Dutta, Scott Ruoti, Rhema Linder, Alex C. Williams, Anastasia Kuzminykh
Despite a plethora of research dedicated to designing HITs for non-workstations, there is a lack of research looking specifically into workers' perceptions of the suitability of these devices for managing and completing work. In this work, we fill this research gap by conducting an online survey of 148 workers on Amazon Mechanical Turk to explore 1. how crowdworkers currently use their non-workstation devices to complete and manage crowdwork, 2. what challenges they face using those devices, and 3. to what extent they wish they could use those devices if their concerns were addressed. Our results show that workers unanimously favor using a desktop to complete and manage crowdwork. While workers occasionally use smartphones or tablets, they find their suitability marginal at best and have little interest in smart speakers and smartwatches, viewing them as unsuitable for crowdwork. When investigating the reason for these views, we find that the key issue is that non workstation devices lack the tooling necessary to automatically find and accept HITs, tooling that workers view as essential in their efforts to compete with bots in accepting high paying work. To address this problem, we propose a new paradigm for finding, accepting, and completing crowdwork that puts crowdworkers on equal footing with bots in these tasks. We also describe future research directions for tailoring HITs to non workstation devices and definitely answering whether smart speakers and smartwatches have a place in crowdwork.
Read more9/10/2024
0
Unveiling the Inter-Related Preferences of Crowdworkers: Implications for Personalized and Flexible Platform Design
Senjuti Dutta, Rhema Linder, Alex C. Williams, Anastasia Kuzminykh, Scott Ruoti
Crowdsourcing platforms have traditionally been designed with a focus on workstation interfaces, restricting the flexibility that crowdworkers need. Recognizing this limitation and the need for more adaptable platforms, prior research has highlighted the diverse work processes of crowdworkers, influenced by factors such as device type and work stage. However, these variables have largely been studied in isolation. Our study is the first to explore the interconnected variabilities among these factors within the crowdwork community. Through a survey involving 150 Amazon Mechanical Turk crowdworkers, we uncovered three distinct groups characterized by their interrelated variabilities in key work aspects. The largest group exhibits a reliance on traditional devices, showing limited interest in integrating smartphones and tablets into their work routines. The second-largest group also primarily uses traditional devices but expresses a desire for supportive tools and scripts that enhance productivity across all devices, particularly smartphones and tablets. The smallest group actively uses and strongly prefers non-workstation devices, especially smartphones and tablets, for their crowdworking activities. We translate our findings into design insights for platform developers, discussing the implications for creating more personalized, flexible, and efficient crowdsourcing environments. Additionally, we highlight the unique work practices of these crowdworker clusters, offering a contrast to those of more traditional and established worker groups.
Read more9/10/2024
0
Matching Input and Output Devices and Physical Disabilities for Human-Robot Workstations
Carlo Weidemann, Nils Mandischer, Burkhard Corves
As labor shortage is rising at an alarming rate, it is imperative to enable all people to work, particularly people with disabilities and elderly people. Robots are often used as universal tool to assist people with disabilities. However, for such human-robot workstations universal design fails. We mitigate the challenges of selecting an individualized set of input and output devices by matching devices required by the work process and individual disabilities adhering to the Convention on the Rights of Persons with Disabilities passed by the United Nations. The objective is to facilitate economically viable workstations with just the required devices, hence, lowering overall cost of corporate inclusion and during redesign of workplaces. Our work focuses on developing an efficient approach to filter input and output devices based on a person's disabilities, resulting in a tailored list of usable devices. The methodology enables an automated assessment of devices compatible with specific disabilities defined in International Classification of Functioning, Disability and Health. In a mock-up, we showcase the synthesis of input and output devices from disabilities, thereby providing a practical tool for selecting devices for individuals with disabilities.
Read more7/29/2024
0
Design and Evaluation of Camera-Centric Mobile Crowdsourcing Applications
Abby Stylianou, Michelle Brachman, Albatool Wazzan, Samuel Black, Richard Souvenir
The data that underlies automated methods in computer vision and machine learning, such as image retrieval and fine-grained recognition, often comes from crowdsourcing. In contexts that rely on the intrinsic motivation of users, we seek to understand how the application design affects a user's willingness to contribute and the quantity and quality of the data they capture. In this project, we designed three versions of a camera-based mobile crowdsourcing application, which varied in the amount of labeling effort requested of the user and conducted a user study to evaluate the trade-off between the level of user-contributed information requested and the quantity and quality of labeled images collected. The results suggest that higher levels of user labeling do not lead to reduced contribution. Users collected and annotated the most images using the application version with the highest requested level of labeling with no decrease in user satisfaction. In preliminary experiments, the additional labeled data supported increased performance on an image retrieval task.
Read more9/6/2024