This workshop on pilot implementation has three main objectives:
- To help mature pilot implementation as a technique for evaluating human-work interaction designs during the process of their development and implementation.
- To collect case studies that analyze experiences – good and bad – with conducting and learning from pilot implementations.
- To formulate a research agenda for future work on pilot implementations – addressing their strengths, limitations, conduct, impact, and so forth.
Pilot implementations are field tests of properly engineered, yet unfinished, systems. In contrast to lab tests, the users in a pilot implementation use the system for performing real work. In contrast to full-scale implementations, the objective of a pilot implementation is to learn. The workshop on pilot implementation aims to (a) help mature this technique for evaluating human-work interaction designs during the process of their development and implementation, (b) collect case studies that analyze experiences with conducting and learning from pilot implementations, and (c) formulate a research agenda for future work on pilot implementations – addressing their strengths, limitations, conduct, impact, and so forth. The target audience for the workshop is researchers and practitioners working on topics related to work analysis, interaction design, system-organization fit, organizational implementation, benefits realization, and in-the-wild evaluation.
The relevant topics include, but are not limited to, the following:
- Sociotechnical aspects of user experiences in pilot implementation
- Pilot implementation of digital twins system
- Pilot implementation in virtual reality
- Pilot implementation and issues of legacy systems and interoperability
- Organizational alignment with pilot implementation
- Making sense of pilot implementation testing data with information visualisation
- End-User Development in pilot implementation
- Cognitive breakdowns in remote pilot implementation tests
For further information, please read the workshop description paper.
University of Copenhagen, Denmark
Arminda Guerra Lopes
Pol. Inst. of Castelo Branco + ITI/Larsys, Portugal
Barbara Rita Barricelli
Università degli Studi di Brescia, Italy.
ITI/Larsys, University of Madeira, Portugal
Vishwakarma Institute of Technology (VIT), India
José Abdelnour Nocera
UWL, UK + ITI/Larsys, Portugal
ITI/Larsys, University of Madeira, Portugal
Copenhagen Business School, Denmark
Timezone: GMT+2 (Italy)
Welcome T. Clemmensen
Introduction to pilot implementation M. Hertzum
SESSION 1 - Presentation of position papers Chair: T. Clemmensen
[Each paper has 5 mins presentation + 5 mins Q+A]
Dropping a bomb or providing a gentle loving touch? Towards a relation artefact theory of pilot implementation (T. Clemmensen)
AttnGAN: Realistic text-to-image synthesis with attentional generative adversarial networks (S. Mathesul, G. Bhutkar, A. Rambhad)
Prototype design of a multi-modal AI-based web application for hateful content detection in social media posts (T. Pradhan, B. Padamwar, G. Bhutkar, A. Pangaonkar, S. Pareek, K. Partani)
Driver-vehicle interaction analysis: Pilot implementation for driver behavior classification using smartphone sensor data (P. Wawage, Y. Deshpande)
University digital engagement of students (M. C. Pereira, J. C. Ferreira, S. Moro, F. Gonçalves)
Pilot implementation in virtual reality: Pitfalls, tensions and organizational issues (C. França, M. Sousa, F. Gonçalves, É. R. Gouveia, B. Gouveia, P. Campos)
Socio-technical and collaborative design of pilot implementations of digital twins (B. R. Barricelli)
Co-designing workshop as pilot implementation for complex workplaces (P. Saadati, J. Abdelnour-Nocera, T. Clemmensen)
Mental happiness - A pilot implementation for elderly people (A. G. Lopes, I. Cerejo)
Pilot implementation: Organizational alignment when implementing an IT-system (L. K..Herbæk, C. E. D. Hansen, T. Clemmensen)
Usability evaluation of mobile app to support road safety (S. Salve, G. Bhutkar)
SESSION 2 - Plenary Chair: T. Clemmensen
SWOT (strengths, weaknesses, opportunities, threats) analysis of pilot implementation, as opposed to usability testing and (the early stages of) full-scale implementation
Wrap up Chair: M. Hertzum
End of workshop
The workshop proceedings are available here: DOWNLOAD (PDF)
For further information, send an email to: hertzum [at] acm [dot] org