Pilot Implementation:

Testing Human-Work Interaction Designs

31 August 2021, Bari, Italy

In conjunction with INTERACT 2021

Theme

This workshop on pilot implementation has three main objectives:

  • To help mature pilot implementation as a technique for evaluating human-work interaction designs during the process of their development and implementation.
  • To collect case studies that analyze experiences – good and bad – with conducting and learning from pilot implementations.
  • To formulate a research agenda for future work on pilot implementations – addressing their strengths, limitations, conduct, impact, and so forth.

Pilot implementations are field tests of properly engineered, yet unfinished, systems. In contrast to lab tests, the users in a pilot implementation use the system for performing real work. In contrast to full-scale implementations, the objective of a pilot implementation is to learn. The workshop on pilot implementation aims to (a) help mature this technique for evaluating human-work interaction designs during the process of their development and implementation, (b) collect case studies that analyze experiences with conducting and learning from pilot implementations, and (c) formulate a research agenda for future work on pilot implementations – addressing their strengths, limitations, conduct, impact, and so forth. The target audience for the workshop is researchers and practitioners working on topics related to work analysis, interaction design, system-organization fit, organizational implementation, benefits realization, and in-the-wild evaluation.

The relevant topics include, but are not limited to, the following:

  • Sociotechnical aspects of user experiences in pilot implementation
  • Pilot implementation of digital twins system
  • Pilot implementation in virtual reality
  • Pilot implementation and issues of legacy systems and interoperability
  • Organizational alignment with pilot implementation
  • Making sense of pilot implementation testing data with information visualisation
  • End-User Development in pilot implementation
  • Cognitive breakdowns in remote pilot implementation tests

For further information, please read the workshop description paper.

Organizers

Morten Hertzum

Morten Hertzum

University of Copenhagen, Denmark

Arminda Guerra Lopes

Arminda Guerra Lopes

Pol. Inst. of Castelo Branco + ITI/Larsys, Portugal

Barbara Rita Barricelli

Barbara Rita Barricelli

Università degli Studi di Brescia, Italy.

Frederica Gonçalves

Frederica Gonçalves

ITI/Larsys, University of Madeira, Portugal

Ganesh Bhutkar

Ganesh Bhutkar

Vishwakarma Institute of Technology (VIT), India

José Abdelnour Nocera

José Abdelnour Nocera

UWL, UK + ITI/Larsys, Portugal

Pedro F. Campos

Pedro Campos

ITI/Larsys, University of Madeira, Portugal

Torkil Clemmensen

Torkil Clemmensen

Copenhagen Business School, Denmark

Program

Timezone: GMT+2 (Italy)

Welcome T. Clemmensen

Introduction to pilot implementation M. Hertzum

SESSION 1 - Presentation of position papers Chair: T. Clemmensen

[Each paper has 5 mins presentation + 5 mins Q+A]

Dropping a bomb or providing a gentle loving touch? Towards a relation artefact theory of pilot implementation (T. Clemmensen)

AttnGAN: Realistic text-to-image synthesis with attentional generative adversarial networks (S. Mathesul, G. Bhutkar, A. Rambhad)

Prototype design of a multi-modal AI-based web application for hateful content detection in social media posts (T. Pradhan, B. Padamwar, G. Bhutkar, A. Pangaonkar, S. Pareek, K. Partani)

Driver-vehicle interaction analysis: Pilot implementation for driver behavior classification using smartphone sensor data (P. Wawage, Y. Deshpande)

University digital engagement of students (M. C. Pereira, J. C. Ferreira, S. Moro, F. Gonçalves)

Pilot implementation in virtual reality: Pitfalls, tensions and organizational issues (C. França, M. Sousa, F. Gonçalves, É. R. Gouveia, B. Gouveia, P. Campos)

Break

Socio-technical and collaborative design of pilot implementations of digital twins (B. R. Barricelli)

Co-designing workshop as pilot implementation for complex workplaces (P. Saadati, J. Abdelnour-Nocera, T. Clemmensen)

Mental happiness - A pilot implementation for elderly people (A. G. Lopes, I. Cerejo)

Pilot implementation: Organizational alignment when implementing an IT-system (L. K..Herbæk, C. E. D. Hansen, T. Clemmensen)

Usability evaluation of mobile app to support road safety (S. Salve, G. Bhutkar)

SESSION 2 - Plenary Chair: T. Clemmensen

SWOT (strengths, weaknesses, opportunities, threats) analysis of pilot implementation, as opposed to usability testing and (the early stages of) full-scale implementation

Wrap up Chair: M. Hertzum

End of workshop

Proceedings

The workshop proceedings are available here: DOWNLOAD (PDF)

Contact Us

For further information, send an email to: hertzum [at] acm [dot] org