Testing ‘AI’: do we have a situation?

Abstract

This working paper is based on the transcription of a recent conversation between the authors, regarding current instances of the real-world testing of “AI” and the “situations” they have given rise to, or as the case may be, not. The conversation took place online, on the 25th of May 2022, as part of the Lecture Series Testing Infrastructures, organized by the Special Collaborative Research Center (CRC) 1187 “Media of Cooperation” at the University of Siegen, Germany. This working paper is an elaborated version of this conversation and is organised as follows. The introduction presents an expanded version of the lecture abstract, which was used to advertise the online conversation. The bulk of the working paper reproduces and extends the transcribed conversation, as well as parts of the ensuing discussion with the audience. In the conclusion, we address the question “do we have a situation?,” when it comes to AI testing in society, in the light of the conversation, and reflect on “what’s next” in social studies of “AI” testing situations, as well as on turn-taking in (online) conversation.