For best experience please turn on javascript and use a modern browser!
You are using a browser that is no longer supported by Microsoft. Please upgrade your browser. The site may not present itself correctly if you continue browsing.

The Digital Methods Initiative (DMI), Amsterdam, is holding its annual Winter School on 'Chatbots for Internet Research?'. The format is that of a (social media and web) data sprint, with tutorials as well as hands-on work for telling stories with data. There is also a programme of keynote speakers. It is intended for advanced Master's students, PhD candidates and motivated scholars who would like to work on (and complete) a digital methods project in an intensive workshop setting. 

Digital Methods Programme
Classes are interactive and web-intensive (Photo: Anne Helmond)

Chatbots and LLMs for Internet Research? Towards a Reflexive Approach

Positions now are increasingly staked out in the debate concerning the application of chatbots and LLMs to social and cultural research. On the one hand there is the question of ‘automating’ methods and shifting some additional part of the epistemological burden to machines. On the other hand there is the rejoinder that chatbots may well be adequate research buddies, assisting with (among other things) burdensome and repetitive tasks such as coding and annotating data sets. They seem to be continually improving, or at least growing in size and apparent promise.

Researcher experiences are now widely reported: chatbots have outperformed human coders, ‘understanding’ rather nuanced stance-taking language and correctly labeling it better than average coders. But other work has found that the LLM labeling also has the tendency to be bland, given how the filters and safety guardrails (particularly in US-based chatbots) tend to depoliticise or otherwise soften their responses. As researcher experience with LLMs becomes more widely reported, there are user guides and best practices designed to make LLM findings more robust. Models should be carefully chosen, persona’s should be well developed, prompting should be conversational and so forth. LLM critique is also developing apace, with (comparative) audits interrogating underlying discrimination and bias that are only papered over by filters.

At this year’s Digital Methods Winter School we will explore these research practices with chatbots and LLMs for internet research, with an emphasis on bringing them together. How to deploy and critique chatbots and LLMs at the same time, in a form of reflexive usage?

Course information:

  • Dates: 6 -10 January 2025
  • Tuition fee: € 695
  • Application deadline: Rolling admissions until 9 December 2024
  • Academic director: Richard Rogers
  • Academic level: all graduate levels - Master's, PhD candidates and professionals/scholars
  • Credits: 6 ECTS 
  • Field of study: New Media and Digital Culture
  • Location: Faculty of Humanities, Media Studies, Turfdraagsterpad 9, Amsterdam
Prof. dr. R.A. (Richard) Rogers

Faculty of Humanities

Departement Mediastudies

More information

For all details about this Winter Course, please visit the Digital Methods website below. 

Previous editions

For a preview of what the event is like, you can view short video clips from previous editions of the Winter School on YouTube.

Facts & Figures
Mode
Full-time
Credits
6 ECTS, 1 weeks
Language of instruction
English
Starts in
January