CSDH - ‘AI-powered research assistant’ and the invisible transformations of research practices

2026-06-03

Introduction

This presentation highlights the added value of creating environments that foster serendipity as opposed to strict findability in the context of documentary search driven by “AI-research-assistant”.

Outline

  1. Context: AI research assistants and documentary research
  2. Serendipity as an epistemological alternative to the discoverability regime materialized by current AI tools.
  3. Proposals for developing tools that value human agency.

AI Assistants and Documentary Research

Basic Definitions

AI: “automation of cognition” Abbass (2021)

Documentary Research: human led process of research and selection of documents.

Information Retrieval: technical matching between a query and one or more documents.

From Traditional Search Engines

Google Scholar basics

To “AI-research assistants”

Google Scholar Labs provides an explanation for the article’s presence in the results list

In order to understand the implications of the integration of “AI-based systems” within information retrieval infrastructure, let’s look at the possible places of its intervention.

Typology of possible AI interventions in scientific production ecosystem

  1. Writing/rephrasing
  2. Metadata creation: disambiguation, keyword creation, subject classification, abstract generation.
  3. Query expansion: thesaurus, ontology vs. query expansion
  4. Information retrieval method: lexical search (boolean, regex, TF-IDF, BM25) vs. so-called semantic search (vector comparison).
  5. Ranking of result list
  6. Enrichment of the results list
  7. Synthesis and analysis of sources: RAG, deep search

Typology based on Tay (2025).

Deep research with Undermind.ai

source

Evaluation of LLM-based applications from the user point of view

Evaluation of RAG and AI Research Tools : Archambault and Rincón (2024); Patterson et al. (2025)

Evaluation of recommander systems : Raza et al. (2025).

Broad design principles for RAG for historical corpus (Puren et al. 2026) :

  • traceability
  • contextualisation
  • auditability : transformations should be notified and evaluation can be made from a grid of clear criteria.

Design principles

Concrete proposals for Archival AI assistants : Finn et al. (2026) : 7 design principles :

  • narrow over general purposes
  • search over analysis
  • tailor to collection first, user second
  • elucidate complexity
  • rigorous and open evaluation
  • transparency in design and communication
  • enable informed usage

For Research Assistants :

  • Tay (2026) focussing on reducing the “blank-box” effect of deep search applications :
    • suggesting guiding sample prompts
    • creating hybrid UI with explicit filters (ex: for period ranges, doc types)
    • autocomplete guiding the prompts based on actual constraints
    • user validation of the LLM parsing of the initial prompt
    • explicit limitations of the systems
    • templates for common tasks

Serendipity as an Epistemological Alternative

Discoverability

Innovation and research depend heavily on our ability to make new semantic connections.

Two faces:

  • Findability: accessing the information one is looking for (document indexing side)
  • Serendipity: accidentally accessing what one did not know one did not know (user side)

Thesis:

Current AI research assistants focus mainly on findability to meet basic search engine standards; however, because they inherently incorporate interpretative steps, making serendipity a core design goal could be a valuable direction to pursue.

Serendipity is a process of filtering and connecting with new information : as a design goal, it means putting at the center human judgment.

Serendipity

Serendipity is both the process and the result of a ‘chance encounter’.

Modeling of serendipity (Makri and Blandford 2012)

Importance of the reflexive dimension to distinguish serendipity from chance.

Serendipity in Science

Exploratory and serendipitous approaches in documentary research:

Challenges for the Design of Environment Favoring Serendipity

Reproducibility and memory: how can we keep track of an exploratory path? how can we help a person recall the many steps leading to a resolution (Sanda Erdelez 2004)?

Evaluation: how can we evaluate the impact of a finding? or the interest of a new search feature (Pouyllau 2023, 2025)? how can we cater to all in a highly subjective process without falling into personalization bias (e.g. filter bubbles (Pariser 2012))?

Questions

How can we design explainable systems that are at the center of environments that favor serendipity and critical exploration? And allow for reflexive interactions with the algorithm?

Proposals : 7 principles for the design of LLM-based applications focussing on serendipity in documentary research

Report as Support for Expertise

  • Complete reports tracing the algorithmic mediation of the user’s request to the response or list of articles returned (reranking criteria, query reformulation prompt, etc.).

  • Expose the tool’s limitations and capabilities Example: Barista, the query builder assistant on Impresso (Finn et al. 2026)

Finn et al. (2026)

Specialization of Classification and Quantification

Similar to the “narrow over generalisation”.

Specialized classification assists human judgment.

Example: Evidence-RAG from the Journal of Digital History: assists the editor in presenting the evaluation of an article: situates the relevance of a comment relative to the evaluated article (Guérard et al. 2026).

Make Room for Uncertainty

Expliciting uncertainties and tool limitations.

A paradigm shift that Digital Humanities approach can embrace:

« Can we conceive of models of interface that are genuine instruments for research? That are not merely queries within pre-set data that search and sort according to an immutable agenda? How can we imagine an interface that allows content modeling, intellectual argument, rhetorical engagement? » — (Drucker 2013)

Counterfactualization: identifying which explanatory variable should change in the algorithm to obtain a different result: make alternative possibilities explicit. (Chevillon 2026)

Example: the Provotype (Boer and Donovan 2012)

Exaptation and Imperfection

(evolution theory): “opportunistic selective adaptation, favoring characteristics that are useful for a new function, for which they were not initially selected.”

In other words : allowing the tool to become the result of a misuse in the process of appropriation (Tchounikine 2025).

Example: “Misappropriation” of the search function of Gallica’s famously flawed search engine (Dumas Primbault 2025)

Friction

Generative adversarial networks (GANs) (Goodfellow et al. 2014) and antagonistic AI (Cai, Arawjo, and Glassman 2024).

Spirit of contradiction: allowing correction and evaluation by the user. Schneider (2026) tomorrow at INKE !

Example: IEML-RS, a recommander system, (Schneider, Levy, and Vitali-Rosati 2026) allows for a basic semantic decomposition of a concept in 9 fixed facets (i.e. IEML), however the “translations” done by a LLM (prompted along with a few example), are mediocre encouraging the user to correct .

IEML-RS, selection of a keyword not translated into IEML - automatic translation with gemini

Exploration Through Disorderliness

Example: françaiS au pluriel (Suchet 2026)

françaiS au pluriel: tree structure

françaiS au pluriel: superposition

françaiS au pluriel: history

Value in Underexplored Facets

Highlight underexplored semantic facets to offer other paths.

Example: typology of citation type -> citation network beyond quantification

Visualization of citation disagreement on a corpus of articles from the journal Itinéraires (in development: classifications are randomized)

Visualization by citation type for an article (in development: classifications and scores randomized)

Conclusion

Frictionless interfaces tend to blur the lines between research and analysis whereas environments fostering a reflective process of selection help put value into the findings themselves.

Acknowledgements

This work benefited from a grant thanks to funding from the Consulat General de France au Quebec and the Fonds de recherche du Québec, which enabled a research stay at the Huma-Num Lab via the Sophie Germain mobility grant. https://doi.org/10.69777/381645

Research funded by the CRSH through the Revue3.0 partnership project as well as a grant from the Circé Network for mutualization and research for scientific journals.

Bibliography

Abbass, Hussein. 2021. “Editorial: What Is Artificial Intelligence?” IEEE Transactions on Artificial Intelligence 2 (2): 94–95. https://doi.org/10.1109/TAI.2021.3096243.
Archambault, Susan, and José Rincón. 2024. “An Evaluation of Cutting-Edge AI Research Tools Using the REACT Framework.” Computers in Libraries 44 (8).
Bates, Marcia J. 1989. “The Design of Browsing and Berrypicking Techniques for the Online Search Interface.” Online Review 13 (5): 407–24. https://doi.org/10.1108/eb024320.
Björneborn, Lennart. 2022. “Adjacent Possible.” In The Palgrave Encyclopedia of the Possible, edited by Vlad Petre Glăveanu, 16–28. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-90913-0_100.
Boer, Laurens, and Jared Donovan. 2012. “Provotypes for Participatory Innovation.” In Proceedings of the Designing Interactive Systems Conference, 388–97. Newcastle Upon Tyne United Kingdom: ACM. https://doi.org/10.1145/2317956.2318014.
Cai, Alice, Ian Arawjo, and Elena L. Glassman. 2024. “Antagonistic AI.” arXiv. https://doi.org/10.48550/arXiv.2402.07350.
Chevillon, Guillaume. 2026. Algorithmes queers: perturber les technologies, imaginer nos futurs. Culture 22. Montreuil: Éditions B42.
Drucker, Johanna. 2013. “Performative Materiality and Theoretical Approaches to Interface.” Digital Humanities Quarterly 007 (1).
Dumas Primbault, Simon. 2023. “Naviguer dans les savoirs à l’ère numérique. Pour une ethnographie des pratiques informationnelles sur Gallica.” Études de communication. langages, information, médiations, no. 61 (December): 61–89. https://doi.org/10.4000/edc.16108.
———. 2025. “La Découvrabilité Comme ”Prise” - Pratiques de Détournement Du Moteur de Recherche de Gallica.” In Découvrabilité Des Contenus Culturels Et Scientifitques, edited by Lise Verlaet and Chloé Delaporte. Montpellier, France.
Erdelez, Sanda. 2004. “Investigation of Information Encountering in the Controlled Research Environment.” Information Processing & Management 40 (6): 1013–25. https://doi.org/10.1016/j.ipm.2004.02.002.
Erdelez, Sandra. 1999. “Information Encountering: It’s More Than Just Bumping into Information.” Bulletin of the American Society for Information Science and Technology 25 (3): 26–29. https://doi.org/10.1002/bult.118.
Finn, Finola, Donal Khosrowi, Caio Mello, Marten Düring, and Danielle Guido. 2026. “Shaping History, Responsibly: Seven Principles to Guide the Design of Archival AI Assistants for Cultural Heritage Collections.” In ACM FAccT. Montréal.
Goodfellow, Ian J., Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. “Generative Adversarial Networks.” arXiv. https://doi.org/10.48550/arXiv.1406.2661.
Guérard, Élisabeth, Mehrdad Almasi, Marion Salaün, and Frédéric Clavert. 2026. “Towards an Interactive ‘Evidence-RAG’ Peer- Review Workspace for the Journal of Digital History.” Long {{Talk}}. Esch-sur-Alzette.
Kauffman, Stuart A. 1996. “Investigations.” Working {{Papers}} 96-08-072. Santa Fe Institute. https://doi.org/None.
Makri, Stephann, and Ann Blandford. 2012. “Coming Across Information Serendipitously – Part 1: A Process Model.” Journal of Documentation 68 (5): 684–705. https://doi.org/10.1108/00220411211256030.
Monechi, Bernardo, Ãlvaro Ruiz-Serrano, Francesca Tria, and Vittorio Loreto. 2017. “Waves of Novelties in the Expansion into the Adjacent Possible.” PLOS ONE 12 (6): e0179303. https://doi.org/10.1371/journal.pone.0179303.
Pariser, Eli. 2012. The Filter Bubble: What The Internet Is Hiding From You. London: Penguin.
Patterson, Brandon, Carlos Flores, Nick Hauschild, and Jared Branch. 2025. “Which AI Tools Work Best for Research? Using Librarian and Student Perspectives to Inform a Rating Rubric.” Journal of Electronic Resources in Medical Libraries 22 (3): 133–38. https://doi.org/10.1080/15424065.2025.2546052.
Pouyllau, Stéphane. 2023. “Utiliser isidore.science : un regard sur les usages d’un moteur de recherche académique.” {Keynote}.
———. 2025. “<< Durabilité et refactorisation des instruments de la recherche en SHS : le cas d’isidore.science et le projet ISIDORE 2030 >>.” Montréal.
Puren, Marie, Donghan Bian, Aurélien Pellet, Julien Perez, and Florian Cafiero. 2026. “Aligner méthode historique et RAG: transformer un assistant conversationnel en chaîne de preuve auditable et discutable.”
Raza, Shaina, Mizanur Rahman, Safiullah Kamawal, Armin Toroghi, Ananya Raval, Farshad Navah, and Amirmohammad Kazemeini. 2025. “A Comprehensive Review of Recommender Systems: Transitioning from Theory to Practice.” arXiv. https://doi.org/10.48550/arXiv.2407.13699.
Schneider, Alexia. 2026. “An Imperfect AI to Uphold Human Agency : Vindicating the ‘Yes but’ of This World.” Short {{Talk}}. Montréal.
Schneider, Alexia, Pierre Levy, and Marcello Vitali-Rosati. 2026. “Reclaiming Epistemic Agency in AI-Assisted Research: A Recommender System That Reveals, Rather Than Hides, IR Logic.” Daejeon, South Corea.
Suchet, Myriam. 2026. “En françaiS Au Pluriel.” En françaiS Au Pluriel. https://www.enfrancaisaupluriel.fr/pages/266.
Tay, Aaron. 2025. “What Do We Actually Mean by "AI-Powered Search"?” Substack Newsletter. Aaron Tay’s Musings about Librarianship.
———. 2026. “The Blank Box Problem: Why It’s Harder Than Ever to Know What to Type Into an AI Search Bar.” Substack Newsletter. Aaron Tay’s Musings about Librarianship.
Tchounikine, Pierre. 2025. Appropriating Technology: How We Make Digital Tools Our Own. Edited by Victor Kaptelinin, Kirsten A. Foot, and Bonnie A. Nardi. Acting with Technology. Cambridge, MA, USA: MIT Press.

Ecosystem of production and dissemination of scientific papers

An ecosystem from article writing to the queries that allow it to be found: interactions between humans and digital tools