Skip to content

Commit

Permalink
Merge pull request #41 from cohure/dev
Browse files Browse the repository at this point in the history
Programme: Add all papers as individual subpages and update the programme
  • Loading branch information
MinaAlmasi authored Nov 12, 2024
2 parents 19bf9e9 + 361b95e commit 2945ae4
Show file tree
Hide file tree
Showing 120 changed files with 14,944 additions and 88 deletions.
142 changes: 142 additions & 0 deletions content/papers.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,142 @@
---
title: "Accepted Papers"
---


<style>
h3 {
font-weight: bold;
}
.paper-entry {
font-size: 1.3em;
margin-bottom: 1.5em;
}
.paper-title {
display: block;
}
.paper-authors {
margin-left: 2em; /* indent authors */
display: block;
}
</style>


### Session 1A: Visual Arts and Art History

<p class="paper-entry"><a href="/papers/paper20" class="paper-title">Viability of Zero-Shot Classification and Search of Historical Photos</a><span class="paper-authors">Erika Maksimova, Mari-Anna Meimer, Mari Piirsalu and Priit Järv</span></p>
<p class="paper-entry"><a href="/papers/paper71" class="paper-title">Transformation of Composition and Gaze Interaction in Noli Me Tangere Depictions from 1300–1600</a><span class="paper-authors">Pepe Ballesteros Zapata, Nina Arnold, Vappu Vilhelmiina Lukander, Ludovica Schaerf and Dario Negueruela del Castillo</span></p>
<p class="paper-entry"><a href="/papers/paper123" class="paper-title">Deciphering Still Life Artworks with Linked Open Data</a><span class="paper-authors">Bruno Sartini</span></p>
<p class="paper-entry"><a href="/papers/paper141" class="paper-title">Computational Segmentation of Wayang Kulit Video Recordings using a Cross-Attention Temporal Model</a><span class="paper-authors">Shawn Hong Wei Liew and Miguel Escobar Varela</span></p>
<p class="paper-entry"><a href="/papers/paper82" class="paper-title">Assessing Landscape Intervisibility and Prominence at Regional Scale</a><span class="paper-authors">Adela Sobotkova</span></p>


### Session 1B: Classification & Information Extraction

<p class="paper-entry"><a href="/papers/paper73" class="paper-title">Page Embeddings: Extracting and Classifying Historical Documents with Generic Vector Representations</a><span class="paper-authors">Carsten Schnober, Renate Smit, Manjusha Kuruppath, Kay Pepping, Leon van Wissen and Lodewijk Petram</span></p>
<p class="paper-entry"><a href="/papers/paper79" class="paper-title">Exploration of Event Extraction Techniques in Late Medieval and Early Modern Administrative Records</a><span class="paper-authors">Ismail Prada Ziegler</span></p>
<p class="paper-entry"><a href="/papers/paper130" class="paper-title">Characterizing the Subversion of Social Relationships on Television</a><span class="paper-authors">Kent Chang, Anna Ho and David Bamman</span></p>
<p class="paper-entry"><a href="/papers/paper52" class="paper-title">Extracting social connections from Finnish Karelian refugee interviews using LLMs</a><span class="paper-authors">Joonatan Laato, Jenna Kanerva, John Loehr, Virpi Lummaa and Filip Ginter</span></p>


### Session 2A: Literature

<p class="paper-entry"><a href="/papers/paper19" class="paper-title">Literary Time Travel: Distinguishing Past and Contemporary Worlds in Danish and Norwegian Fiction</a><span class="paper-authors">Jens Bjerring-Hansen, Ali Al-Laith, Daniel Hershcovich, Alexander Conroy and Sebastian Ørtoft Rasmussen</span></p>
<p class="paper-entry"><a href="/papers/paper59" class="paper-title">Recognizing Non-named Spatial Entities in Literary Texts: A Novel Spatial Entities Classifier</a><span class="paper-authors">Daniel Kababgi, Giulia Grisot, Federico Pennino and Berenike Herrmann</span></p>
<p class="paper-entry"><a href="/papers/paper97" class="paper-title">Latent Structures of Intertextuality in French Fiction</a><span class="paper-authors">Jean Barré</span></p>
<p class="paper-entry"><a href="/papers/paper36" class="paper-title">Global Coherence, Local Uncertainty: Towards a Theoretical Framework for Assessing Literary Quality</a><span class="paper-authors">Yuri Bizzoni, Pascale Moreira and Kristoffer Nielbo</span></p>
<p class="paper-entry"><a href="/papers/paper90" class="paper-title">Animacy in German Folktales</a><span class="paper-authors">Julian Häußler, Janis von Keitz and Evelyn Gius</span></p>


### Session 2B: Semantic Analysis

<p class="paper-entry"><a href="/papers/paper6" class="paper-title">Quantitative Framework for Word-Color Association and Application to 20th Century Anglo-American Poetry</a><span class="paper-authors">Sungpil Wang and Juyong Park</span></p>
<p class="paper-entry"><a href="/papers/paper92" class="paper-title">Domain Adaptation with Linked Encyclopedic Data: A Case Study for Historical German</a><span class="paper-authors">Thora Hagen</span></p>
<p class="paper-entry"><a href="/papers/paper95" class="paper-title">Tracing the Development of the Virtual Particle Concept Using Semantic Change Detection</a><span class="paper-authors">Michael Zichert and Adrian Wüthrich</span></p>


### Session 3A: Literary Canon & Reception

<p class="paper-entry"><a href="/papers/paper76" class="paper-title">Literary Canonicity and Algorithmic Fairness: The Effect of Author Gender on Classification Models</a><span class="paper-authors">Ida Marie S. Lassen, Pascale Feldkamp, Yuri Bizzoni and Kristoffer Nielbo</span></p>
<p class="paper-entry"><a href="/papers/paper106" class="paper-title">Patterns of Quality: Comparing Reader Reception Across Fanfiction and Published Literature</a><span class="paper-authors">Mia Jacobsen, Pascale Moreira, Kristoffer Nielbo and Yuri Bizzoni</span></p>
<p class="paper-entry"><a href="/papers/paper86" class="paper-title">Univariate Statistical Analysis of a Non-Canonical Literary Genre: Quantifying German-Language One-Act Plays (1740–1850)</a><span class="paper-authors">Viktor J. Illmer, Dîlan Canan Çakir, Frank Fischer and Lilly Welz</span></p>


### Session 3B: Stylometry

<p class="paper-entry"><a href="/papers/paper15" class="paper-title">Abbreviation Application: A Stylochronometric Study of Abbreviations in the Oeuvre of Herne’s Speculum Scribe</a><span class="paper-authors">Caroline Vandyck and Mike Kestemont</span></p>
<p class="paper-entry"><a href="/papers/paper61" class="paper-title">Bootstrap Distance Imposters: High Precision Authorship Verification with Improved Interpretability</a><span class="paper-authors">Ben Nagy</span></p>
<p class="paper-entry"><a href="/papers/paper121" class="paper-title">Promises from an Inferential Approach in Classical Latin Authorship Attribution</a><span class="paper-authors">Giulio Tani Raffaelli</span></p>
<p class="paper-entry"><a href="/papers/paper9" class="paper-title">Multilingual Stylometry: The influence of language and corpus composition on the performance of authorship attribution using corpora from the European Literary Text Collection (ELTeC)</a><span class="paper-authors">Christof Schoech, Julia Dudar, Evgeniia Fileva and Artjoms Šeļa</span></p>


### Session 4A: Large Language Models

<p class="paper-entry"><a href="/papers/paper96" class="paper-title">Remember to forget: A study on verbatim memorization of literature in Large Language Models</a><span class="paper-authors">Xinhao Zhang, Olga Seminck and Pascal Amsili</span></p>
<p class="paper-entry"><a href="/papers/paper122" class="paper-title">A Preliminary Analysis of ChatGPT's Poetic Style</a><span class="paper-authors">Melanie Walsh, Anna Preus and Elizabeth Gronski</span></p>
<p class="paper-entry"><a href="/papers/paper119" class="paper-title">On Classification with Large Language Models in Cultural Analytics</a><span class="paper-authors">David Bamman, Kent Chang, Li Lucy and Naitian Zhou</span></p>


### Session 4B: Automatic Text Recognition

<p class="paper-entry"><a href="/papers/paper30" class="paper-title">Does Context Matter? Enhancing Handwritten Text Recognition with Metadata in Historical Manuscripts</a><span class="paper-authors">Benjamin Kiessling and Thibault Clérice</span></p>
<p class="paper-entry"><a href="/papers/paper35" class="paper-title">Enhancing Arabic Maghribi Handwritten Text Recognition with RASAM 2: A Comprehensive Dataset and Benchmarking</a><span class="paper-authors">Chahan Vidal-Gorène, Clément Salah, Noëmie Lucas, Aliénor Decours-Perez and Antoine Perrier</span></p>
<p class="paper-entry"><a href="/papers/paper110" class="paper-title">Steps Towards Mining Manuscript Images for Untranscribed Texts: A Case Study from the Syriac Collection at the Vatican Library</a><span class="paper-authors">Luigi Bambaci, George Kiraz, Christine M. Roughan, Daniel Stökl Ben Ezra and Matthieu Freyder</span></p>


### Session 5A: Linguistic Change

<p class="paper-entry"><a href="/papers/paper18" class="paper-title">Quantifying Linguistic and Cultural Change in China, 1900-1950</a><span class="paper-authors">Spencer Stewart</span></p>
<p class="paper-entry"><a href="/papers/paper21" class="paper-title">The Birth of French Orthography: A Computational Analysis of French Spelling Systems in Diachrony</a><span class="paper-authors">Simon Gabay and Thibault Clérice</span></p>
<p class="paper-entry"><a href="/papers/paper60" class="paper-title">SCIENCE IS EXPLORATION: Computational Frontiers for Conceptual Metaphor Theory</a><span class="paper-authors">Rebecca M. M. Hicke and Ross Deans Kristensen-McLachlan</span></p>


### Session 5B: Search & Discovery

<p class="paper-entry"><a href="/papers/paper1" class="paper-title">Explainable Search and Discovery of Visual Cultural Heritage Collections with Multimodal Large Language Models</a><span class="paper-authors">Taylor Arnold</span></p>
<p class="paper-entry"><a href="/papers/paper17" class="paper-title">Integrating Visual and Textual Inputs for Searching Large-Scale Map Collections with CLIP</a><span class="paper-authors">James Mahowald and Benjamin Lee</span></p>
<p class="paper-entry"><a href="/papers/paper55" class="paper-title">Visual Navigation of Digital Libraries: Retrieval and Classification of Images in the National Library of Norway’s Digitised Book Collection</a><span class="paper-authors">Marie Roald, Magnus Breder Birkenes and Lars Johnsen</span></p>


### Session 6A: Annotation

<p class="paper-entry"><a href="/papers/paper75" class="paper-title">Combining Automatic Annotation Tools with Human Validation for the Semantic Enrichment of Cultural Heritage Metadata</a><span class="paper-authors">Eirini Kaldeli, Alexandros Chortaras, Vassilis Lyberatos, Jason Liartis, Spyridon Kantarelis and Giorgos Stamou</span></p>
<p class="paper-entry"><a href="/papers/paper46" class="paper-title">Models of Literary Evaluation and Web 2.0: An Annotation Experiment with Goodreads Reviews</a><span class="paper-authors">Simone Rebora and Gabriele Vezzani</span></p>
<p class="paper-entry"><a href="/papers/paper62" class="paper-title">Addressing Uncertainty According to the Annotator’s Expertise in Archaeological Data Collections: an Approach from Fuzzy Logic</a><span class="paper-authors">Patricia Martin-Rodilla and Leticia Tobalina</span></p>
<p class="paper-entry"><a href="/papers/paper74" class="paper-title">Direct and Indirect Annotation with Generative AI: A Case Study into Finding Animals and Plants in Historical Text</a><span class="paper-authors">Arjan van Dalfsen, Folgert Karsdorp, Ayoub Bagheri, Thirza van Engelen, Dieuwertje Mentink and Els Stronks</span></p>


### Session 6B: Multilingualism & Translation Studies

<p class="paper-entry"><a href="/papers/paper104" class="paper-title">Textual Transmission without Borders: Multiple Multilingual Alignment and Stemmatology of the 'Lancelot en prose'</a><span class="paper-authors">Lucence Ing, Matthias Gille Levenson and Jean-Baptiste Camps</span></p>
<p class="paper-entry"><a href="/papers/paper128" class="paper-title">Automatic Translation Alignment Pipeline for Multilingual Digital Editions of Literary Works</a><span class="paper-authors">Maria Levchenko</span></p>
<p class="paper-entry"><a href="/papers/paper135" class="paper-title">Early Modern Book Catalogues and Multilingualism: Identifying Multilingual Texts and Translations Using Titles</a><span class="paper-authors">Yann Ciarán Ryan and Margherita Fantoli</span></p>
<p class="paper-entry"><a href="/papers/paper42" class="paper-title">Computational Paleography of Medieval Hebrew Scripts</a><span class="paper-authors">Berat Kurar-Barakat, Daria Vasyutinsky-Shapira, Sharva Gogawale, Mohammad Suliman and Nachum Dershowitz</span></p>


### Session 7A: Social Patterns

<p class="paper-entry"><a href="/papers/paper93" class="paper-title">And then I saw it: Testing Hypotheses on Turning Points in a Corpus of UFO Sighting Reports</a><span class="paper-authors">Jan Langenhorst, Robert C. Schuppe and Yannick Frommherz</span></p>
<p class="paper-entry"><a href="/papers/paper13" class="paper-title">Beyond the Register: Demographic Modeling of Arrest Patterns in 1879-1880 Brussels</a><span class="paper-authors">Folgert Karsdorp, Mike Kestemont and Margo De Koster</span></p>
<p class="paper-entry"><a href="/papers/paper39" class="paper-title">Epistemic Capture through Specialization in Post-World War II Parliamentary Debate</a><span class="paper-authors">Ruben Ros and Melvin Wevers</span></p>
<p class="paper-entry"><a href="/papers/paper94" class="paper-title">Revolution + Love: Measuring the Entanglements of Violence and Emotions in Post-1949 China</a><span class="paper-authors">Maciej Kurzynski</span></p>


### Session 7B: Measuring Emotion & Sentiment

<p class="paper-entry"><a href="/papers/paper67" class="paper-title">In the Context of Narrative, We Never Properly Defined the Concept of Valence</a><span class="paper-authors">Peter Boot, Angel Daza, Carsten Schnober and Willem van Hage</span></p>
<p class="paper-entry"><a href="/papers/paper98" class="paper-title">Sentiment Below the Surface: Omissive and Evocative Strategies in Literature and Beyond</a><span class="paper-authors">Pascale Feldkamp, Ea Lindhardt Overgaard, Kristoffer Nielbo and Yuri Bizzoni</span></p>
<p class="paper-entry"><a href="/papers/paper124" class="paper-title">Once More, With Feeling: Measuring Emotion of Acting Performances in Contemporary American Film</a><span class="paper-authors">Naitian Zhou and David Bamman</span></p>


### Session 8A: Cultural Dynamics

<p class="paper-entry"><a href="/papers/paper137" class="paper-title">On the Unity of Literary Change: The Development of Emotions in German Poetry, Prose, and Drama between 1850 and 1920 as a Test Case</a><span class="paper-authors">Leonard Konle, Merten Kröncke, Fotis Jannidis and Simone Winko</span></p>
<p class="paper-entry"><a href="/papers/paper49" class="paper-title">Context is Key(NMF): Modelling Topical Information Dynamics in Chinese Diaspora Media</a><span class="paper-authors">Ross Deans Kristensen-McLachlan, Rebecca M. M. Hicke, Márton Kardos and Mette Thunø</span></p>
<p class="paper-entry"><a href="/papers/paper70" class="paper-title">Locating the Leading Edge of Cultural Change</a><span class="paper-authors">Sarah Griebel, Becca Cohen, Lucian Li, Jiayu Liu, Jaihyun Park, Jana Perkins and Ted Underwood</span></p>


### Session 8B: Popular Media

<p class="paper-entry"><a href="/papers/paper132" class="paper-title">Treating Games as Plays? Computational Approaches to the Detection Scenes of Game Dialogs</a><span class="paper-authors">Martin Schlenk, Thomas Efer and Manuel Burghardt</span></p>
<p class="paper-entry"><a href="/papers/paper57" class="paper-title">Admiration and Frustration: A Multidimensional Analysis of Fanfiction</a><span class="paper-authors">Mia Jacobsen and Ross Deans Kristensen-McLachlan</span></p>
<p class="paper-entry"><a href="/papers/paper102" class="paper-title">Greatest Hits Versus Deep Cuts: Exploring Variety in Setlists Across Artists and Musical Genres</a><span class="paper-authors">Edward Abel and Andrew Goddard</span></p>
56 changes: 56 additions & 0 deletions content/papers/paper1.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,56 @@

<style>
h2 {
margin-top: 0;
margin-bottom: 1.5rem;
line-height: 1.3;
}

h3 {
margin-top: 2rem;
margin-bottom: 1rem;
font-size: 1.4rem;
font-weight:bold;
}

.metadata {
background-color: #f7fafc;
padding: 1rem;
border-radius: 6px;
margin-bottom: 2rem;
}

.metadata p {
margin: 0.5rem 0;
}

.abstract {
text-align: justify;
padding: 1rem;
background-color: #f7fafc;
border-left: 4px solid #2c5282;
border-radius: 0 6px 6px 0;
}

strong {
color: #2d3748;
font-weight: 600;
}
</style>
<main role="main">
<h2>Explainable Search and Discovery of Visual Cultural Heritage Collections with Multimodal Large Language Models</h2>

<section class="metadata">
<p style='font-size:1rem'><i>(long paper)</i></p>
<p><strong>Authors:</strong> Taylor Arnold</p>
<p><strong>Presented in</strong> <a href="/programme/#session5B">Session 5B: Search & Discovery</a></p>
<p><strong>Paper:</strong> <a href="https://ceur-ws.org/Vol-3558/paper1.pdf">Download PDF</a></p>
</section>

<section>
<h3>Abstract</h3>
<div class="abstract">
<p>Many cultural institutions have made large digitized visual collections available online, often under permissible re-use licences. Creating interfaces for exploring and searching these collections is difficult, particularly in the absence of granular metadata. In this paper, we introduce a method for using state-of-the-art multimodal large language models (LLMs) to enable an open-ended, explainable search and discovery interface for visual collections. We show how our approach can create novel clustering and recommendation systems that avoid common pitfalls of methods based directly on visual embeddings. Of particular interest is the ability to offer concrete textual explanations of each recommendation without the need to preselect the features of interest. Together, these features can create a digital interface that is more open-ended and flexible while also being better suited to addressing privacy and ethical concerns. Through a case study using a collection of documentary photographs, we provide several metrics showing the efficacy and possibilities of our approach.</p>
</div>
</section>
</main>
Loading

0 comments on commit 2945ae4

Please sign in to comment.