• Digital Humanities and Cultural Heritage
• Publicationsclose
• Research dataclose
• Other research productsclose
• 2013-2022close
• Article close
• 050105 experimental psychology close
• 050904 information & library sciences close
• European Commission close
• EU close
• English close
• Social Science and Humanities close

Abstract Ten years ago, researchers using event‐related brain potentials (ERPs) to study language comprehension were puzzled by what looked like a Semantic Illusion: Semantically anomalous, but structurally well‐formed sentences did not affect the N400 component—traditionally taken to reflect semantic integration—but instead produced a P600 effect, which is generally linked to syntactic processing. This finding led to a considerable amount of debate, and a number of complex processing models have been proposed as an explanation. What these models have in common is that they postulate two or more separate processing streams, in order to reconcile the Semantic Illusion and other semantically induced P600 effects with the traditional interpretations of the N400 and the P600. Recently, however, these multi‐stream models have been called into question, and a simpler single‐stream model has been proposed. According to this alternative model, the N400 component reflects the retrieval of word meaning from semantic memory, and the P600 component indexes the integration of this meaning into the unfolding utterance interpretation. In the present paper, we provide support for this “Retrieval–Integration (RI)” account by instantiating it as a neurocomputational model. This neurocomputational model is the first to successfully simulate the N400 and P600 amplitude in language comprehension, and simulations with this model provide a proof of concept of the single‐stream RI account of semantically induced patterns of N400 and P600 modulations.

In this article, the Mingei Online Platform is presented as an authoring platform for the representation of social and historic context encompassing a focal topic of interest. The proposed representation is employed in the contextualised presentation of a given topic, through documented narratives that support its presentation to diverse audiences. Using the obtained representation, the documentation and digital preservation of social and historical dimensions of Cultural Heritage are demonstrated. The implementation follows the Human-Centred Design approach and has been conducted under an iterative design and evaluation approach involving both usability and domain experts.

Korean can be transcribed in two different scripts, one alphabetic (Hangul) and one logographic (Hanja). How does the mental lexicon represent the contributions of multiple scripts? Hangul’s highly transparent one-to-one relationship between spellings and sounds creates homophones in spoken Korean that are also homographs in Hangul, which can only be disambiguated through Hanja. We thus tested whether native speakers encoded the semantic contributions of the different Hanja characters sharing the same homographic form in Hangul in their mental representation of Sino-Korean. Is processing modulated by the number of available meanings, that is, the size of the semantic cohort? In two cross-modal lexical decision tasks with semantic priming,participants were presented with auditory primes that were either syllables (Experiment 1) or full Sino-Korean words (Experiment 2), followed by visual Sino-Korean full word targets. In Experiment 1, reaction times were not significantly modulated by the size of the semantic cohort. However, in Experiment 2, we observed significantly faster reaction times for targets preceded by primes with larger semantic cohorts. We discuss these findings in relation to the structure of the mental lexicon for bi-scriptal languages and the representation of semantic cohorts across different scripts. 1. Introduction 2. Hanja and Hangul during processing 3. Experiment 1: Cross-modal fragment priming 3.1. Method 3.1.1. Participants 3.1.2. Materials and design 3.1.3. Procedure 3.2. Results 3.3. Discussion 4. Experiment 2: Cross-modal full word priming 4.1. Method 4.1.1. Participants 4.1.2. Materials and design 4.1.3. Procedure 4.2. Results 4.3. Discussion 5. General discussion 6. Conclusions

The current study examined the effects of variability on infant event-related potential (ERP) data editing methods. A widespread approach for analyzing infant ERPs is through a trial-by-trial editing process. Researchers identify electroencephalogram (EEG) channels containing artifacts and reject trials that are judged to contain excessive noise. This process can be performed manually by experienced researchers, partially automated by specialized software, or completely automated using an artifact-detection algorithm. Here, we compared the editing process from four different editors—three human experts and an automated algorithm—on the final ERP from an existing infant EEG dataset. Findings reveal that agreement between editors was low, for both the numbers of included trials and of interpolated channels. Critically, variability resulted in differences in the final ERP morphology and in the statistical results of the target ERP that each editor obtained. We also analyzed sources of disagreement by estimating the EEG characteristics that each human editor considered for accepting an ERP trial. In sum, our study reveals significant variability in ERP data editing pipelines, which has important consequences for the final ERP results. These findings represent an important step toward developing best practices for ERP editing methods in infancy research.

International audience; Recently, the field of musical co-creativity has gained some momentum. In this context, our goal is twofold: to develop an intelligent listening and predictive module of chord sequences, and to propose an adapted evaluation of the associated Music Information Retrieval (MIR) tasks that are the real-time extraction of musical chord labels from a live audio stream and the prediction of a possible continuation of the extracted symbolic sequence. Indeed, this application case invites us to raise questions about the evaluation processes and methodology that are currently applied to chord-based MIR models. In this paper, we focus on musical chords since these mid-level features are frequently used to describe harmonic progressions in Western music. In the case of chords, there exists some strong inherent hierarchical and functional relationships. However, most of the research in the field of MIR focuses mainly on the performance of chord-based statistical models, without considering music-based evaluation or learning. Indeed, usual evaluations are based on a binary qualification of the classification outputs (right chord predicted versus wrong chord predicted). Therefore, we present a specifically-tailored chord analyser to measure the performances of chord-based models in terms of functional qualification of the classification outputs (by taking into account the harmonic function of the chords). Then, in order to introduce musical knowledge into the learning process for the automatic chord extraction task, we propose a specific musical distance for comparing predicted and labeled chords. Finally, we conduct investigations into the impact of including high-level metadata in chord sequence prediction learning (such as information on key or downbeat position). We show that a model can obtain better performances in terms of accuracy or perplexity, but output biased results. At the same time, a model with a lower accuracy score can output errors with more musical meaning. Therefore, performing a goal-oriented evaluation allows a better understanding of the results and a more adapted design of MIR models.

Summary Can preverbal infants utilize logical reasoning such as disjunctive inference? This logical operation requires keeping two alternatives open (A or B), until one of them is eliminated (if not A), allowing the inference: B is true. We presented to 10-month-old infants an ambiguous situation in which a female voice was paired with two faces. Subsequently, one of the two faces was presented with the voice of a male. We measured infants' preference for the correct face when both faces and the initial voice were presented again. Infant pupillary response was measured and utilized as an indicator of cognitive load at the critical moment of disjunctive inference. We controlled for other possible explanations in three additional experiments. Our results show that 10-month-olds can correctly deploy disjunction and negation to disambiguate scenes, suggesting that disjunctive inference does not rely on linguistic constructs. Highlights • 10-month-old infants have no logical operators in their lexicon • Nevertheless, they can use logical deduction in case of an ambiguous situation • They correctly deduce which faces and voices are paired through disjunctive inference • Infants' performance in this task can be followed by measuring their pupil dilation Biological Science, Neuroscience, Cognitive neuroscience, Behavioral Neuroscience Graphical abstract

AbstractRadical empiricists at the turn of the twentieth century described organisms as experiencing the relations they maintain with their surroundings prior to any analytic separation from their environment. They notably avoided separating perception of the material environment from social life. This perspective on perceptual experience was to prove the inspiration for Gibson’s ecological approach to perceptual psychology. Gibson provided a theory of how the direct perception of the organism-environment relation is possible. Central to his account was the notion of a medium for direct perception. However Gibson provided two mutually inconsistent accounts of the medium leading to problems for his radical empiricism. We develop an account of the medium that does justice to ecological psychology’s radical empiricist roots. To complement this account of the medium we detail a usage-based account of information. Together they allow us to propose a novel radical empiricist view of direct perception. We then return to the notion of medium and expand it to include sociomaterial practices. We show how direct perception happens in the midst of social life, and is made possible by an active achieving and maintaining of a pragmatic relation with the environment.

This study applies relative entropy in naturalistic large-scale corpus to calculate the difference among L2 (second language) learners at different levels. We chose lemma, token, POStrigram, conjunction to represent lexicon and grammar to detect the patterns of language proficiency development among different L2 groups using relative entropy. The results show that information distribution discrimination regarding lexical and grammatical differences continues to increase from L2 learners at a lower level to those at a higher level. This result is consistent with the assumption that in the course of second language acquisition, L2 learners develop towards a more complex and diverse use of language. Meanwhile, this study uses the statistics method of time series to process the data on L2 differences yielded by traditional frequency-based methods processing the same L2 corpus to compare with the results of relative entropy. However, the results from the traditional methods rarely show regularity. As compared to the algorithms in traditional approaches, relative entropy performs much better in detecting L2 proficiency development. In this sense, we have developed an effective and practical algorithm for stably detecting and predicting the developments in L2 learners’ language proficiency. H2020 European Research Council

AbstractWhen speakers of two or more languages interact, they are likely to influence each other: contact leaves traces in the linguistic record, which in turn can reveal geographic areas of past human interaction and migration. However the complex, multi-dimensional nature of contact has hindered the development of a rigorous methodology for detecting its traces. Specifically, other factors may contribute to similarities between languages. Inheritance (a property is passed from an ancestor to several descendant languages), and universal preference (a property is universally preferred), may both overshadow contact signals. How can we find geographic contact areas in language data, while accounting for the confounding effects of inheritance and universal preference? We presentsBayes, an algorithm for Bayesian clustering in the presence of confounding effects. The algorithm learns which similarities in a set of features are better accounted for by confounders, and which are due to contact effects. Contact areas are free to take any shape or size, but an explicit geographic prior ensures their spatial coherence. We test the clustering method on simulated data and apply it in two case studies to reveal language contact in South America and the Balkans. Our results are supported by —mostly qualitative— findings from previous studies. While we focus on the specific problem of language contact, the method can also be used to uncover other traces of shared history in cultural evolution, and more generally, to reveal latent spatial clusters in the presence of confounders.

This study investigates the form of deictic gestures used by speakers of the Quiahije variety of Eastern Chatino (Otomangean, Zapotecan) spoken in Oaxaca, Mexico. An analysis of over six hours of interviews about local landmarks reveals that Quiahije Chatino speakers consistently use the far-is-up strategy to convey target distance in their deictic gestures—the farther the target, the higher and more expansive the form of the gesture. Participants in the study consistently used the far-is-up strategy to modify two types of deictic gestures: points and ‘go’ emblems (a gesture conveying forward motion). For points alone, participants combined the far-is-up strategy with the use of distinct handshapes for pointing to nearby versus distant targets. By systematically examining how deictic gestures are modified in one community in Mexico, this study lays the groundwork for further comparative and typological research on gestural deixis.