In this chapter, we introduce the notion of simple context-free decision processes, which are an extension of episodic finite-state Markov decision processes (MDPs). Intuitively, a simple context-free decision process can be thought of as an episodic finite-state MDP wi...

1.1 Background Humanoid robots, like the Honda’s ASIMO1, have been developed and such machines will be expected to help people to do a variety of tasks in every day life. Then robots that exist in the same dynamic environment as humans should be able to interact with hu...

This work was supported by JSPS KAKENHI Grant Number JP19K00231.

<p>In the Pliocene Model Intercomparison Project Phase 2 (PlioMIP2), coupled climate models have been used to simulate an interglacial climate during the mid-Piacenzian warm period (mPWP; 3.264 to 3.025 <span class="inline-formula">Ma</span>). Here, we compare the Atlan...

<p>We report the results of friction experiments on brucite under both dry and wet conditions under various normal stresses (10–60 <span class="inline-formula">MPa</span>). The final friction coefficients of brucite were determined to be 0.40 and 0.26 for the dry and we...

<p>The dominant modes of climate variability on interannual timescales in the tropical Indian Ocean are the El Niño–Southern Oscillation (ENSO) and the Indian Ocean Dipole. El Niño events have occurred more frequently during recent decades, and it has been suggested tha...

Long Short-Term Memory recurrent neural network (LSTM) is widely used and known to capture informative long-term syntactic dependencies. However, how such information are reflected in its internal vectors for natural text has not yet been sufficiently investigated. We a...

It is commonly assumed that the energy density of the Universe was dominated by radiation between reheating after inflation and the onset of matter domination 54,000 years later. While the abundance of light elements indicates that the Universe was radiation dominated d...

<p>Drilling fluid infiltration during well drilling may induce pore pressure and strain perturbations in neighbored reservoir formations. In this study, we report that such small strain changes (<span class="inline-formula">∼20</span> <span class="inline-formula">µ<i>ε<...

Collector's seals provide important clues about the ownership of a book. They contain much information pertaining to the essential elements of ancient materials and also show the details of possession, its relation to the book, the identity of the collectors and their s...