justin

Today I read a paper titled “Verbal Interactions in Virtual Worlds”

The abstract is:
We first discuss respective advantages of language interaction in virtual worlds and of using 3D images in dialogue systems.

Then, we describe an example of a verbal interaction system in virtual reality: Ulysse.

Ulysse is a conversational agent that helps a user navigate in virtual worlds.

It has been designed to be embedded in the representation of a participant of a virtual conference and it responds positively to motion orders.

Ulysse navigates the user’s viewpoint on his/her behalf in the virtual world.

On tests we carried out, we discovered that users, novices as well as experienced ones have difficulties moving in a 3D environment.

Agents such as Ulysse enable a user to carry out navigation motions that would have been impossible with classical interaction devices.

From the whole Ulysse system, we have stripped off a skeleton architecture that we have ported to VRML, Java, and Prolog.

We hope this skeleton helps the design of language applications in virtual worlds.

Today I read a paper titled “Forgetting Exceptions is Harmful in Language Learning”

The abstract is:
We show that in language learning, contrary to received wisdom, keeping exceptional training instances in memory can be beneficial for generalization accuracy.

We investigate this phenomenon empirically on a selection of benchmark natural language processing tasks: grapheme-to-phoneme conversion, part-of-speech tagging, prepositional-phrase attachment, and base noun phrase chunking.

In a first series of experiments we combine memory-based learning with training set editing techniques, in which instances are edited based on their typicality and class prediction strength.

Results show that editing exceptional instances (with low typicality or low class prediction strength) tends to harm generalization accuracy.

In a second series of experiments we compare memory-based learning and decision-tree learning methods on the same selection of tasks, and find that decision-tree learning often performs worse than memory-based learning.

Moreover, the decrease in performance can be linked to the degree of abstraction from exceptions (i.e., pruning or eagerness).

We provide explanations for both results in terms of the properties of the natural language processing tasks and the learning algorithms.

Today I read a paper titled “Word-Sense Disambiguation Using Decomposable Models”

The abstract is:
Most probabilistic classifiers used for word-sense disambiguation have either been based on only one contextual feature or have used a model that is simply assumed to characterize the interdependencies among multiple contextual features.

In this paper, a different approach to formulating a probabilistic model is presented along with a case study of the performance of models produced in this manner for the disambiguation of the noun “interest”.

We describe a method for formulating probabilistic models that use multiple contextual features for word-sense disambiguation, without requiring untested assumptions regarding the form of the model.

Using this approach, the joint distribution of all variables is described by only the most systematic variable interactions, thereby limiting the number of parameters to be estimated, supporting computational efficiency, and providing an understanding of the data..

Today I read a paper titled “The Minimum Expectation Selection Problem”

The abstract is:
We define the min-min expectation selection problem (resp.

max-min expectation selection problem) to be that of selecting k out of n given discrete probability distributions, to minimize (resp.

maximize) the expectation of the minimum value resulting when independent random variables are drawn from the selected distributions.

We assume each distribution has finitely many atoms.

Let d be the number of distinct values in the support of the distributions.

We show that if d is a constant greater than 2, the min-min expectation problem is NP-complete but admits a fully polynomial time approximation scheme.

For d an arbitrary integer, it is NP-hard to approximate the min-min expectation problem with any constant approximation factor.

The max-min expectation problem is polynomially solvable for constant d; we leave open its complexity for variable d.

We also show similar results for binary selection problems in which we must choose one distribution from each of n pairs of distributions.

Today I read a paper titled “The Generalized Universal Law of Generalization”

The abstract is:
It has been argued by Shepard that there is a robust psychological law that relates the distance between a pair of items in psychological space and the probability that they will be confused with each other.

Specifically, the probability of confusion is a negative exponential function of the distance between the pair of items.

In experimental contexts, distance is typically defined in terms of a multidimensional Euclidean space-but this assumption seems unlikely to hold for complex stimuli.

We show that, nonetheless, the Universal Law of Generalization can be derived in the more complex setting of arbitrary stimuli, using a much more universal measure of distance.

This universal distance is defined as the length of the shortest program that transforms the representations of the two items of interest into one another: the algorithmic information distance.

It is universal in the sense that it minorizes every computable distance: it is the smallest computable distance.

We show that the universal law of generalization holds with probability going to one-provided the confusion probabilities are computable.

We also give a mathematically more appealing form .

Today I read a paper titled “On the Information Engine of Circuit Design”

The abstract is:
This paper addresses a new approach to find a spectrum of information measures for the process of digital circuit synthesis.

We consider the problem from the information engine point of view.

The circuit synthesis as a whole and different steps of the design process (an example of decision diagram is given) are presented via such measurements as entropy, logical work and information vitality.

We also introduce new information measures to provide better estimates of synthesis criteria.

We show that the basic properties of information engine, such as the conservation law of information flow and the equilibrium law of information can be formulated.

Today I read a paper titled “Using Tree Automata and Regular Expressions to Manipulate Hierarchically Structured Data”

The abstract is:
Information, stored or transmitted in digital form, is often structured.

Individual data records are usually represented as hierarchies of their elements.

Together, records form larger structures.

Information processing applications have to take account of this structuring, which assigns different semantics to different data elements or records.

Big variety of structural schemata in use today often requires much flexibility from applications–for example, to process information coming from different sources.

To ensure application interoperability, translators are needed that can convert one structure into another.

This paper puts forward a formal data model aimed at supporting hierarchical data processing in a simple and flexible way.

The model is based on and extends results of two classical theories, studying finite string and tree automata.

The concept of finite automata and regular languages is applied to the case of arbitrarily structured tree-like hierarchical data records, represented as “structured strings.” These automata are compared with classical string and tree automata; the model is shown to be a superset of the classical models.

Regular grammars and expressions over structured strings are introduced.

Regular expression matching and substitution has been widely used for efficient unstructured text processing; the model described here brings the power of this proven technique to applications that deal with information trees.

A simple generic alternative is offered to replace today’s specialised ad-hoc approaches.

The model unifies structural and content transformations, providing applications with a single data type.

An example scenario of how to build applications based on this theory is discussed.

Further research directions are outlined.

Today I read a paper titled “Semiclassical Neural Network”

The abstract is:
We have constructed a simple semiclassical model of neural network where neurons have quantum links with one another in a chosen way and affect one another in a fashion analogous to action potentials.

We have examined the role of stochasticity introduced by the quantum potential and compare the system with the classical system of an integrate-and-fire model by Hopfield.

Average periodicity and short term retentivity of input memory are noted.