Fast Gaussian Process Regression using KD-trees

Fast Gaussian Process Regression using KD-trees

The computation required for Gaussian process regression with n training examples is about O(n3) during training and O(n) for each prediction. This makes Gaussian process regression too slow for large datasets. In this paper, we present a fast approximation method, based on kd-trees, that significantly reduces both the prediction and the training times of Gaussian […]

Transfer learning for text classification

Transfer learning for text classification

Linear text classification algorithms work by computing an inner product between a test document vector and a parameter vector. In many such algorithms, including naive Bayes and most TFIDF variants, the parameters are determined by some simple, closed-form, function of training set statistics; we call this mapping mapping from statistics to parameters, the parameter function. […]

On Local Rewards and the Scalability of Distributed Reinforcement Learning

On Local Rewards and the Scalability of Distributed Reinforcement Learning

We consider the scaling of the number of examples necessary to achieve good performance in distributed, cooperative, multi-agent reinforcement learning, as a function of the the number of agents n. We prove a worstcase lower bound showing that algorithms that rely solely on a global reward signal to learn policies confront a fundamental limit: They […]

Learning Vehicular Dynamics, with Application to Modeling Helicopters

Learning Vehicular Dynamics, with Application to Modeling Helicopters

We consider the problem of modeling a helicopter’s dynamics based on state-action trajectories collected from it. The contribution of this pa- per is two-fold. First, we consider the linear models such as learned by CIFER (the industry standard in helicopter identification), and show that the linear parameterization makes certain properties of dynamical sys- tems, such […]

Learning Depth from Single Monocular Images

Learning Depth from Single Monocular Images

We consider the task of depth estimation from a single monocular image. We take a supervised learning approach to this problem, in which we begin by collecting a training set of monocular images (of unstructured outdoor environments which include forests, trees, buildings, etc.) and their corresponding ground-truth depthmaps. Then, we apply supervised learning to predict […]

Contextual search and name disambiguation in email using graphs

Contextual search and name disambiguation in email using graphs

Similarity measures for text have historically been an important tool for solving information retrieval problems. In many interesting settings, however, documents are often closely connected to other documents, as well as other non-textual objects: for instance, email messages are connected to other messages via header information. In this paper we consider extended similarity metrics for […]

groupTime: Preference-Based Group Scheduling

groupTime: Preference-Based Group Scheduling

As our business, academic, and personal lives continue to move at an ever-faster pace, finding times for busy people to meet has become an art. One of the most perplexing challenges facing groupware is effective asynchronous group scheduling (GS). This paper presents a lightweight interaction model for GS that can extend its reach beyond users […]

A Dynamic Bayesian Network Model for Autonomous 3D Reconstruction from a Single Indoor Image

A Dynamic Bayesian Network Model for Autonomous 3D Reconstruction from a Single Indoor Image

When we look at a picture, our prior knowledge about the world allows us to resolve some of the ambiguities that are inherent to monocular vision, and thereby infer 3d information about the scene. We also recognize different objects, decide on their orientations, and identify how they are connected to their environment. Focusing on the […]

Learning Factor Graphs in Polynomial Time and Sample Complexity

Learning Factor Graphs in Polynomial Time and Sample Complexity

We study the computational and sample complexity of parameter and structure learning in graphical models. Our main result shows that the class of factor graphs with bounded degree can be learned in polynomial time and from a polynomial number of training examples, assuming that the data is generated by a network in this class. This […]

Bayesian Estimation for Autonomous Object Manipulation Based on Tactile Sensors

Bayesian Estimation for Autonomous Object Manipulation Based on Tactile Sensors

We consider the problem of autonomously estimating position and orientation of an object from tactile data. When initial uncertainty is high, estimation of all six parameters precisely is computationally expensive. We propose an efficient Bayesian approach that is able to estimate all six parameters in both unimodal and multimodal scenarios. The approach is termed Scaling […]

Quadruped Robot Obstacle Negotiation Via Reinforcement Learning

Quadruped Robot Obstacle Negotiation Via Reinforcement Learning

Legged robots can, in principle, traverse a large variety of obstacles and terrains. In this paper, we describe a successful application of reinforcement learning to the problem of negotiating obstacles with a quadruped robot. Our algorithm is based on a two-level hierarchical decomposition of the task, in which the high-level controller selects the sequence of […]

Solving the problem of cascading errors: Approximate Bayesian inference for linguistic annotation pipelines

Solving the problem of cascading errors: Approximate Bayesian inference for linguistic annotation pipelines

The end-to-end performance of natural language processing systems for compound tasks, such as question answering and textual entailment, is often hampered by use of a greedy 1-best pipeline architecture, which causes errors to propagate and compound at each stage. We present a novel architecture, which models these pipelines as Bayesian networks, with each low level […]