Previous Special Year Seminar

May
21
2020

Theoretical Machine Learning Seminar

Forecasting Epidemics and Pandemics
Roni Rosenfeld
3:00pm|Remote Access Only - see link below

Epidemiological forecasting is critically needed for decision making by national and local governments, public health officials, healthcare institutions and the general public. The Delphi group at Carnegie Mellon University was founded in 2012 to...

May
19
2020

Theoretical Machine Learning Seminar

Neural SDEs: Deep Generative Models in the Diffusion Limit
Maxim Raginsky
12:00pm|Remote Access Only - see link below

In deep generative models, the latent variable is generated by a time-inhomogeneous Markov chain, where at each time step we pass the current state through a parametric nonlinear map, such as a feedforward neural net, and add a small independent...

May
14
2020

Theoretical Machine Learning Seminar

MathZero, The Classification Problem, and Set-Theoretic Type Theory
David McAllester
3:00pm|Remote Access Only - see link below

AlphaZero learns to play go, chess and shogi at a superhuman level through self play given only the rules of the game. This raises the question of whether a similar thing could be done for mathematics --- a MathZero. MathZero would require a formal...

May
12
2020

Theoretical Machine Learning Seminar

Generative Modeling by Estimating Gradients of the Data Distribution
Stefano Ermon
12:00pm|Remote Access Only - see link below

Existing generative models are typically based on explicit representations of probability distributions (e.g., autoregressive or VAEs) or implicit sampling procedures (e.g., GANs). We propose an alternative approach based on modeling directly the...

May
07
2020

Theoretical Machine Learning Seminar

Learning probability distributions; What can, What can't be done
Shai Ben-David
3:00pm|Remote Access Only - see link below

A possible high level description of statistical learning is that it aims to learn about some unknown probability distribution ("environment”) from samples it generates ("training data”). In its most general form, assuming no prior knowledge and...

May
05
2020

Theoretical Machine Learning Seminar

Boosting Simple Learners
12:00pm|Remote Access Only - see link below

We study boosting algorithms under the assumption that the given weak learner outputs hypotheses from a class of bounded capacity. This assumption is inspired by the common convention that weak hypotheses are “rules-of-thumbs” from an “easy-to-learn...

Apr
30
2020

Theoretical Machine Learning Seminar

Latent Stochastic Differential Equations for Irregularly-Sampled Time Series
David Duvenaud
3:00pm|Remote Access Only - see link below

Much real-world data is sampled at irregular intervals, but most time series models require regularly-sampled data. Continuous-time models address this problem, but until now only deterministic (ODE) models or linear-Gaussian models were efficiently...

Apr
23
2020

Theoretical Machine Learning Seminar

Deep Generative models and Inverse Problems
Alexandros Dimakis
3:00pm|https://theias.zoom.us/j/384099138

Modern deep generative models like GANs, VAEs and invertible flows are showing amazing results on modeling high-dimensional distributions, especially for images. We will show how they can be used to solve inverse problems by generalizing compressed...

Apr
21
2020

Theoretical Machine Learning Seminar

Assumption-free prediction intervals for black-box regression algorithms
Aaditya Ramdas
12:00pm|https://theias.zoom.us/j/384099138

There has been tremendous progress in designing accurate black-box prediction methods (boosting, random forests, bagging, neural nets, etc.) but for deployment in the real world, it is useful to quantify uncertainty beyond making point-predictions...

Apr
09
2020

Theoretical Machine Learning Seminar

Meta-Learning: Why It’s Hard and What We Can Do
3:00pm|https://theias.zoom.us/j/384099138

Meta-learning (or learning to learn) studies how to use machine learning to design machine learning methods themselves. We consider an optimization-based formulation of meta-learning that learns to design an optimization algorithm automatically...