Event
Proposing a Tractable Method for Estimating Empowerment from Offline Data
1 reports · 1 sources
Sergey Levine introduces a new paper proposing a computable empowerment estimator and its applications. Levine states that empowerment measures the degree of control an agent has in a given state, can be estimated from offline data, and can be used to guide exploration; previously, estimating empowerment from offline data, while useful—providing an unsupervised objective for learning the relative value of reaching diverse outcomes from each state—was computationally difficult.
Report timeline
- A New Method Enabled by Offline Data Estimation
Estimating empowerment from offline data is useful because it provides an unsupervised objective for learning the relative "value" of each state in reaching diverse outcomes. But making it computable is notoriously difficult. In our new paper, we propose a computable estimator, along with some applications!
Sergey Levine ·