“Information-Based Objective Functions for Active Data Selection”, 1992-07-01 (; backlinks):
Learning can be made more efficient if we can actively select particularly salient data points.
Within a Bayesian learning framework, objective functions are discussed that measure the expected informativeness of candidate measurements. 3 alternative specifications of what we want to gain information about lead to 3 different criteria for data selection.
All these criteria depend on the assumption that the hypothesis space is correct, which may prove to be their main weakness.