IEEE Member-only icon Piero P Bonissone - Lazy Meta-Learning - Creating Customized Model Ensembles on Demand Piero P Bonissone -  Lazy Meta-Learning - Creating Customized Model Ensembles on Demand

Piero P Bonissone - Lazy Meta-Learning - Creating Customized Model Ensembles on Demand

86 views
  • Share
Create Account or Sign In to post comments
#WCCI 2012 #Piero P. Bonissone #model ensemble selection and fus #Lazy MetaLearning

Abstract: In the not so distant future, we expect analytic models to become a commodity. We envision having access to a large number of data-driven models, obtained by a combination of crowdsourcing, crowd-servicing, outsourcing and legacy models. In this new context, the critical question will be model ensemble selection and fusion, rather than model generation. We try to address this issue by proposing customized model ensembles on demand, inspired by Lazy Learning. In our approach, referred to as Lazy Meta-Learning, for a given query we find the most relevant models from a model DB, using models meta-information. After retrieving the relevant models, we select a subset of models with highly uncorrelated errors. With these models we create an ensemble and use their meta-information for dynamic bias compensation and relevance weighting. The output is a weighted interpolation/extrapolation of the outputs of the models ensemble. Furthermore, the confidence interval around the output is reduced as we increase the number of uncorrelated models in the ensemble. We have successfully tested this approach in an electric power management application.

Abstract: In the not so distant future, we expect analytic models to become a commodity. We envision having access to a large number of data-driven models, obtained by a combination of crowdsourcing, crowd-servicing, outsourcing and legacy models. In this new context, the critical question will be model ensemble selection and fusion, rather than model generation. We try to address this issue by proposing customized model ensembles on demand, inspired by Lazy Learning. In our approach, referred to as Lazy Meta-Learning, for a given query we find the most relevant models from a model DB, using models meta-information. After retrieving the relevant models, we select a subset of models with highly uncorrelated errors. With these models we create an ensemble and use their meta-information for dynamic bias compensation and relevance weighting. The output is a weighted interpolation/extrapolation of the outputs of the models ensemble. Furthermore, the confidence interval around the output is reduced as we increase the number of uncorrelated models in the ensemble. We have successfully tested this approach in an electric power management application.

Advertisment

Advertisment