Followblock this user
Giorgio Fumera
Trusted member
Associate Professor
University of Cagliari, Faculty of Engineering, Department of Electrical and Electronic Engineering, Cagliari, Italy
Dynamics of Variance Reduction in Bagging and Other Techniques Based on Randomisation
Abstract. In this paper the performance of bagging in classification problems is theoretically analysed, using a framework developed in works by Tumer and Ghosh and extended by the authors. A bias-variance decomposition is derived, which relates the expected misclassification probability attained by linearly combining classifiers trained on N bootstrap replicates of a fixed training set to that attained by a single bootstrap replicate of the same training set. Theoretical results show that the expected misclassification probability of bagging has the same bias component as a single bootstrap replicate, while the variance component is reduced by a factor N. Experimental results show that the performance of bagging as a function of the number of bootstrap replicates follows quite well our theoretical prediction. It is finally shown that theoretical results derived for bagging also apply to other methods for constructing multiple classifiers based on randomisation, such as the random subspace method and tree randomisation. 1
Oh la la
Your session has expired but don’t worry, your message
has been saved.Please log in and we’ll bring you back
to this page. You’ll just need to click “Send”.
Your evaluation is of great value to our authors and readers. Many thanks for your time.
Review 
When you're done, click "publish"
Only blue fields are mandatory.
Your mailing list is currently empty.
It will build up as you send messages
and links to your peers.
No one besides you has access to this list.
Enter the e-mail addresses of your recipients in the box below.
Note: Peer Evaluation will NOT store these email addresses log in
Your message has been sent.
Description
New Full text for this article was not available?
Send a request to the author(s).
Title : Dynamics of Variance Reduction in Bagging and Other Techniques Based on Randomisation
Abstract : Abstract. In this paper the performance of bagging in classification problems is theoretically analysed, using a framework developed in works by Tumer and Ghosh and extended by the authors. A bias-variance decomposition is derived, which relates the expected misclassification probability attained by linearly combining classifiers trained on N bootstrap replicates of a fixed training set to that attained by a single bootstrap replicate of the same training set. Theoretical results show that the expected misclassification probability of bagging has the same bias component as a single bootstrap replicate, while the variance component is reduced by a factor N. Experimental results show that the performance of bagging as a function of the number of bootstrap replicates follows quite well our theoretical prediction. It is finally shown that theoretical results derived for bagging also apply to other methods for constructing multiple classifiers based on randomisation, such as the random subspace method and tree randomisation. 1
Subject : unspecified
Area : Computer Science
Language : English
Url : http://ce.diee.unica.it/en/publications/papers-prag/MCS-Conference-20.pdf
Doi : 10.1.1.74.5834
Leave a comment
This contribution has not been reviewed yet. review?