%0 Conference Paper %A Zhang, Congle %A Xue, Gui-Rong %A Yu, Yong %A Zha, Hongyuan %B 18th International World Wide Web Conference %C Madrid, Spain %D 2009 %F www2009:122 %P 1083-1083 %T Web-Scale Classification with Naive Bayes %U http://www2009.eprints.org/122/ %X Traditional Naive Bayes Classifier performs miserably on web-scale taxonomies. In this paper, we investigate the reasons behind such bad performance. We discover that the low performance are not completely caused by the intrinsic limitations of Naive Bayes, but mainly comes from two largely ignored problems: contradiction pair problem and discriminative evidence cancelation problem. We propose modifications that can alleviate the two problems while preserving the advantages of Naive Bayes. The experimental results show our modified Naive Bayes can significantly improve the performance on real web-scale taxonomies.