2011

Domain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach

Xavier Glorot, Antoine Bordes, Yoshua Bengio

citations

Cite Score

58

AI summary

This paper proposes a deep learning approach using Stacked Denoising Auto-encoders for domain adaptation in sentiment classification, outperforming state-of-the-art methods on Amazon product review benchmarks and demonstrating scalability on a large industrial dataset.

Main Contributions

  • Introduced a deep learning approach based on Stacked Denoising Auto-encoders for domain adaptation in sentiment classification.
  • Proposed an unsupervised method to learn meaningful representations from reviews across various domains.
  • Achieved state-of-the-art performance on a benchmark of 4 Amazon product review types, significantly outperforming existing methods.
  • Demonstrated successful domain adaptation on a larger industrial-strength dataset of 22 domains, showing scalability.
  • Utilized rectifier non-linearities to provide sparse representations that are efficient for linear classifiers.

Abstract

The exponential increase in the availability of online reviews and recommendations makes sentiment classification an interesting topic in academic and industrial research. Reviews can span so many different domains that it is difficult to gather annotated training data for all of them. Hence, this paper studies the problem of domain adaptation for sentiment classifiers, hereby a system is trained on labeled reviews from one source domain but is meant to be deployed on another. We propose a deep learning approach which learns to extract a meaningful representation for each review in an unsupervised fashion. Sentiment classifiers trained with this high-level feature representation clearly outperform state-of-the-art methods on a benchmark composed of reviews of 4 types of Amazon products. Furthermore, this method scales well and allowed us to successfully perform domain adaptation on a larger industrial-strength dataset of 22 domains.

Citation Graph

Loading graph...

References [27]

Sort:
Filter:

V. Nair, Geoffrey E. Hinton - 2010

18 papers in library cite

Geoffrey Hinton, Ruslan Salakhutdinov - 2006

37 papers in library cite

Geoffrey E. Hinton, S. Osindero, Y. Teh - 2006

43 papers in library cite

Xavier Glorot, Antoine Bordes, Yoshua Bengio - 2011

17 papers in library cite

Yoshua Bengio - 2009

25 papers in library cite

Pascal Vincent, Hugo Larochelle, Yoshua Bengio, Pierre Antoine Manzagol - 2008

25 papers in library cite

Ronan Collobert, Jason Weston - 2008

32 papers in library cite

Yoshua Bengio, P. Lamblin, D. Popovici, Hugo Larochelle - 2006

33 papers in library cite

John Blitzer, Mark Dredze, Fernando Pereira - 2007

4 papers in library cite

Rajat Raina, Alexis Battle, Honglak Lee, Benjamin Packer, A. Ng - 2007

7 papers in library cite

I. Goodfellow, Quoc Le, A. Saxe, A. Ng - 2009

7 papers in library cite

James Bergstra, O. Breuleux, F. Bastien, P. Lamblin, Razvan Pascanu, G. Desjardins, J. Turian, D. W. Farley, Yoshua Bengio - 2010

22 papers in library cite

B. Snyder, R. Barzilay - 2007

5 papers in library cite

Ruslan Salakhutdinov, Geoffrey Hinton - 2007

5 papers in library cite

Pascal Vincent - 2011

4 papers in library cite

John Blitzer, R. Mcdonald, Fernando Pereira - 2006

4 papers in library cite

Bo Pang, L. Lee - 2008

4 papers in library cite

Bo Pang, L. Lee, S. Vaithyanathan - 2002

4 papers in library cite

S. B. David, John Blitzer, K. Crammer, Fernando Pereira - 2006

3 papers in library cite

H. Daumeiii, D. Marcu - 2006

2 papers in library cite

M. Thomas, Bo Pang, L. Lee - 2006

2 papers in library cite

J. J. Jiang, C. Zhai - 2007

2 papers in library cite

Marc'aurelio Ranzato, M. Szummer - 2008

2 papers in library cite

W. Dai, G. Xue, Qiang Yang, Y. Yu - 2007

2 papers in library cite

Sinno Jialin Pan, X. Ni, J. T. Sun, Qiang Yang, Ziru Chen - 2010

1 paper in library cites

V. Sindhwani, S. S. Keerthi - 2006

1 paper in library cites

Shanda Li, C. Zong - 2008

1 paper in library cites

Cited by

3

papers in your library

Cites

12

papers in your library

Read

on February 16, 2026

Your review

Tags

Paper Aliases

No aliases