Statistical Analysis Stack Exchange
Statistical Analysis Stack Exchange

Questions tagged [sentiment-analysis]

93 questions
23
votes
1 answer

Has the reported state-of-the-art performance of using paragraph vectors for sentiment analysis been replicated?

I was impressed by the results in the ICML 2014 paper "Distributed Representations of Sentences and Documents" by Le and Mikolov. The technique they describe, called "paragraph vectors", learns unsupervised representations of arbitrarily-long…
bskaggs
  • 363
  • 2
  • 6
9
votes
2 answers

Understanding and applying sentiment analysis

I was just having been assigned a project of conducting sentiment analysis for some document collections. By Googling, a lot of sentiment-related research has popped up. My questions are: What are the major methods/algorithms for sentiment…
user3269
  • 4,622
  • 8
  • 43
  • 53
8
votes
2 answers

Supervised approaches vs. topic models in sentiment analysis

I am researching Sentiment Analysis over social media, particularly classifying online texts such as blog posts as positive, negative or neutral. Most of the approaches I have found for sentiment analysis are supervised (they need labeled data to…
kanzen_master
  • 1,235
  • 3
  • 15
  • 22
8
votes
2 answers

Information gain and mutual information: different or equal?

I'm very confused about the difference between Information gain and mutual information. to make it even more confusing is that I can find both sources defining them as identical and other which explain their differences: Information gain and Mutual…
jcsun
  • 107
  • 1
  • 7
7
votes
0 answers

Maximum entropy classifier and sentiment analysis

I am doing a project work in sentiment analysis (on Twitter data) using machine learning approach. In order to find the 'best' way to this I have experimented with naive Bayesian and maximum entropy classifier by using unigrams, bigrams and unigram…
norbip
  • 171
  • 4
5
votes
2 answers

Financial Slang and NLP for Sentiment Analysis

I am working on Sentiment-Analysis/Opinion-Mining of Tweets, focused on Finance related tweets. One of the biggest issues I am facing is the unability of my algorithm to detect equivalent entities (Definition in B.Liu 2012: Page 18-19) when…
ylnor
  • 188
  • 11
4
votes
2 answers

Is there a better approach than counting positive-negative words in sentiment analysis?

I am doing some sentiment analysis on AirBnb public reviews. (Detailed Review Data). http://insideairbnb.com/get-the-data.html So what I have is about 230,000 comments and reviews in the city of Barcelona and I'd like to carry out some sentiment…
adrian1121
  • 856
  • 8
  • 22
3
votes
0 answers

How do I analyze the effects of pandemic on tone of online comments?

I am looking at analyzing the effects of Covid pandemic on online communications. I am hypothesizing that user comments on discussion forums are significantly more negative in tone during the Covid pandemic period (i.e., Mar 01 2020 -Apr 15, 2020)…
SanMelkote
  • 621
  • 5
  • 20
3
votes
2 answers

No Training Dataset for Sentiment Analysis Algo

I am learning about the potential with Sentiment Analysis and have gone through many examples but I am still unsure about my understanding of one crucial detail: does one always need to start Sentiment Analysis with a previously labeled training…
Odisseo
  • 614
  • 5
  • 11
3
votes
1 answer

Word Embedding for Sentiment Analysis

I am working on sentiment analysis of text. I am using keras word embedding. If my embedding has a vocabulary of 50 and an input length of 4 and I choose an embedding space of 8 dimensions, how will be the output from the embedding layer?
vamsi
  • 191
  • 1
  • 7
3
votes
0 answers

Delta TF-IDF right choice for multi classification problem

In the paper of Martineau & Finin they describe their new approach with Delta TF-IDF . Instead of measuring how rare features are in the document, they weight these values by how biased they are to one corpus. The way they do it, is by calculating…
jonas00
  • 81
  • 4
3
votes
0 answers

Why does RNN overfit for sentiment analysis but not for spam detection?

I used this code which uses RNNs for spam detection and got reasonable results. But when I use the same code for sentiment analysis, the model overfits badly: its training accuracy keep growing, but its test accuracy remains the same. The dictionary…
Hossein
  • 3,170
  • 1
  • 16
  • 32
3
votes
0 answers

Machine learning basic learning question

I have been studying machine learning on my own, from online videos and tutorials and by referring books from the library. I am finding it very difficult to understand the concepts. I am not speaking of the various algorithms but the main basic…
Esash
  • 31
  • 2
3
votes
2 answers

How to prepare a dataset for text classification

I would like to compare some algorithms for performing sentiment classification (Naive Bayes, SVM, and Random Forest). So far, I have collected about 100 000 unique opinions with the following distribution: 10% negative 90% positive After some…
Khozzy
  • 263
  • 1
  • 2
  • 9
2
votes
1 answer

Sentiment Analysis with respect to subject

I'm familiar with the bag of words/Naive bayes sentiment analysis for text (e.g. http://streamhacker.com/2010/05/10/text-classification-sentiment-analysis-naive-bayes-classifier/) I was curious to see if anyone here knows anything about computing…
Michael
  • 2,180
  • 4
  • 23
  • 32
1
2 3 4 5 6 7