Thursday, October 18, 2012

I'm not negative, you jerk

Hey, remember how I used to do these random word clouds of my blog? No? Cos I haven't done them in about a year? Right, makes sense.

The other day I remembered I hadn't done one of those in awhile and decided I wanted to again. But whenever I do build one it's just made up of my 6 most recent posts. But I want my word cloud to represent MOAR DATA. So I decided to play around with a social listening tool to pull in more posts. Here's what that looks like

Yeah I know, not that interesting. Oh I say "book" and "read" a lot? Who would have guessed.

BUT while I was in this tool I decided to take a look at the sentiment section and see what it says. And it told me I am mostly negative. Wait, what?

It said, for the past year, 22% of my content as been positive, 37% neutral and 41% negative. Granted, my first reaction to those stats was to IM a friend and go "Apparently my blog is 41% negative. Well fuck you then!". So yeah, maybe they have a point.

Then I really looked at why the system was being so judgy. Essentially anytime I used a negative word like "bad" or "don't like" it said the section was negative. Of course, as with any automated system, it can't take into account context. The system can't tell I said "Now normally I don't like this, but this book nailed it perfectly. Kudos" It also marks my entire rant about wanting to set a character on fire because I hate them so much as "positive" because I said the character was "SO PERFECT".

Moral of this post:
Word clouds are pretty boring but have shapes and colors so people like them (me included)
Context is important
Computers do not get sarcasm
Automated sentiment is pointless

Comments (18)

Loading... Logging you in...
  • Logged in as
Obvs I'm gonna ask what site you used because I want to do this.

You should start saying flibbertigibbet all the time.
5 replies · active 646 weeks ago
So the tool I used for this costs money, but I have access to it through work. And I was TESTING it to see how well it worked (if any work people question me about this).

I'm going to start saying flibbertigibbet. Or more likely I'll start typing it and it will end up flibbertighahdada
I just used Wordle or something and it's all "You loooove Steinbeck" and I'm like "TRUE but also not representative."

Also my most-used word is 'like.' Gotta start watching that. I TYPE LIKE I SPEAK AND I OVERUSE THIS WORD.
I used Worlde to make the word cloud and did you know you can remove words from it and make yourself seem smarter? cos I maaaaaay have removed "like" from my word cloud before posting.
I love you for admitting this.
I can't even believe that you say 'read' and 'book' so much? What is all that about?!

Re: Your lessons learned through this experience- You'd think that by now, someone would have made computers get sarcasm! I just... IT'S REALLY FRUSTRATING WHEN YOU'RE A SARCASTIC PERSON! Also it's annoying how you can't do sarcasm in writing. Well, you *can*, but then you have to explain it, and that just sucks all the fun out of everything!
1 reply · active 647 weeks ago
so they have sort of made computers that get sarcasm. This is going to get nerdy, so feel free to skip

Most auto-sentiment just uses keyword analysis and says "they said the word "bad" which is on our negative list, therefore this post is negative".
If you have an archive of data, some systems let you "retrain" their sentiment and learn from how you update the sentiment.
There are other systems where from the start you have to train the system on sentiment before it runs anything
Then there are "natural language processing" sentiment systems which are the best. And super expensive.
Hahaha! I love the word cloud. I also love the sarcasm.
1 reply · active 647 weeks ago
Thank you! I'm glad SOMEONE appreciates the sarcasm, since clearly this program does not.
My 3-year-old has also picked up a little of the sarcasm from her parents. It's cute and weird at the same time.
3 replies · active 646 weeks ago
Adorable! You've taught her well.
My 3-year-old niece replies to being told she has to go to bed with "balderdash, Auntie Tika. Balderdash."

It's not sarcasm, but it's utterly hilarious.
I tried to make my own world cloud, but apparently google is blocking it (or something?) Eh, I'm pretty sure mine would have been all

READ LIKE UGH GIF BOOKS TBR READATHON ENJOY AUTHOR LOVED HATED YES PAGES WILKIEEEEE
1 reply · active 646 weeks ago
I used Wordle.net to make the word cloud. You should be able to put in the URL of your blog and will make a word cloud for however many posts you display on one page.

I think you do need a certain version of Java for it to work

You should make a word cloud and post it!
Oh, I love this post. Do them more often, k?
1 reply · active 646 weeks ago
Haha k! You should do one too. EVERYONE WORD CLOUD

Post a new comment

Comments by