Log in

No account? Create an account
StumbleUpon Considered Harmful - Arvind Narayanan's journal — LiveJournal [entries|archive|friends|userinfo]

StumbleUpon Considered Harmful [Jun. 24th, 2011|10:03 pm]
Arvind Narayanan
[Tags|, ]

About a week ago I noticed a large, anomalous traffic spike on one of my articles over at 33bits.org. These visitors seemed to bounce immediately, not viewing any other pages, and were much less likely to engage with the page in any way, such as commenting. Numerically, this traffic source contributed about 75% of the total for that article, but only 2 of the 64 tweets came during the time window of the spike, which means that these visitors were about 100 times less likely to engage with the article as others. An admittedly crude measurement, but even if it's within an order of magnitude, it means that this is a "poor quality traffic source" in SEO parlance—an extraordinarily poor one.

Then I glanced at the referer chart and noticed that the source was stumbleupon.com. At once it all made sense.

Let me explain. The average StumbleUpon user turns to the service when they're bored, so bored they can't even go to the trouble of endlessly clicking on links on web pages like most of us do. Instead they click repeatedly on the "Stumble" button which takes them to random web pages supposedly somewhat tailored to their interests. They're not in it to read the articles (any more than someone who's flipping through the pages of Playboy is in it to read the articles). Instead they're in it for the tiny dopamine spike that they get each time they land on a new page.[1]

Nine times out of ten, such a user will bounce immediately after looking at the title of your article, deciding that it's not something they're interested in. If they do start reading, a further nine times out of ten they'll bounce somewhere into the second paragraph. If you don't believe me, try using the product, and see how quickly you find yourself doing the same thing.

Before I go on to make my point, I should say that this is nothing more than a minor annoyance to me personally. I'm an academic; I'm not trying to monetize my site. And 33bits is a wordpress.com blog, so I don't pay hosting costs. The only reason I'm annoyed is that when I look at my stats page to see what sorts of articles my readers are most interested in, I have to mentally discount the articles that got StumbleUpon traffic. But anyone who pays hosting costs for their blog and is trying to make money (or spread an idea, or whatever) might want to take note of the following.
The architecture of StumbleUpon is fundamentally exploitative of the quid-pro-quo nature of free websites. A pageview from a StumbleUpon visitor costs just as much in bandwidth, but is a couple of orders of magnitude less likely to result in any sort of engagement. Your website wasn't meant to be viewed in a frame, so don't let it.
Even though StumbleUpon has only 10 million users, this is a bigger problem than might seem at first sight. The recommendations that the system makes are voting-based, so the mechanics of popularity and the resulting traffic patterns are essentially the same as with Digg and Reddit, although the engagement numbers are very, very different. This means that most days you'll probably see no StumbleUpon traffic, but one day you'll get unlucky and the resulting spike will dominate your traffic and costs for that month, but you'll have nothing to show for it.

I would recommend some framebusting and User-Agent sniffing code to politely tell StumbleUpon users to go somewhere else, but whatever you do, don't put a Stumble button on your pages!

[1] I'm sure there's a sizeable fraction of users for whom the collaborative filtering aspect works well, and who consequently actually read the articles and engage with the sites. But even if half the users fall into this group (although I doubt it's anywhere near that high), most of the traffic generated by StumbleUpon users to any given site is going to be low quality because the dopamine junkies make 100x more clicks.

From: katie_gray
2011-06-29 01:40 am (UTC)

Bounce Rate Measurement - and a Paid Discovery credit!

Hi Arvind,

I totally understand your frustration here, but I wanted to clear something up about bounce rate: the tracking method used by many web tracking platforms, including Google Analytics, calculates bounce rate as the percentage of single-page visits, or visits in which a person left a site from the entrance (or landing) page. As you know, StumbleUpon takes you from one page to another that's likely on a different domain. So even if a StumbleUpon user stumbles to your page and spends, say, 20 minutes engaging with your content, once they stumble to the next page, this visit will still count as a bounce because the user didn't click to another page within one domain. Similarly, the time on site metric registers as zero unless the user clicks a link on the landing page, even if that user spends several minutes (or more) enjoying content on that page. So basically, Google Analytics doesn't give you the full picture.

What StumbleUpon is particularly good at is remembering and keeping track of "loyalty statistics" - in other words, if someone thumbs up content, we'll likely recommend content from that same domain in the future, ensuring that you have a high quality, loyal following. You can check the loyalty of your visitors in Analytics (http://su.pr/1SaR7O).

It might help you to actually run a test with StumbleUpon Paid Discovery (www.stumbleupon.com/pd), our marketing platform, which can show you some of these stats, like time on site, whether people share your page via other platforms, and more. Feel free to email advertisers@stumbleupon.com with the subject line "Paid Discovery Test" and mention this blog post, and we'll give you $25 credit to try us out. You can test out different targeting techniques and see which gets you the best return. In fact, many publishers and advertisers have told us that their time on site metrics with StumbleUpon have far exceeded that of other marketing platforms (http://su.pr/1uFMqW). If this still doesn't work out for you, please let us know!

Katie Gray
Social Media Marketing Manager, StumbleUpon
(Reply) (Thread)