Information overload and failure filter are false problems

The concept of information overload has received a lot of debate, and I completely agree with Clay Shirky that it’s actually ‘filter failure’ which is causing our current obsession with the problems of keeping up with the influx of content which is published and digitally accessible at a far greater rate than any time in human history.

But I think we’ve all been missing the real problem.

The current situation may be detrimental to our thought processes as some have argued, but that situation won’t last. Not only will technology filters improve, but humans are a pretty adaptable species, and the current supposedly harmful adaptions to accomodate skimming and processing lots of data. And I’m not even sure that information paralysis is the real problem, as we can cut down those inputs if we need to – even just by closing a feed reader or Twitter client, or by turning off the PC or TV.

I’m actually more concerned with a problem which has been affecting me to some extent.

‘Opportunity Overload’

WTF is Opportunity Overload?

As a personal example, I recently bought three books which will hopefully help me to make some changes in my lifestyle, and they nicely represent how we traditionally got the information to make changes and create new opportunities.

Buy a book, take a course, hire a professional, these were the ways to make changes and solve problems for the last few hundred years, even if actually the choices we made were the result of our subsconscious decisions and social proof. As a  homeowner, I’d limit the amount of DIY to the amount of information I’d been able to get – and if I wasn’t sufficiently educated, I’d just get a professional in to solve the problem (assuming I had the money available – if not, I’d ignore it and hope it went away).

That’s all changed.

Now I can find videos on plumbing on Youtube, or tips on cutting floor tiles on a blog. Or find better ways to run my businesses. Or learn to programme. Or how to cure the brown spot on my apple trees and improve the vegetable patch.

With internet access, I’m able to access all of these opportunities. To publish my own blog, to record my own music, to shoot my own videos.

Except there are only a finite amount of hours in the day, to be split with sleeping and spending time with my family.

And that’s the real cause of stress – it’s not about the amount of information coming in. It’s about the opportunity overload that information and digital enablement creates, and that I can’t hope to fulfill in the time available. I no longer have the excuse that I’m not a mechanic, plasterer or plumber when I know how much help is available online – and doing it myself theoretically means the cost issue is far less of a reason to avoid doing it.

It means the skills to prioritise tasks is going to be more essential than ever. And so is the ability to accept that not all things will be achievable, and to be able to let go of those opportunities and tasks which I’ll never value quite enough to get around to – even if I’d quite like to be able to say that I’d done it.

And that’s going to be tricky – human nature is ambitious and aspirational. There’s a very, very tiny part of me that still finds it a little hard to accept I’m unlikely to be a professional motorcycle racer, play football for Chelsea, or become a rockstar, even though 99.9% of me has changed to following aspirations to grow my business, support my family, and ride motorcycles and play guitar purely for enjoyment.

So how do we all deal with the knowledge that if we only had enough time, we could Google the way to achieve pretty much any task, but it’s only our human frailty and need for sleep/family/food/friends that are stopping us?

That’s why I feel Information Overload ain’t the problem – Opportunity Overload is.


Problems embedding Youtube videos in WordPress etc?

I’ve seen a few people ask why embedding Youtube videos seems to have stopped working on their WordPress blog recently, so thought I’d quickly share the reason.

Basically Youtube (And Vimeo), both released a new embed code a while ago, to enable viewing through Flash and HTML5. But when you put that new code into HTML view in WordPress, and then publish or go back to View mode, it disapears.

Fortunately the old version is still available if you click the appropriate box under the Embed options:

Hope that helps…

Content farms will eat themselves

The leading example of web publishing dubbed ‘content farms’ is Demand Media, which has just publicly filed registration for an IPO, and as a result has made it’s financial records public for the first time.

There was some surprise that content farming doesn’t currently make Demand Media profitable – last year it turned over $198 million in revenue, but still managed to lose $22 million. This year is looking better – a $6 million loss on $108 million so far… but it’s also important to note that a sizeable percentage of revenue is actually coming from Demand’s web registrar business, eNom, rather than content farming.

Content farms will peak this year:

I definitely think this is the right time for an IPO, as I honestly believe that this year could be the peak of content farming as a sustainable model for big business – for years, small companies and individuals have gone around creating targeted landing pages, and I still think there are ways to make this work effectively, but sizeable companies dominating the space are going to struggle.

What content farms rely on:

There are two things that content farms rely on for content creation – Search and Advertising. Essentially they’re creating content to respond to popular search queries to arbitrage advertising revenue (sold direct or via networks such as Google’s Adsense). In Demand’s case, it currently has deals with Google which are set to end in 2011.

They’re able to produce this content by farming the work out to a legion of online writers who are submitting for a low cost.

The shakey foundations of content farms:

Search – Traffic comes from responding to search queries. If the nature of search changes, by becoming more personalised and from social recommendations, then the traffic to search query specific sites drops.

This is likely, because the search content is often on sites which have no focus on owning an area with quality content – which is the sort of thing which is more likely to be shared on social networks (It should have also been the sort of content more likely to be highlighted by Google – maybe in 2011?).

Advertising – Ad networks, affiliate deals, and particularly advertising linked closely to search works, such as Google Adwords. If you can optimise a page for traffic and response by targeting people actively searching for it, and it’s something which advertisers will happily bid a significant amount to advertise against, you’re in business.

But the nature of the internet, and relatively open networks like Adwords (which have no minimum barrier to entry), means that there are always going to be an increasing number of options for advertisers. And while there will only ever be a handful of sites getting sizeable traffic from a position on page one of the search results, Adwords is keyword-based, so in aggregate you can achieve a similar scale more cheaply if you start digging into the results (as more people will – search advertising is relatively old in terms of internet revenues, but still a newborn for most advertisers.)

Content creators: Content farms can exist because there are thousands of people who are willing and able to churn out enough content to make a worthwhile return for them despite the relatively low reward – in comparison to traditional freelance costs for someone working in the media. Partly this is because it’s easy – relative to establishing a successful blog in a niche and achieving the same level of earnings for example. And partly it’s down to a lack of options – if you’re not one of the ‘elite’ with a job for traditional media, and you’re not building your own property, there’s an apparent limit to your options for contributing for payment

The earthquakes of algorithms and competition:

Google, (and Bing, Wolphram Alpha, or any other search product) uses software which can be tweaked and changed at any point – and if content farming is producing terrible writing (I’m not saying that’s the case across all companies and articles, but potentially en masse), then that software algorithm can be adapted.

Plus the social web is having an increased effect on both filtering and discovery. Google News is experimenting with human editors, whilst the likes of Facebook and Twitter have made social recommendations more mainstream than the previous traffic drivers of Digg, Reddit and Stumbleupon, because suddenly my none-digitally addicted friends have a quick and easy way to share links beyond their email connections, and for everyone else to pick up on them and repeat them.

And content farming is not a new concept – the segment of bloggers who focus primarily on making money have long looked at search data and advertising as the way to isolate niches which are most likely to make them a reward… So there’s nothing which is protected from unlimited competition, particularly when the likes of aol and Yahoo have also started to use search as a tool for article creation.

Finally, there’s a big element missing from content farm advertising. I’ve spent a long time working for media companies, and whatever you may believe about the media industry as a whole, I’ve seen an enormous amount of respect and faith from audiences for traditional media products. There are flaws in traditional display advertising, but you’re not just buying the ‘last click’ – indeed several attempts have been made to quantify the branding and awareness benefit you get from advertising with a big media brand.

Indeed, the same is true of advertising with a small niche blog in many ways – if I’m actively accepting advertising (which I do), and promoting affiliate products (which I also do), I have a vested interest in vetting them beforehand to avoid losing any trust, respect and loyalty from anyone who visits my site. I’ve never made a direct recommendation for anyone to purchase something I haven’t sampled first, and I take a similar approach to the advertising I sell directly. Only those adverts served by Google Adsense are independent from any editorial judgement, and that hopefully means that the implicit or explicit links mean that there’s an element of trust there.

Whereas people writing solely for search aren’t building that same level of engagement – they’re writing whatever they’re assigned, and that’s not going to translate to the social web effectively. I don’t pay to promote myself – I submit my content to several other locations, and then it’s down to the people who either know me, or see it and like it, to reward it with recommendations, links and traffic.

And there’s a final thought – at the moment there are several big sites allowing you to contribute on a huge range of topics without necessarily benefitting you financially. Wikipedia is one example, but others, for instance, Squidoo, allow you to donate any earnings to charity, for example. At the moment most of the open or non-profit approaches aren’t as prominent in the minds of many people, but as time goes by, more and more people seem to be following the notion of establishing a knowledgeable online presence in order to benefit indirectly, rather than monetising it at the source – Cory Doctorow often quotes Tim O’Reilly as saying ‘ the greatest enemy of a new author isn’t piracy, it’s obscurity’, and the same could be true on monetisation. More and more people seem to be contributing and building elements of online empires to establish reputation over monetisation, and these non-profit approaches could become another source of competition.

So what can content farms do?

In my eternal optimism, I think there’s a future for an evolution of content farming – to establish the leverage to provide a platform which correctly rewards people for displaying a high level of knowledge and engagement, so that those wishing for a direct financial reward can be recompensed, and advertisers can confidently invest in the branding and trust benefits of being associated with them.

But the challenge is that it’s an area in which media companies have existed for years, and they’re coming to the web from the opposite angle as they are getting more and more digitally savvy (there’s still a long way to go, but there’s probably more movement in digital from a lot of big media companies in the last year or so than in the last 5 or 6). If they don’t fall into only developing expertise in a closed application ecosystem, but also continue to invest, experiment and build, then content farms could actual be inspiring and paving the way for traditional brands to have a resurgence.

Ingredients missing from Twitter's Blackbird Pie to embed tweets

Twitter’s message embedding tool, Blackbird Pie, is now live. Well at least it would be, if the application hadn’t already toppled over due to the interest in it:

Twitter's new Blackbird Pie application for embedding tweets crashes on launch day

The above tweet had to be captured the old-fashioned way. But having had a look at the posts about the service before it fell over, I have to admit I’m fairly disapointed so far.

So on the plus side:

  • You just submit the url of a tweet to get the code
  • It picks up the font used in your tags to emulate your blog style.
  • It copies whatever background the original tweeter used.
  • The @tags, hashtags and account itself are all clickable.

But on the downside:

  • It was never that tricky to embed a tweet before – I just used the Aviary plugin for Firefox for a quick screengrab, upload the image, and then manually link to the account or hashtag as needed.
  • I’ve yet to see someone display an embedded tweet, but what happens if Twitter decides to remove that content from their system?
  • The block of code provided is a huge amount to copy and paste just to embed an element. Certainly something I wouldn’t want to have to edit to fit the size of any site/blog.
  • It seems like a hugely missed opportunity so far. Embedding an individual tweet isn’t a problem – but what is more problematic is capturing a few, or a whole conversation between one or more people. I’m sure I’ve seen one tool for capturing conversations but can’t remember what it is, and using my own quick screenshot method or Blackbird Pie it’ll still be a pain.
  • It’s crashed already, despite being built by people familiar with the size and scale of Twitter. And it’s not even showing a Fail Whale (Fail bird?)

Blackbird Pie seems undercooked

I’m really not sure why Twitter has released this now. We’ve had their acquisition of Tweetie, the release of BlackBerry and Android applications, and the launch of Promoted Tweets. Why rush out something which doesn’t actually offer anything particularly beneficial to users? Unless it’s simply there to add control for Twitter (And perhaps promotional partners).

After all, it may help when dealing with DMCA issues with particular messages.