SEO Articles : How Much Blog Spam? A Study of a Ping Dataset

How much blog spam is produced in 5 minutes in a quiet Sunday evening? What is the ratio of spam blogs in the most popular blog services? To answer this question I present you the results of an experiment analyzing ping data and manually reviewing blogs.

The relative ease of creating and maintaining blogs makes them ideal tools for spamming search engines. Spam blogs or splogs serve two basic purposes: making money from advertising and affiliate programs, and participating in link farms. But making money from AdSense and providing nepotistic links are not what it takes to call a blog splog. Otherwise we would have to classify all blogs showing ads or promoting a business as spam; and there are thousands popular, quality blogs that would fall into this category. The distinctive feature of a splog, however, is that it has no use for its visitors. Should Google ban a splog from AdSense and prevent its links from passing on authority “ such a splog would have no more value or purpose of existence. So my definition of a splog would be a blog with the only purpose of showing contextual or affiliate ads, or boosting link popularity of certain target site

How active are these splogs? This question calls for a little experiment; similar to one described by P. Kolari, A. Java and T. Finn in their paper Characterizing the Splogosphere. They did their experiment in early 2006, and I am going to repeat it at a smaller scale now, in the early 2007.

Every time a blog is updated it sends a ping to one of many ping servers in order to invite search engine crawlers to index the new post. I am going to use ping data provided by one of the most popular ping servers Weblogs.com. Due to the limited scale of the experiment I will be using the smaller dataset covering the last 5 minutes of pings. It's pretty big though: 8117 pings. I've written a simple Java application to parse the XML file and extract URLs and names of the blogs in the dataset. Also some of the blogs were classified by blog platform: Blogspot (Blogger), MySpace, Spaces.Live.com etc. I have discovered a number of popular blog services, that I haven't come across yet, such as a popular Taiwanese site Wretch.cc, or Italian Libero.it and Splinder.com. I was surprised to see how few pings came from some other popular blog services; Livejournal for instance had only 6 pings! Obviously LJ doesn't rely much on Weblogs.com, but LJ has little to do with my experiment, as it is known to have very small percentage of splogs.

So below is a break down of blogs by platform, according to a ping dataset retrieved on a Sunday evening, Feb. 11. Do not mix blogs under Wordpress.com category with blogs using WP as a blog engine. Only those blogs hosted by Wordpress.com are included into this category.

Fig. 1 Popular Blog Services in the Sunday Weblogs Dataset

The huge Rest category consists of standalone blogs and blogs hosted by minor blog services.
A few words on the blogs in the dataset: a lot of blogs were not in English, I think as much as 70% of them. For instance, all Wretch.cc blogs and many Spaces.Live.com ones are in Chinese, there are also a lot of blogs in Italian, Spanish, Russian, Japanese and German.

Once dataset was downloaded and processed I started manually reviewing the blogs and discovering spam. Of course I couldn't visit all the 8117 blogs, so I randomly selected 20 blogs from each category.

How did I classify spam blogs? While blogs with automatically generated content or dictionary dumps are easily classified as spam, those with plagiarized content or in foreign languages required a bit more of effort. Nepotistic links with keyword stuffed anchors were a good indicator of spam. Copyscape.com helped much discovering plagiarized posts. And finally, affiliate and contextual ads were the final complement in the spam classification problem. It has to be noted that very few blogs in languages other than English were classified as spam. I can be sure about my judgment of German and Russian blogs, since I know these languages, but when dealing with others I relied only on excessive advertising and nepotistic links as spam indicators. I skipped Wretch.cc and Explog.jp samples as I was totally unable to judge Chinese and Japanese blogs. In total of 177 reviewed blogs 36 were classified as spam.

Below you can see two charts, one indicating a ratio of spam within a sample, and another showing how much each blog platform contributes to the total amount of spam.

Fig 2. Percentage of Spam Blogs in 20-blogs Samples

Fig 3. Contribution of Each Category to the Total Blog Spam

With the notable exception of Blogspot, the majority of blogs hosted by popular blog services are spam free. Of course one can question their quality, as many of them are of little value to others. But let's not forget that most of those blogs are private diaries or personal playgrounds never intended to have big audiences; and as long as they have value to the author and his/her close circle of friends we can't call them spam.

Thus, according to my reviews blogs hosted by beon.ru, Libero.it, Spaces.Live.com, Livejournal.com, splinder.com, and typepad.com showed no instances of blog spam in 20 blogs samples. Among 20 MySpace blogs I have discovered 1 splog, and Wordpress.com sample contained 2. The popular Google's service Blogspot has confirmed its unofficial name of Splogspot with 50% spam ratio. The Rest category comprised by standalone blogs and blogs attached to commercial sites showed even bigger proportion of blog spam: 23 blogs of 27 reviewed were classified as spam. The relatively low number of splogs hosted by public services can be explained by anti-spam actions taken by the administration of such services. The standalone splogs, however, are not subject to such moderation, which allows them to thrive producing tons of junk content for SE crawlers and overloading ping servers with spam pings.

As you might have noticed I used the same style of charts introduced by the famous blog ModernLifeIsRubbish.co.uk, which has an excellent tutorial on how to create pretty pie charts in Adobe Illustrator. Highly recommended!

5 Fast Tips to Improve Internal Links

This guest post was written by James Hay, Social Media Coordinator for Fasthosts Internet Ltd.

Playing to your strengths is an important part of SEO, and before going out and spending all day endlessly pursuing external links, it is important to look at your own site.

You control what is displayed on your site and the SEO tips below provide a number of ways to increase your rank strength and improve your blog’s internal link architecture.

Just in case you’ve not come across the phrase “Internal Linking” before, here’s a quick definition from SearchPath:

The process whereby words or phrases within a web page are linked to other pages in the site. Internal links are considered important in SEO terms, as they are often spidered and displayed by Google.

So here are my top five tips to help you improve your internal link architecture.

Ensure that the keyword(s) you’re trying to get ranked for is used as your anchor text (the text within the link). For example, if the phrase you are trying to get ranked for is “Internal Links”, and the page you want people to find for that phrase is your article “Guide to Internal Linking”, then use that phrase as the anchor text for your link. The search engine spiders will then understand what your target page is about, and it will increase the content’s ranking strength for that phrase.

Although there is no empirical evidence to say that search engines spiders prefer absolute URLs (i.e. http://yourdomain.com/pagetitle.html) over relative URLs (i.e. /pagetitle.html), it is good practice to use absolute URLs. It help spiders determine exactly where the page is located on your site, and if your content gets copied, then at least the links will point back to your website.

The speed at which your pages load certainly affects your page rank. I recommend using Google Webmaster Tools and adding a sitemap to your blog. You can then look at your site performance and how quickly your pages load. Google seems to regard 1.5 seconds or less as a good load time. Compress any large images and refine unnecessary code to help speed up your site.

Although search engines are improving all the time, the search engine spiders still have difficulty crawling non-text navigation menus. It is advisable to use text menus rather than those that require Flash or JavaScript.

It’s important to keep in mind that search engine spiders love to move freely and quickly through your site, which is why I’ve provided the tips above. But one thing that spiders really dislike is hitting a dead-end, and broken links are the cause of this. The Google Webmaster Tools can also identify broken links on your blog. Go through those links and either remove them, or change the anchor text and redirect the link to a valid page.

These are my top tips for improving internal links on your blog. What others can you add?

This article was written by James Hay, Social Media Coordinator at Fasthosts Internet Ltd and the main contributor to the Fasthosts Blog which provides advice on everything from B2B Marketing to Social Networking.

View the original article here