The askamum.co.uk site has been hit by Panda and search traffic dipped since April 2011. I was called to look at it in November 2011. In January we put out a release that was felt would correct a huge amount of duplication and crawl errors. It did – the release certainly consolidated the main site, but a significant problem remains – the forums.
The forums are an out of the box solution called Star Community – written in asp.net. I’ve taken the crawl report and pages in the folder /Community/ cause well over 90% of errors. In absolute terms that’s near 100,000 of them. It appears the forums are dragging the rest of the site down.
The forum drives hardly any keyword traffic – maybe a puny 100 visits a month.
Now as far as I can see there are a few solutions to this problem. Listed below.
1. Block Googlebot from the folder /Community/
I’m not sure about this, as Google still detects links that point to folders blocked by robots.txt. It also counts them as an error in Webmaster Tools. It would be a very cheap solution though. The duplication would be solved by the next crawl.
Despite this caveat, I’ve decided to do it in the interim, since we have very little to lose.
2. Gut the entire forum and start with a new technology
This is an option, but we’d lose over 1,000,000 comments and the legacy of users. There isn’t a huge amount of value in the user comments, but it could kill a lot of repeat visits again as users have their history wiped out. We’d have to change this when the site moves platform anyway, which is on the horizon.
3. Fix the forum to remove low value pages
This one seems the most difficult and most expensive. Because Star Community is licensed software, it’s also more difficult than just changing the code. We could sort out pagination through using JavaScript, but then there’s a rabbit warren of other ways to find low value pages.
Had anyone ever faced a Panda related issue like this one – particularly using forum technology? I’d love to have your feedback.