This is a Google Analytics graph of traffic on Ask MetaFilter from 2011-2014 showing the late 2012 reduction (that one big spike was a recent thread going viral for a day). We never really recovered and have been slipping since.

MetaFilter as SEO spamfarm? Huh?

Most recently, we’ve been getting several emails every morning asking us to remove links to sites that were mentioned on MetaFilter, every big web publisher gets them now. The text of these emails is slightly distressing, but here’s an actual message Google sent to someone, who in turn contacted us pleading for removal:

We’ve reviewed the links to your site and we still believe that some of them are outside our quality guidelines. Sample URLs: http://ask.metafilter.com/194610/get-me-and-my-stuff-from-point-a-to-point-b-possibly-via-point-c Please correct or remove all inorganic links, not limited to the samples provided above. This may involve contacting webmasters of the sites with the inorganic links on them.

Here’s my morning inbox

Google calling links found on MetaFilter “inorganic” is troubling. We have a staff of six full-time moderators in five timezones throughout the world (two are in Europe) to make sure zero spam ends up on the site. We have a variety of internal tools that help us track all spam down: views of all activity by new users that contain links and lists of comments added to old questions that had a link in them (two patterns we found comment spammers trying in the past). Moderators scan every new user of the site looking for telltale signs of a possible spammer and we have ways of marking potentially problematic accounts behind-the-scenes that give us additional view of their activity on the site later on. Those views are checked every few hours and when we occasionally find people posting comment spam, we remove it and ban the accounts immediately. We also have a robust flagging system used by members of the site so they can alert us instantly when spotted and we take the same actions on spammy additions. We have a total of over ten million comments across on all our sites combined and we spend so much time and energy tracking the few problem comments down that I would be hard-pressed to find even a single public comment that could be considered comment spam.

Every time I investigate these “unnatural link” claims, I find a comment by a longtime member of MetaFilter in good standing trying to help someone out, usually trying to identify something on Ask MetaFilter. In the course of explaining things, they’ll often do a search for examples of what they’re describing and include those for people asking a question. Whatever was #1 in Google for “crawlspace vent covers” in a question of “How to reduce heating costs in the Winter?” might show up, and now years later, the owners of sites that actively gamed Google to get that #1 spot at the time are trying to clean up their act but unfortunately I have a feeling MetaFilter is suffering as collateral damage in the process.

Since we’ve never seen a return to our pre-Fall 2012 traffic levels, I have to assume whatever hidden law we broke we’re still breaking, or that Google sees us as a home for comment spam even though we boot every single one we can find though a series of sophisticated methods, and the whole experience has been frustrating to say the least. At this point, I’m at wits end trying to figure out why our high-quality site, featuring good advice from a dedicated community of real people with a best-in-industry 24-hour moderation staff has seen such big decreases.

On the flip side, I’ll accept that MetaFilter is from “two or three Internets ago”, and perhaps this is Google’s way of saying they’re changing with the times and we’re not. I’m ok with that too, but since Google is a giant black box to outsiders, we’ll never really know.

The future of MetaFilter and beyond

We’ve cut back as much as we can over the last 18 months, we’ve changed web hosts, going from hardware in racks to cloud hosting (cutting our bills by 80%). We’ve all taken pay cuts.

But at this point with recent shifts in search traffic and ad revenue MetaFilter is now losing several thousand dollars per month and if nothing were to change, MetaFilter would be sunk by the middle of summer when our already depleted savings run completely dry.

What other options?

I started looking to move away from reliance on advertising revenue and Google in particular, but unfortunately Google has a very good product in Adsense (and DoubleClick which they bought, and Adwords which they also do) and other ad networks could only offer 1/2 to 1/4 of the rates we find with Google’s Adsense.

We even explored selling MetaFilter with the goal being someone else running the difficult financial/advertising aspects of the site while the staff remained to run the day-to-day operations of the community. It’s a lot to ask of a potential acquirer that we sell but change things as little as possible, and after months of negotiations with potential partners none proved successful.

MLKSHK and App.net

My favorite image sharing site MLKSHK recently announced a planned shutdown (done in a nice way with exports and lots of explanation and lead time) and as soon as I saw the news I knew I didn’t want to find myself writing the same thing anytime soon. Despite facing impending financial doom on this fifteen year old site, I’m not quite ready to throw in the towel.

App.net, the API-platform-but-everyone-considers-a-Twitter-competitor announced it was scaling back all full-time employees from the project but hoping to run it “normally for an indefinite period.” While that sounds like a difficult spot they’re in, I think that strikes a better chord for how I’m thinking about MetaFilter.

Tightening the belt further

MetaFilter is frequently mentioned as one of the best places to find high quality conversations on the Internet, and it got that way through having a large dedicated moderation staff. MetaFilter is the most highly moderated site of its size on the Internet. I know this because I’ve talked to people working at all the larger, more famous sites and they most often have just a single or small number of people working part or full time as moderators, with the bulk of moderation work handled either by volunteers and users themselves, or through software automation of one form or another.

In order to cut costs further, I announced our first ever lay-offs. At the end of May 2014, I’m cutting half our moderation staff to make up for revenue shortfalls. Starting June 1st, we’ll continue operating as normal, but with less staff with more of my time will be devoted to day to day moderation on the site.

Overall, moderation conforms to an 80-20 rule where with the right approach and moderate effort you can get a very good community site, but going the extra mile takes multiples of effort to make small gains. I feel in the past we were very close to getting the best possible community site we could because we had so many resources available to us, and as we scale back the goal is to maintain that high quality as much as possible with the hope being the overall decrease won’t be so much as to drastically change the community.

Finally, a bit of barn raising

When we announced the layoffs, I downplayed the idea of Metafilter members giving us money, because I had doubts about whether that would have any practical effect on our situation. But then an amazing thing happened: people independently dug up a largely-forgotten donation link buried on the site’s about page, and even figured out how to set up monthly subscription payments to MetaFilter using the PayPal’s crude tools. I previously estimated a small population of maybe a couple hundred people might pony up a buck or two each month, which wasn’t really enough to change our situation. Much to my surprise, several hundred people have already given money as one-time contributions and/or set up monthly subscriptions, with the average contribution at nearly $10. The dream of maybe replacing some of our ad revenue with member support is looking like it could actually happen. So, grateful for the spontaneous outpouring of support, we’ve built up a formal fund-the-site page here:

Conclusion

I’m sad to have to cut staff positions, but I believe the members are what make a community great and I am looking forward to MetaFilter’s sustained presence online. We may have to make hard choices in the future as the revenue landscape continues to change, but the goal will always be towards having the best place online to have conversations, share interesting things on the web, and offer advice to one another.

Finally, I thank everyone that used the site over the last 15 years, the great dedicated staff, as well as those helping fund it today. MetaFilter couldn’t be what it is without all of you.