Eclectic Studios
Showing posts with label Search Engines. Show all posts
Showing posts with label Search Engines. Show all posts

Wednesday, November 8, 2006

Friendly Fire in the War on Spam – Part 3: The boy who cried SPAM

Part 1 | Part 2 | Part 3

There are many people out there who run legitimate email newsletters. Newsletters provide useful information to subscribers and they are a great way for companies to stay in touch with their client base. Those who send newsletters have to be very careful about how they handle their mailing lists. Most people who send newsletters are careful and concerned about stopping spam. The CAN-SPAM act is a good starting point, but those who care about their customers agree that these are probably the most important "best practices" for sending email newsletters:

  • Use a self-managing mailing list or service
  • Include unsubscribe instructions with every email you send
  • Require a double-opt-in for new subscribers (Double opt in refers to the process of signing up for a newsletter then requiring a confirmation response from the email address that was sent. This way an email address cannot be added by an imposter)
Even with all these precautions legitimate emailers get flogged as spammers. But these are skilled, tech-savvy people who seriously oppose spamming. How can they be accused of spamming when they've been so careful? The sad answer is that it happens when a legitimate newsletter is flagged as spam by one of their own subscribers.

The double-opt-in signup makes it impossible for an email address to be accidentally added to a mailing list. Someone has to choose to subscribe and then verify their wish to subscribe. But a month later, they may have forgotten all about it. They complain to an ISP about this spammer or hit the "Spam" button on their email client. Just like that, the emailer has been accused of spamming. The consequences of being accused of spamming can be drastic and swift, often resulting in non-delivered emails and blacklisting. The anti-spam movement is so strong right now that an ISP might immediately deny service to the newsletter sender. This happens without any crime being done, without any proof, and without any warning to the person managing the newsletter.

What's most alarming about this problem is that there really is no defense against it. This is a problem that is totally out of the control of people who use email legitimately. Email recipients have been empowered to take on spam. People have a lot of rage when it comes to spam and they have no qualms about practicing mob justice. Apparently the AOL email interface is particularly empowering when it comes to accusing spammers by providing a large spam button… that has serious consequences.

The only solution may be to abandon email newsletters all together. As RSS technology becomes a part of the daily lives of mainstream internet users we ca see an alternative to using email to deliver content. There can be no argument about who is subscribing to RSS information. The recipient requests the information only when they want to, or when their reader has been programmed to.

Interestingly this corresponds nicely with the advent of blogging. Blog content authoring tools can easily be directly liked to RSS feeds. By inviting site visitors to subscribe to your RSS feed, they get a much greater amount of anonymity and you get a huge drop in stress and no possible way of being accused of spamming. But for the moment, you can't reach the same audience with RSS that you can with email. But t writing is on the wall. RSS, or more precisely the idea of RSS as a means of people gathering up information that they like will likely replace the "pushed" architecture of the email newsletter in time.

Wednesday, October 18, 2006

Friendly Fire in the War on Spam – Part 2: Blacklists

Part 1 | Part 2 | Part 3

There are several organizations that maintain blacklists of IP addresses that send out spam. Internet service providers (ISPs) subscribe to these lists to filter out email that comes from these sources. The idea being that this will keep spam from being delivered to their email users. There is no silver bullet for spam and this can be a heavy-handed practice. It works fine when email comes from a private IP address, but what if someone with a large ISP email address, like yahoo.com, starts sending out spam? Should the originating IP address be blocked? This could block every email that comes from a yahoo.com email address. There are plenty of legitimate non-spamming users who have @yahoo.com email addresses. I use yahoo as an example, but this could be applied to any ISP. Most blacklist managers are aware there are large numbers of legitimate users out there and generally do not blacklist larger service providers without good reason. An example of a good reason is when an email service provider shows a total inability to monitor and control spam that originates from their network. This is a real problem for email service providers. Naturally they want customers but at the same time they must monitor and deny service to customers who are spammers. They effectively have to look for customers to turn away. Never the less, no ISP should tolerate spamming in their network. It has serious repercussions on their legitimate users. If an ISP becomes blacklisted, legitimate customers don't get the service they pay for.

Legitimate email users should be aware of this. If your ISP harbors spammers or is soft on spam, there is a chance that your ISPs IP addresses will be added to a blacklist or has been added already. These may well be the same IP addresses that you use to send email. As a result, your email can be labeled as spam, regardless of the content. The best defense is to use an ISP that has a strong anti-spam policy and avoid working with the ISPs on this list.

Get out of there:
You should avoid ISPs that are "spam friendly" or "spam infested." There are plenty of ethical considerations but they should be avoided for tangible reasons. Spam exploited ISPs generally suffer from poor server performance and lost emails. You can also become associated with spammers just by your relative proximity to each other on the internet. This can lead to frustrating returned emails and long sessions arguing with blacklist managers and your ISP to get the common IP address you share with spammers released. The best bet is to avoid these ISPs all together.

Newsletter Problems:
Blacklists can be a major problem for those who send out email newsletters. One of the things many email newsletter management services don't talk about is their delivery rate. Because newsletter services send out so much email their IP addresses are constantly fighting a battle against being blacklisted. Most of the time newsletter services are in the right. It's usually a case of an email behaving like spam or one of their customers making a mistake that trips a flag. This can lead to the newsletter service provider having their IP address blacklisted.

What you need to know is whether or not the IP addresses of your newsletter service provider have been blacklisted. Some services never make any claims to their delivery rate, only how many emails you're allowed to send… with no assurances that your email will ever arrive. One service provider that does speak about this issue is Constant Contact who takes managing the reputation of their IP addresses quite seriously.

Friday, October 13, 2006

Friendly Fire in the War on Spam – Part 1: Filters

Part 1 | Part 2 | Part 3

Not only is spam incredibly frustrating, it continues to hamper legitimate business in new ways. Sending out honest email newsletters is becoming increasingly difficult for a number of reasons. Most of these are the direct result of entanglements with tools and protocols that are in place to protect users from spam.

A big problem with spam prevention today is that most anti-spam software can report "false positives" where legitimate email is labeled and treated like spam. The spam filtering software looks over an email message if it fits the profile of spam. This can be done at the server level, an IT department's Exchange server, or at the client level, a copy of Outlook or Eudora on a desktop. The problem is that determining what is spam and what isn't spam is a very delicate job. Unfortunately most anti-spam software just isn't up to it. You run the risk of either tossing legitimate email in the trash without seeing it or only eliminating a small fraction of incoming spam. Granted that cutting out half of the spam you receive is a positive step but it's hardly an ideal solution especially when you loose real email in the process.

Dealing with incoming spam:
In my experience, most anti-spam software causes as much hassle as it prevents. This is especially true for people like me who depend on email for new business leads. Those of us in this situation simply cannot afford a false positive because that costs us business. For a long time my solution was to run a spam filter on my email client at a low level. Set this way it would flag obvious spam and let the rest through to my inbox for me to deal with. I still had a ton of spam coming into my inbox but it wasn't quite as bad. Even with a low grade filter I had to skim through my spam folder once per day to look at hundreds of emails to avoid throwing out something important.

The problem with these types of filters is that the software is making a guess. Emails that have blank subjects or subjects like "hello" or "hey" look a lot like spam. Heaven help you if you actually happen to be in the mortgage business or work for Pfizer.

Better than filters:
Since software isn't up to the task of determining what is spam and what isn't spam what can we do? Cloudmark has developed a unique and quite brilliant solution to the problem. Rather than rely on software to make judgment calls on what is or isn't spam, Cloudmark leverages the opinions of millions of email users. Here's the process in a nutshell: The vast majority of spam is a basic message that gets sent to a large number of people. Everyone with Cloudmark's software has the option to mark an email as spam. When a message gets marked, Cloudmark reads this as a "vote" to label a message as spam. When a message gets enough "votes" Cloudmark's software gets updated and removes future occurrences of that message from everyone's mailbox. The genius of this is that Cloudmark only marks something as spam if several people have marked it. If you get a new business lead from an individual, there is no way that email can be flagged as spam by Cloudmark because it is a unique message. No one else has received the email other than you, so no one else could have marked it as spam. No more false positives!

Monday, October 2, 2006

Internet Marketing Strategy - Tech vs. Creative

There is a traditional battle in web design between the technical people and the creatives.

Tech – "What good is a website if no one finds it?"
Creative – "What good is being found if no one does anything with it?"

I tend to think of myself as a "creative" (although my background might speak to the contrary) and I'm usually an advocate for the creative aspects of web design: supporting the brand message, dedicating resources to interface design, and refining usability. Getting my "creative way" has often meant headaches for the technical folks and vice versa.

Back in 1996, many were of the opinion (myself included) that SEO (search engine optimization) was a fool's errand. The eyeball economy had not yet started. There was so little traffic in niche markets that it didn't seem worth the effort to compete in search engines. Conventional thinking was that you'd be better off with a compelling "destination" website, some traditional, proven marketing techniques, and fundamental SEO tactics rather than spending exorbitant resources competing for search results with no guarantee of any ROI. However, the web has changed a lot since then and we need a new web-marketing paradigm.

The amount of information accessible online today is incomprehensibly large. While this makes the Internet a fantastic resource, finding information can be daunting and being found online is extremely difficult. Enter SEO. The arguments traditionally made by programmers and technically-minded web developers carry more weight today. The reality of the modern congested webscape is that being found is 90% of the battle… maybe more.

Even though Google provides 600 trillion results, we know most folks typically don't go more than about 3 pages deep. So why bother? Because of these two modern realities:

  1. The cut-off really IS that abrupt. Back in the day you could count on a few people to power through the first 10 or so pages of results looking for your site. Today content is more abundant as there are more sites offering up information and search engines are getting smarter. Today the top 30 results are actually close to relevant! So instead of having to sift through the first 10 -20 pages of nonsense, search engine users can actually find good information on the first few pages of results.

  2. The payoff is huge! There are so many people out there using search to find so many things every day that the number of searches preformed, and the resulting number of clicks, visits, and purchases is so high that if you manage to get into the top 10 results the amount of business that this yields will likely be enormous (provided you haven't made any other gigantic web design/marketing errors).

So what does this mean? It means that SEO is no longer trivial. It's still a risk, but making it to the top of results has a huge pay off.

In short, getting found through search has practically become an all-or-nothing prospect. And the "all" is so big that even a website with terrible design will do well because even the small percentage of visitors that make it through the poor design will still be a large number.

Now don't think that SEO is a silver bullet. There can only be 10 sites in the top 10 and all of your competitors the world over want to be there just as badly as you do. SEO is less about a marketing strategy and more about trench warfare… with about a million trenches. Know what you're getting into and don’t think of it as a single ad or even a single campaign. SEO is a long, process of modifying, tweaking and monitoring. Search engine rules change and content is always king. It's nearly impossible to stay ahead of the curve. The trick is to keep up with it enough to surf.

Saturday, July 8, 2006

Blogging!

Oh the irony… I'm about to cause a total paradox… I'm going to blog about blogging. I'm sure I'm not the first person to do this, but if the people that access this blog are the people I hope they will be, namely my clients, I thought I'd go ahead and put together a short how-to on the subject.

Why Should I care?
- Consider Blogging a marketing effort.

I'm sure you're no stranger to the idea of sending out a newsletter to remain top-of mind with your clients and prospects. Blogging is a natural extension of this. Now, many people try o send out newsletters via email. This is a very solid and sound tactic. Unfortunately, it's also a task that al too often gets put off, ignored, and as a result happens far less frequently as it should. This is one of blogging's biggest appeals. Blogging is a relatively coarse medium. There's no need for polish or refinement. It's a come-as you are medium. Just string together a few paragraphs to make a point and you're in business. The tools make it easy, and there's no danger of spamming.

But the big deal is this - People find websites via search engines, and search engines like text information. A great way to get found is by sharing information in a blog. You can provide your contact information right in the blog itself or link back to your website.

How do I get started? – You're already halfway there!
Well it's alarmingly easy, especially if you're already here. You can do as I did and head straight to www.blogger.com. Sign up for a free account, create a title for your blog, pick a design template and start typing. Presto-change-o! You're now a blogger!

Now blogger has it's share of critics and many people feel that www.wordpress.com is a superior product. I'm not as familiar with it, but blogger.com is completely free. It's a good place to get your feet wet in this world of real-time publishing. Good luck and let me know how it works for you!