Archive for November, 2006

Reading Spam

Nov 06
23

I’ve started reading spam. It’s not glamorous but there sure is a lot of it to read. When you start reading spam you quickly see some pattern.

  1. 98.9% of spam comes from people you don’t know. About .005% is from a friend who forwards me jokes or pyramid schemes. The remaining 1% is from websites that I’m registered too that send holiday emails.
  2. Spam communicates it’s message in two core ways:
    • Links to websites
    • Images within the text that direct users to call, email or open a web-page
    • Some messages have no link or actual content and seems to be trying to confuse spam blocking software so that future messages can get through.
  3. The text of a message tends to be semi-random meaning each message is semi-unique. Sometimes words have random characters, sometimes there is non-sense words and other times it seems to be random text copied from a random website.

I realized that modern spam filters have some serious problems:

- Bayesian filters will get tricked by random messages and content taken from the web
- Community filtering can’t flag all messages if the content is semi-random
- Image filters can’t recognize the text in an image if the image is random and the text in the image is sometimes random.
- Dynamic blacklisting can reduce spam but not eliminate it.
How about an alternative?

I’ll try to avoid the term ‘filter’ because this word implies that messages can get through the filter by tailoring content. No matter how smart the filter gets it’s possible to craft messages that will pass through. Any system that relies on ‘spam filters’ will have both false positives and false negatives.

Instead of filters let’s start with a basic trust system.

What’s a trust system? Ebay uses a good example of a trust system. Users establish trust and reputation over time. Anyone can give feedback on the trust relationship. The longer you have an Ebay account the more your trust grows over time. The same should be true for email.

There are many ways to build such a system but the easiest way to explain it is by comparing it to the Google page rank technique. Assume that every email I send is like an outbound link. Every email I receive is an inbound link. With your own email data you could compute the email rank of any individual. With an aggregated data set you could compute the email rank across a very wide range of people who use email.

Each email you receive allows you to give basic rating of positive and negative. Really simple.
New Users and Mailing Lists
When a new user enters the system they would have an email rank of zero. Their initiation into email would be to build a trust relationship with someone who has a higher rank. As the email is used the persons reputation grows and the validity of their messages increases.

Mailing lists that people subscribe to would have to build the same type of trust. As these mailing lists are used and as more people subscribe/opt-in the trust of the list grows. At Raizlabs we have a mailing list product and I’m always nervous that software designed to be used as a useful tool for news and opt-in mail could be used by someone to send out spam.

Why is it that I know more about the trustworthiness of random people on Ebay then I do of the trustworthiness of email in my own inbox?

For more ideas on email check this out.

How much do we really see?

Nov 06
22

How much do we really see?

I came across an interesting video that asks us, how much do we really see? We all think we’re good observers and can watch closely and carefully but how often do our eyes really deceive us?

For example, how many times do the people in the white shirts bounce the ball on the ground? You can take a look at this video here. Watch it only once and no-pausing, the ball sometimes moves fast so pay attention. I’ll wait for you to come back.

————————————–

No cheating, go watch the video if you haven’t already.

How many people counted 10 bounces? Perhaps 9, or 11? Ok then. How many of you noticed the gorilla? You didn’t see the gorilla? It was right there in the middle of the screen! Go watch it again.

For me this was a stunning example of how we sometimes can’t see what’s right in front of our eyes. It also makes me wonder how many other things happen every day all around us that we simply didn’t notice.

When is a DVD not a DVD?

Nov 06
21

When you buy a DVD you expect that your DVD will play in every DVD player. Well it turns out that the some DVD’s aren’t normal. In fact it’s questionable if they can even be called DVD’s.

I had a very annoying experience with the Matrix DVD. The Matrix DVD is not a normal DVD. I’ve had the disc for a number of years. The DVD simply won’t play in my new MacBook Pro. At first I thought it was a scratched disk but a closer look showed the disk was fine. It plays fine on my PC and perfectly in my DVD player. As soon as it goes into the Mac it starts to seek all over the disk preventing it from playing properly.

Doing some research I found that Warner Bros. did something wacky to their disks.
In tiny text at the bottom of the box. it says:
“The DVD-ROM features will not work on a CD-ROM or a Macintosh computer.”
Of course I don’t care about the DVD-ROM features, I just want to watch the movie.

The DVD-ROM features will not work on a CD-ROM or a Macintosh computer.
So now I have a so called “DVD” that I bought that I can’t play. What are my rights? Was I supposed to know that the DVD wasn’t going to play on a Mac? All other DVD’s play fine. Was it unfair for Warner Bros. to sell me a DVD that wasn’t actually a standard DVD. Can I return the disk years later? Is this a bug in the Apple DVD Player? Anyone else having the same problem?

Our relationship with computers

Nov 06
19

Dear Computer,
Enough with the pop-ups, the alerts, the toast notifications, the email dings, the buzzers, the bells the RSS notifications and messages. You do nothing but nag me all day. I’m done with your blinking battery indicator, and your endless yes / no questions.

When did we lose sight of our direction? Don’t you dare tell me you can’t delete the file. If I said I want it deleted, don’t argue with me. How can you ask me if I want the file saved? Of course I want to save it! I’ve been working on it for hours.

You don’t understand me. You never did. I wonder if you ever will. We don’t have conversations, we don’t interface. Two monologues doesn’t make a dialog. You have a great memory but you never remember what I like. You’re always off running random errands and other nonsense.

I don’t know if it’s going to work out. I’m asking you to change.

- Your Humans

Firefox for the Mac

Nov 06
12

I’ve been using my Mac for a week now and I have to say that Firefox for OS X is simply not as good as it is for Windows.

  • Load performance is slower. I’m using a faster computer then before so it’s not the CPU.
  • Some pages don’t render quite right. This is rare but certain pages look slightly different on the Mac then on Windows, it’s subtle and may have something to do with fonts. In some cases the page just looks wrong. Similarly some sites have links that don’t seem to work on the Mac version of Firefox. Click, nothing, click, nothing. I’m not sure what causes this bug.
  • Accessibility is much worse. In particular it’s not possible to tab into combo-boxes, radio-buttons, or regular buttons. Perhaps there’s a trick to this but the tab key seems to only moves between text inputs. Safari is much better in terms of Accessibility.
  • Sometimes it’s impossible to type. I’m not sure what causes this but placing focus in the URL bar and typing sometimes doesn’t do anything. I see the blinking cursor but when I type nothing happens. This seems to happen about once a day, I’m not sure why, and others seem to have this problem.
  • There is no way to take the browser full-screen. This feature is available in the Windows version but curiously absent on the Mac.
  • The bookmarks toolbar doesn’t show icons. Perhaps this is the Mac style but for me the icons help quickly identify sites by color. Having the option to see the icons would be helpful.
  • The bookmarks menu has an item called “Imported IE favorites.” Since this is a Mac and has never had IE installed I have no idea where this came from.
  • Controls don’t follow the look and feel of the OS. Buttons, combo-boxes, checkboxes don’t have the OSX look and feel. Instead they look like Windows 2000 controls. Only the scrollbars look like OSX.

Overall Firefox for the Mac isn’t bad but it’s also not as good as I expect it to be. I’m going to try Safari and see how it compares.

Building a better Digg Design

Nov 06
6

Many web designs have too much unorganized stuff on the screen. Much of this stuff is usually useful in some way but it’s unorganized and leads to a confusing page flow.

When you read a book you have a very simple page flow. You start at the upper left hand corner and you scan across and down till you reach the end of the page. This basic flow remains similar when people read read magazines, newspapers and web-pages as well.

Page flow can easily be altered by objects that grab your attention. These can be images, columns or text. These attention grabbers divert your natural flow. Visual blocks encourage the users eye to jump around the page until it stops on something interesting. The design of these visual blocks is core to how a page will function.

Let’s use Digg is a simple example:


Your eye will generally start at the upper left corner and drift diagonally down to the bottom right looking for things of interest. In this case we start at the logo, drift down the page. Each block of data will be quickly skimmed or ignored. A possible flow could be 1,3,5,6,7,9. Every person will scan the page differently but understanding a basic flow means that you should try to put important elements within the core flow.

The current Digg site places many navigation elements outside the main flow. The “top” navigation is along the left and secondary navigation is sometimes along the top and sometimes along the left. Because the navigation elements are scattered it’s harder to browse the site. The flow also decreases ad revenue because the ads across the top will be ignored as people scroll into the content.

I’ve done a basic mock up to illustrate an alternative flow:

Key Points about the design:

  • The logo larger and on a white background. This makes it easy to read and recognize. This also helps maintain brand integrity when people copy the logo and place it in a news article, post or publication. (Don’t fight this, help your brand get popular)
  • Secondary login information and profile links help users recognize if they are logged in quickly. This is near the top but outside the main flow so if a user scans quickly and misses this it’s not a big deal.
  • The top most categories are shown as tabs. This makes it easy to navigate between categories and provides consistent placement within the flow. You can’t scan down the page without seeing the top categories.
  • Many secondary navigation elements have been combined. All these navigation elements are filters and sorts on a possible list of articles. Having all these navigation elements together makes it easier to filter/sort by the appropriate criteria. When similar things are placed together they fit into a single flow block making it easier to parse.
  • I’ve left the main section alone. It could also be tweaked to improve readability but it’s pretty good as it is.
  • A simple flow also helps the page load fast. (This is currently a problem for the site)
  • The ads section is probably most altered. This seems like a place where Digg could do much better then vanilla Google ads. I’m showing a concept where users could Digg-up ads. The section is within the page flow and would scroll similar to the rest of the page. The section is clearly marked as advertising but something like this would generate amazing click-through, revenue and end-user enjoyment.

Mac Blue-ish Screen of Death

Nov 06
2

I recently purchased one of the new MacBook Pro Core 2 Duo laptops. The laptop is well engineered and offers a great way for an interface designer to explore multiple operating systems with a single computer (or so I thought).

I purchased Parallels software to allow me to run Windows, and as soon as I ran the software the computer crashed. This is essentially the Mac version of the blue screen of death. Everything locks up, I can’t move the mouse I can’t cancel the operation. Here’s what it looks like:

The screen text in the center of the screen reads…

You need to restart your computer. Hold down the Power button for several seconds or press the Restart button.

Hey Mac, I thought you didn’t crash?