I'm Aza Raskin @azaaza. I make shiny things. I simplify.

I am the cofounder of Massive Health.

 

Cognitive Shield for the Firefox New Tab

As we iterate on the new tab design for Firefox, we’ve run into a seeming paradox. The new tab screen should have two main functions: (A) To show you the sites you are most likely to be interested in going to, and (B) to not distract you. That’s the paradox: by design success is when the pages we show are maximally interesting/distracting, but an explicit goal is to not interrupt your flow.

This iteration focuses on solving that paradox by proposing a solution that we’ve dubbed “the cognitive shield” (coined by Alex Faaborg).

The Cognitive Shield

No matter where we put the links to your most visited sites (and their latest news), it always seemed to be a distraction. Our original thought was to place the links along the bottom of the page — outside your foveal vision. In practice, the peripheral vision proved too strong, and the links still drew your eye and interrupted your cognitive flow.

The cognitive shield hides the distractions until you move the mouse. Then the links fade in quickly.

Here’s the thinking:

If you are typing a destination into the navigation bar, then your locus of attention is on the place you are trying to go — so we should stay politely out of your cognitive way. On the other hand, if you are using the mouse than you will probably benefit from the mouse-based navigation aid, so show it.

Whether you are using the mouse is a good indicator of whether you are in a cognitive flow or not. That realization resolves the paradox: the links are there when you need then, and not when you don’t.

The Design

The design of the cognitive shield is a ring of 8 circles (designed by Edi Lee), each containing one of your top-visited sites. We think of it as a personal watermark.

We went through a number of metaphors for the cognitive shield.

Instead of a metaphor which always strains — what symbol represents frequently used sites? — we went for the abstract glyph.

Known Bugs

There are a couple more features we’re in the process of adding. In particular: The ability to manually add a site is entirely broken. There’s no way to change the total number of frequently visited sites shown. There may still be encoding problems for non-roman scripts. Middle-clicks may be broken. The visual style needs a refresh. And the sites don’t remember their new positions post restart.

Testing the Prototype of New Tab

Step 1. Download and install the latest development build of Firefox 3.1.
Step 2. Download and install the latest version of the New Tab prototype.
Step 3. Let us know what you think, including what works, what doesn’t and how we can improve the design.

RT @azaaza Cognitive Shield for the Firefox New Tab | Follow @azaaza on Twitter | All blog posts

Tags: ,

View all 47 comments



Dmitry

The idea with icon circle which fades and becomes replaced by a list of sites is not a good one imho. The user tries to focus mouse pointer on that circle believing it’s some kind of action menu and then on the half-way to the target, the circle disappears instantly and a list appears in it’s place. The user loses his initial target and gets confused by a new one, differently arranged set of targets.
His initial thoughts will be “Am I doing something wrong? Why is this circle menu evades me? How do I get to it?”, or “There is something broken here”



Simon

Not having tested it (but liking the design idea):

* Will tabbing into the content area make the list (and the feed provided goodies) keyboard accessible? Requiring a mouse wouldn’t seem right.

* Will moving the mouse away from the list return the display to the “Shield”? Or how else can I quickly return to a (mostly) privacy insensitive state?

* Is it intentional that the current “Shield” design doesn’t contain as many icons as the corresponding list does? If so, isn’t it supposed to be a subtle clue about what you’ll get when mousing towards it?

And the one feature I’m missing from Chrome: Can the new tab page be easily configured to display the first few bookmarks from my personal toolbar instead of the most visited sites from history (those are my to-do-list: where I plan to go soon, not where I’ve already been).


This is definitely a tough design problem. One thing I’ve noticed is that I find myself sometimes moving the mouse to click in the url bar.

I don’t always notice that, when I open a new tab, the url bar is in focus with the blinking cursor. So, I move the mouse to click in the URL bar, which makes the cognitive shield do something that attracts my attention, the exact opposite of what it is designed to do.

I have no data to back this up, but I think it is probably pretty common for people to click in the url bar even though the cursor is already blinking and ready. In my opinion, the people that open a new tab and just start typing might be more advanced users.



Mike Beltzner

The iteration here is great, but I think it’s important to point out that it was based on:

– feedback from people leaving comments here, talking about it in hallways and on IRC, etc
– a few designers working through those problems to come up with solutions, proposing ideas, convincing each other, modifying throughout
– some insights which led Alex to come to idea of some form of “cognitive shield”
– then a bunch of iterations on what such a shield would look like
– then some quick coding work from Ed to go from whiteboard mockup to prototype

The process here was awesome.



Al

Dmitry is right.
Better something like ‘expande a list’ from the circle when the mouse hover it.
lis1:::| ( ) ( )
lis2:::|::::( ):::> ( )
lis3:::| ( ) ( )
The dots are the change in the bg of the circle and the list (eg. from #FFF to #FFF5EE.)
Maybe just like a a Pie Chart



Chris

I’ve been following this iteration process and it seems like you’re burning 90% of your time on the last 10% of the work. Maybe you should just pick something and move on.


>So, I move the mouse to click in the URL bar, which makes
>the cognitive shield do something that attracts my attention
>the exact opposite of what it is designed to do.

I agree, we need to require the user to mouse to that side of the page (or give the context area the keyboard focus) before we fade the water mark. The current implementation triggers way too easily and gets a lot of false positives.



Stampie

I second Dmitry: I could not imagine what was the rationale of this shield idea until I read now this blog post.

Maybe if instead of changing the shield to a list you would be changing it to a circular menu by a visible enlarging process, it would be easier to understand what is happening with these items. I don’t know whether it is a good idea or not, but maybe worth a try.


I like me some eye candy, but I’ll still be ^T’ing. I like to make single letter keywords for my favourite sites too, even less typing. I may be wrong, but as fascinating as this is, I don’t think I’ll get any use out of it.


I had the same reaction as Dmitry: the shield attracted me, so I started to move the pointer over to it, whereupon it transformed into the list, surprising me. So I reloaded the page and tried to race the transformation, moving the mouse over fast enough to hit the shield and press one of its buttons before it faded away. But I could never get there fast enough. I did that about half a dozen times before giving up in frustration.

It wasn’t obvious to me that the shield represented the same information as the list and that the goal of the shield was to attract me to the list.

That said, the shield still appeals to me. It feels both easier to ignore when I don’t want to interact with it and more attractive when I see it. But I suspect it would be better to let the user access the content represented by the shield through the shield itself rather than taking the shield away as the user moves towards it.


Isn’t it more likely that when I open a new tab, I’m going to go to a site I’ve already been to?

In that case, it seems like the url bar is actually the distraction from me getting to the link I want f that link is already listed right on the page and I can click on it.

If I open a tab to go to a link and you can present that link for me on the blank tab so I can click, rather than type, or have to search with the awesome bar, then you’ve saved me time, not distracted me.


Great to see the iteration here, but the shield isn’t feeling right to me, and I’m trying to put my finger on why. I think it comes down to the RSS aspect of the frequent sites page.

The last iteration, dropping the thumbnails and giving me finer grained control over the site list, was a revelation. My weather site is pushing weather details there, planet.mozilla is showing me the last several articles. It felt *good* to have the browser smartly anticipating my needs there.

In this iteration though, I don’t have any of that at a glance, and having to new-tab-then-mouse feels halting when I use the keyboard, and sort of unnecessary when I use the mouse, since the circle disappears instantly.

I also found it surprising, as Myk reports above, that I couldn’t use the shield as a set of targets for launching things. “Yes, I want to go to flickr — hey! Where’d it go?”

I get the idea of avoiding distraction though, and I’m not resisting the approach, just reflecting on the experience here. I do wonder if I would find the transition less jarring if the circle animatedly “unwound” itself into the list format? That might help me target better too, since I can see the movement and anticipate the final position for a ballistic mouse move.

Just some thoughts, I really do enjoy the iteration happening here.


>that I couldn’t use the shield as a set of targets for launching >things. “Yes, I want to go to flickr — hey! Where’d it go?”

I think that’s mainly a problem with the design of the shield, it shouldn’t ideally even look like a target. I’m imagining something that really is like a water mark.

>My weather site is pushing weather details there, >planet.mozilla is showing me the last several articles. It felt >*good* to have the browser smartly anticipating my needs >there.

I think we should allow direct navigation from the bookmarks toolbar to a full page of interesting ambient stuff, perhaps replacing the “most visited sites” smart bookmarks folder. The difference there though is that you are initiating the action.


Aza, thanks for the great post on the thought process. I have to say, though, that I agree with the Dmitry-Myk-Johnathan thread here, that I was immediately tempted to click on the icons.

I personally was really loving having the list of recently visited sites immediately displayed on the right in that gray column fashion… perhaps just display it at first with a very low opacity and/or blur, in lieu of the shield?


I experienced exactly the issue that Dmitry describes. It took me a while to realize that the circle and the list actually represent the same thing and that I don’t need to “go back” to the circle to choose a site. It looks too much like a UI element.


Hi Aza, I liked the article and concept. However, when I downloaded and am trying to get to the cognitive shield, I don’t find it. We should make it pretty easy for users to locate and use it. May be a menu option to turn it on with more opacity. Considering that I am a savvy computer user and still find it quite abstract, more general users would find it even more abstract. Great idea nevertheless.


Thanks everyone for the comments. I feel rather silly that I didn’t fully appreciate the problems that people would have with the design of the shield. I expected folks to maybe try to click on the badge once, but then realize it was only a graphic. That doesn’t appear to have been the case!

In the latest version, we’ve removed the graphic and instead just desaturated the list until mouseover.



freibooter

I personally don’t like the fact that the shield – and whatever form, circle or desaturation – is lifted even if the mouse accidentally hovers over some of the enormous whitespace of the new tab. It would be better if that only happened in closer proximity to the actual menu.



Greg

I don’t know about the rest of your, but I’ve noticed a drastic slow down in performance between the last iteration and the shield iteration as well. I realize that its not a finished concept, and I do like the over all concept (even the watermark isnt a horrible idea, because I have noticed that links on the new tab do make it more distracting). It reminds me very much of the old Firefox Journal plugin, which I personally thought was very well implemented and provided great functionality before it fell out of support.


fourthing or fifthing the comments about the shield. As Dmitry and Myk and Johnathan mentioned, my initial reaction was, “ooh! circley!” and then “it was here a second ago, where’d it go?”

I really like the information down the side as Johnathan says. It gives you some ambient information and presents a list of recent locations. I’m not sure it remembers my choices in terms of where I place things in that list or if I remove them though. The ordering seems to reset every time I visit one of those sites.

What about including bookmarks in some form? The bookmarks toolbar takes up unnecessary space, imo. Being able to point at a Places folder and say, “put this on my new tab screen” would be pretty ace.



Jim Jeffery

Tried this out this morning on a fresh profile. The first thing I was when I hit Ctrl+T was of course the ‘New Tab’ & my login ID for my bank account ! What ? New profile, no history, nothing.. where the heck did that come from? I don’t even use Minefield/Firefox for my bank since they (bank) don’t like me changing my browser several times a day while testing, so I use IE8.

After some more testing I noticed a black bar across to top of the ‘New Tab’ that was broken into white boxes.. Highlightlng the white boxes revealed information about a site I had visited. Strange its there rather in the body of the ‘New Tab’.

I never could get a ‘list’ of sites to appear even after repeatedly opening/closing several sites in tabs… The only thing that was showing up was a link to a bug.. A bug I had never visited with this ‘New Profile’, again where the heck did that come from ?

aka
Littlemutt



Jim Jeffery

I copied over my places.sqlite from my usual profile into the test profile and now the sites are listing as they should.

However, I see another problem. There is a * (star) in the lower left corner. Clicking this seems to ‘toggle’ off the listing of sites, however when opening a new tab the location bar has ‘focus’ but this string is also there:

chrome://abouttab/content/tab.html

This messes navigation if I know what site I want to visit, as its ‘appended’ onto the string above, and of course navigation fails in ‘Site not found’.

Shouldn’t it just be like now, a ‘blank-tab’ with the cursor in the Location-bar ?

Sorry if this has already been mentioned.

aka
Littlemutt


I agree that the sheild doesn’t work very well. You aim for one of the circles and they all disappear. You get kind of stumped by the list that appears in its place.

How about just having a very faded list which is saturated when you mouse close to it or over it? Or did you already try that? (Can’t remember all the different versions now.)


Oh, now I saw your comment Aza. Good idea!

BTW, the font you’ve chosen in the “Undo bar” for the web page title is not very readable and a bit too small if you ask me. (I have ClearType enabled, if that makes a difference.)

I’d suggest making it the same size as “You recently closed the tab”, make it *not* capitalized but bold instead.


This is a bit off-topic, I guess, but I’d like to cast my vote in agreement with Jim Jeffery’s comment. Will there be an option to disable this feature?


Some major problems with the dots iteration were:

1) People expected it to be a target (it kind of looked like a target)
2) There wasn’t a good mapping between the shield (used to keep you focused), and the information that appeared
3) The display activated too easily, hit control-t and then moved the mouse to give the location bar the focus (even though it already had it), or moused into the new tab as the next page was loading, it triggered even though you didn’t want to view the list.

Here is a new iteration that solves those three problems while still maintaining what I think is good about the design:

http://people.mozilla.com/~faaborg/files/20090324-notificationsAndFlow/shieldi2.png

I also have a post up about the objectives of not showing the user compelling information that is unrelated to their current task, unless they directly ask for it:

http://blog.mozilla.com/faaborg/2009/03/24/notifications-and-flow/


I am using the latest iteration of About:Tab .34 and I enjoy it overall.

I feel like the new tab page should have a instant search box built in at all times. I remember this in one of your original mockups Aza. I know there’s already search within the browser chrome, but a search on the new tab UI would be nice as well.

I like the ability to move the frequent sites around, but the three-line icon used to provide this ability it somewhat confusing. I’m not sure users will understand visually what it’s for. When you click on it and mess around it becomes clear, but not until then.

You should provide a quick option to turn RSS on or off for the frequent sites. I’m not sure how I feel about it – it seems too busy.

I think Apple’s Top Sites new tab UI for Safari 4 is wayy to glamorous. I like the simple and fast direction that Shiretoko is heading. Keep it up. I love some of your original mockups for this so maybe go back and retool some of those.

-Matt


Aza and Alex – I just asked my wife (who is a typical Firefox user and non-technical) what she thought the new tab page should be. Here’s what she said:

1) She is forced to have her homepage statically set (for work), so she thought maybe give her options for a secondary or even a third homepage that could be executed during Firefox start or access those secondary homepages through the new tab UI. Basically she’d love to have easy access to other pages besides her work homepage.

2) She thinks frequent sites are useful, but also most recent sites should be included in the UI somehow. For example, if you’re working on a project or doing some research and you have to come back to it later, you can open a new tab and there will be the last 3 or 4 sites you were visiting.

3) She agreed that a blank new tab page is 100% not useful :)

4) She wanted the new tab page to be easy to understand and quick.

Hope that helps. I might ask some other non-technical users what they think and put that on here as well.

-Matt



Mike

I think designing interfaces we should try to find ideas which could make interface and user experience simplier.

Maybe having a blank new tab is not a good idea at all. It’s not logical when for example you could have 3 or 4 blank tabs in your browser without any content there. Blank tab isn’t a good concept.

When user push the new tab button better to show him a layer with a field where he could write the website adress. Of course this field could be with the suggest. And when he entered the website adress and pushed enter browser will create a new tab and open website there.


How about a a nice large watermarked firefox logo in the middle of the screen? It should fade into a list when you move the mouse *over it*, otherwise it should just sit there quietly.

I know it’s not as “designy” as your congitive shield, but a big watermarked logo does not hold the “promise” of interaction as much as your (very visually appealing) 8-icon shield. Its circles look too clickable, and people will invariably attempt to click on them.



Laura Creighton

I am 100% in favour of Mike’s suggestion that having a
blank new tab may not be a good idea. I think it is a very
bad idea. But this is because I have never wanted tabs
to behave the way they do currently. What you get when you type control-T is a new window. But this is rarely what
I want. What I want is a _fork_ of my exisitng window.

What is not preserved, and which I want preserved, is the
history of the window I was in when I opened a new tab. For me the history is very important, and I like being able
to use the back arrow, and use it a lot, to see where I have been.

The problem arises when I wish to explore 2 directions
at once. What I want is a way to open up a new window
with the new link while preserving the entire state of what
window I am in now (one back arrow away) and the entire
history of that window as the history of the new tab, so that back arrows will go back through the common
shared past of both tabs.

Let me know if this makes sense. I know precisely what
I want, but I have so far been not that successful in explaining it. If this is confusing, I will try again.

Take care all,
Laura Creighton



Mike

I think laura is on point. When you open a tab in the middle of doing something, it usually pertains to what is going on, right now… Maybe your going to look something up at another site because its a ‘reference’ to the current tab. This makes sense because right now my tabs are (in order) “Tabs :: Firefox extensions” “Mozdev.org” “A google search for putting ‘history’ in a blank tab” and finally this one. Clearly im looking to make a blank tab one that’s history… or put my history in a tab. But that doesn’t matter — what matters is if i open a new tab… i don’t probably want to go to facebook.

It might be a better idea to try and PREDICT what I’m going to do. You can try predictions based on time of day (I’m on face book at this 8pm) or by immediate events (recently i used google at least 3 times) or possibly by objective or target — all my current tabs deal with — Tabs, History, Blank tabs.

In my mind, history is an under utilized function. So a new tab, should focus on history and probably 2 types of it: the immediate history (based on the “back button”), and the long term history.



Disousa

It’s pretty cool, though I’d suggest not having the “remove” text show up whenever someone hovers over the sites. Why not having a right-click option? It forces unwanted interaction but it’s a bit better in terms of not drawing attention away from what you are doing. Also, the text is a bit too dark. If you brighten it up a bit it will seem less intruding.

Oh, and the search boxes are a great idea.


Maybe if instead of changing the shield to a list you would be changing it to a circular menu by a visible enlarging process, it would be easier to understand what is happening with these items. I don’t know whether it is a good idea or not, but maybe worth a try.


The idea with icon circle which fades and becomes replaced by a list of sites is not a good one imho. The user tries to focus mouse pointer on that circle believing it’s some kind of action menu and then on the half-way to the target, the circle disappears instantly and a list appears in it’s place. The user loses his initial target and gets confused by a new one, differently arranged set of targets.



Sex

The idea with icon circle which fades and becomes replaced by a list of sites is not a good one imho. The user tries to focus mouse pointer on that circle believing it’s some kind of action menu and then on the half-way to the target, the circle disappears instantly and a list appears in it’s place. The user loses his initial target and gets confused by a new one, differently arranged set of targets.


Given the impact of the downturn in the labor market, GHD, has undergone mens belts cheap gucci belts many workers have no other choice, fixed-term employment cheap louis vuitton belts for men or agency. Therefore, some could change from low labor costs all on cheap desiger belts a regular basis. In other words, if they gucci belts on sale could move from poverty to escape C temporarily. The charity louis vuitton belts cheap says that government policy and legislation, MBT, on the basis of the phenomenon and requires change, including improved rights and conditions for employees to wear.


This iteration focuses on solving that paradox by proposing a solution that we’ve dubbed “the cognitive shield” (coined by Alex Faaborg).


Great to see the iteration here, but the shield isn’t feeling right to me, and I’m trying to put my finger on why. I think it comes down to the RSS aspect of the frequent sites page.


Not entirely what your article is about, but i think you should go the enzo humanized route with ubiquity and remove it from the browser.


Which was sort of inspiring! Completely unforeseen. Now I know what I am going to perform tomorrow


Nice!! I hope you will keep up the amazing work.


A lot of thanks for all of your labor on this web site. Kate take interest in going through investigations and it’s easy to understand why. I hear all relating to the lively mode you render vital suggestions via your web site and cause participation from other people on this idea so our own girl is actually being taught so much. Take advantage of the rest of the new year. You’re carrying out a wonderful job.


Maybe fans of Atlas Shrugged? If any actually have the capital to take on such an operation, that is….|


I’m able to imagine the hard work it must have been necessary to research for this submit.


whoah this weblog is excellent i really like reading your posts. Keep up the good paintings! You recognize, a lot of persons are searching around for this information, you can aid them greatly.


Good ¡V I should definitely pronounce, impressed with your web site. I had no trouble navigating through all the tabs as well as related info ended up being truly easy to do to access. I recently found what I hoped for before you know it in the least. Quite unusual. Is likely to appreciate it for those who add forums or anything, site theme . a tones way for your client to communicate. Excellent task..


Leave a Comment