PhotoSynth at TED

PhotoSynth is a Microsoft technology that I have talked about before, it’s certainly one of the most impressive visual technologies I have seen.  Here’s a video of Blaise Aguera y Arcas at TED this March presenting PhotoShop to the conference attendees and getting a standing ovation … quite deservedly in my opinion. The video is also a great introduction to the technology and what its capable of doing.

I agree with Blaise when he says Simply put, it could utterly transform the way we experience digital images.

Twelve months at Talis

So much has been lost, so much forgotten. So much pain, so much blood. And for what, I wonder. The past tempts us, the present confuses us, and the future frightens us. And our lives slip away, moment by moment, lost in that vast terrible inbetween. But there is still time to seize that one last fragile moment. To choose something better, to make a difference ... and I intend to do just that.

Yesterday was an anniversary of sorts, it marked the end of my first twelve months here at Talis. I was chatting to Ian on the train home last night and as always he asked me how I’m getting on, and I’m happy to say that im still loving everything im doing. I’ve learnt more this last twelve months than in the five years I spent at my previous job. It’s an fantastic environment and its been incredible working alongside a group of extremely talented geeks. I feel like I have grown a lot this past twelve months and not only learnt new things but learnt new ways of thinking about problems.

When I joined Talis I was looking for a new beginning, I guess there was a part of me that needed to start over and that needed more than anything else to forget the past. I certainly found that new beginning here and it’s helped me to find my direction again and a sense of purpose … it’s helped me make some wonderful new friends along the way … but most of all I finally feel like I’m actually making a difference.

GimpShop … It’s Gimp for Photoshop Users

For anyone, like me, who is used to using Adobe Photoshop making the transition to The Gimp, which is it’s closest Open Source equivelant,  has always been really difficult largely because we are so used to the Photoshop terminology for features and functions and it’s keyboard shortcuts. We get so used to doing things in a certain way in Photoshop that the second we try to use The Gimp we simply want to give up!  I know I have on many occasions!

Then along comes Scott Moschella, who has taken the Open Source GIMP and made some tweaks to it! In short he’s hacked The Gimp to make it more accessible to Photoshop users:

If you’ve never used Photoshop before, you may not appreciate my GIMPshop hack. What I’ve done is renamed and reorganized GIMP’s tools, options, windows, and menus to closely resemble Adobe Photoshop’s menu structure and naming conventions. Many of the menu options and even whole menus were recreated to faithfully reproduce a Photoshop-like experience. After running my GIMPshop hack, you’ll find that Photoshop and the GIMP are strikingly similar.

Scott has done an amazing job, it’s not a 100% 1 to 1 mapping but it’s close enough for me, and means I can actually be productive in The Gimp!  To get a feel for how close it is compare these screenshots:

The Adobe Photoshop Edit Menu:

..and now its GimpShop equivalent:

You can download GimpShop for free from Scott’s Site here. I strongly recommend this to anyone out there looking for an Open Source, or lets face it a Free, equivalent to PhotoShop!

Microsoft adds copyrighted books to its Live Search

Microsoft has added copyrighted books to its online library, stating it has permission to offer the works t searchers on the internet .  They have made deals with with authors and publishers to include their works in the Live Search, and in doing so Microsoft have managed to sidestep the controversy that Google initially triggered when they began their book digitising project to offer the worlds written works online.

User’s have to log into Live Search in order to read the content online, it appears that user’s can only read a certain number of pages and the software keeps track of how many pages visitors have read online for free. Most of the searches I have performed allow me to read 10% of the pages in any Copyrighted book that I’m browsing. I actually find this far more useful than simply being able to browse the table of contents or view selected extracts as one can in Google’s Book Search. This enables me to make a more informed decision as to whether I want to go and buy the book, and also, if im just searching for the answer to a question or need to read up on a chapter on some specific subject, I can read those bits for free online which probably will mean I wont need to go out and buy the book.

Amongst the publishers who have agreed to allow this type of access to their materials are Simon and Schuster, Mcgraw-Hill, Rodale and Cambridge University Press. Microsoft obviously provide direct links to where the books you are reading online can be purchased from. It’s an interesting move by Microsoft when you consider that Google’s wholesale scanning of copyrighted works in library collections will give it a larger database of books, but by working with publishers and obtaining their permission, Microsoft is seemingly able to offer a better experience to users.

JavaScript can provide a richer user experience without compromising Accessibility.

When Rob and I originally put Cenote together one of the constraints we had to work within was that the application must work without relying on JavaScript. This is primarily because relying heavily on JavaScript can introduce some accessibility issues, these issues include:

  • Making Navigation difficult: Site’s that rely on JavaScript can make it very difficult to navigate around a site using a keyboard or other assistive technologies, and impossible if JavaScript is disabled in the browser.
  • Hides Content: Sites that rely heavily on JavaScript can present content and functionality to the user that is not accessible to assistive technologies, such as Text Readers.
  • Removes User Control: User’s have no control over automated content changes. For user’s have no accessibility needs this isn’t a problem, but for users who rely on assisstive technology there is no way of knowing that content has changed. This can prove to be very confusing/disorienting since this can also involve altering normal browser functionality and triggering events that the user is not aware of.

This doesn’t necessarily mean that pages that contain JavaScript cannot be fully accessible, such pages can be accessible if the functionality is device independent ( in other words it does not require only a mouse or only a keyboard to work ) and the content is always available to assistive technologies.

So based on this knowledge Rob and I made the conscious decision that what we would do was develop Cenote first without using any JavaScript at all. This would ensure that the content rendered on the pages was always available to assistive technologies. We agreed that we could then use JavaScript to enhance the user experience by using JavaScript to manipulate the DOM of the page in the browser.

To see this in action visit this page in Cenote, if you scroll to the bottom of the page you’ll notice a list of libraries that you navigate through using a paging control (pictured). You’ll also notice that the book jacket in the top left hand corner of the page that has a nice reflection effect. Both these effects are made possible through JavaScript, and provide a slightly richer user experience. To see what I mean try turning off JavaScript in your browser1, and hit refresh. The page now displays the book jacket without the reflection and the complete list of libraries without the paging control.

So how is all this achieved? Well lets take a closer look at how the paging control. The snippet of html below shows a simplified2 version of markup that actually represents the items in the list3, take particulare note of the empty div after the unordered list this is the placeholder we inject the paging control into:

  1.  
  2. <ul id="Libraries">
  3.   <li><a class="item-library" href="#">Aberdeenshire Libraries</a></li>
  4.   <li><a class="item-library" href="#">Barnsley MD Library</a></li>
  5.   <li><a class="item-library" href="#">Blackburn</a></li>
  6. </ul>
  7. <div id="pagingcontrol"></div>
  8.  

Now when you view the page without JavaScript enabled the browser renders this markup exactly as it is. Accessibility or Assitive technology only use the HTML markup on the page. In the case of Text Readers this HTML is parsed and the software reads the content on the page back to the user. Now when JavaScript is enabled the markup on the page does not change, it stays exactly the same. We use JavaScript to manipulate the browsers DOM which is the model the browser generates internally to represent the page. Now in the example above the Unordered List is identified using the id “Libraries” which makes it easy to find in the DOM as this snippet of code illustrates:

  1. span class=”st0″>’Libraries’‘LI’

Here we use its identifier to find the unordered list we want to augment with our paging control. Each list element in the unordered list is what we refer to as a holding, we simply extract the contents of each of those nodes and temporarily store them in an array called libraries. In the case of the page I pointed you to earlier this array would contain 50 items.

Once we have found and copied the original complete list of libraries we can now proceed with updating the DOM to display to the user only the first 10 libraries, and render a paging navigation control. The function below updates the DOM by removing the original contents of the Libraries node, and replaces it with 10 items indexed from the specified startPosition.

  1. span class=”st0″>"Libraries"‘<UL>’‘<LI>’ + libraries[x] + ‘</LI>’‘<LI> </LI>’‘</UL>’;
  2.         renderNavigationControls();
  3.     }
  4. }
  5.  

The final line in the function above calls a method to render the navigation controls which I’ve copied below. You’ll notice that we find the placeholder identified by “pagingcontrol”, and render the preview, next and individual page links ( renderPageNumbers() ) into it.

  1. span class=”st0″>’pagingcontrol’‘<a href=\”javascript:printPreviousPage();\” alt=\”Previous Page\” title=\”Previous Page\”>< previous</a>’‘< previous’‘  ‘ + renderPageNumbers() + ‘  ‘‘<a href=\”javascript:printNextPage();\” alt=\”Next Page\” title=\”Next Page\”>next ></a>’‘next >’;
  2.         }
  3.     }
  4. }
  5.  

To reiterate, because this technique manipulates the DOM, the original markup isnt changed at all. Project Cenote was recently open sourced you can download the entire source base, which includes the javascript file, pagingcontrol.js, from which I took the extracts above, and get a feeling for how it works and experiment with it.

Now the above example might not seem all that impressive, its just a little paging control, right? Well, its a simple example that illustrates the technique which can be very powerful. Consider the following images which show a Calendar that view that was created by one of my colleagues, Andrew, which uses an unordered list to represent a series of events, and that’s what you see when JavaScript is disabled:


However with JavaScript enabled the DOM of the page is rewritten and combined with some CSS it looks like this:

Now thats more impressive, right? I hope this serves to illustrate how you can use JavaScript to provide richer user experiences without compromising accessibility. It’s an area I’ve been thinking about a lot recently and there are wider issues around how to develop better JavaScript libraries that understand how to expose dynamic content that needs to be accessible and whether this needs to be considered a best practise that more developers need to adopt. These issues beginning to have wider implications as my friend Alan put it earlier this week:

it will address issues of how traditianal HCi changes in the face of web2.0: when people are doing mash-ups (so there are more ‘artisan’ interface constructors), or end users configuring their own spaces (as in MySpace), or how you build ‘good practice’ into javascript libraries like prototoype or yahoo! YUI

.. when he contacted Justin and me earlier this week and invited us along with others from Talis to attend this years 2007 – British HCi Conference taking place at Lancaster University. Recognising how we to develop best practises for the development of truly accessible Javascript libraries is one of the issues I’ll be raising to the panel when I attend the conference.

  1. In Firefox you can achieve this by going to Tools -> Options -> Content and uncheck the box labelled JavaScript. However if you don’t already use it I recommend installing the Web Developer extensions for Firefox [back]
  2. I’ve removed the url and the title attribute and the icon image from each link to simplify the example [back]
  3. I’m using Dean’s Syntax Highlighter but specifying html means that the Snap Shots tries to execute against it, so I’ve specified XML instead [back]

Google Gears – Building Offline Web Applications

Google has released Google Gears, a new technology that is designed to overcome the single major drawback all web based applications suffer from: they don’t work without an internet connection! Google Gears is an Open Source framework, which is essentially a browser extension that is powered by JavaScript API’s that enable data storage, application caching and multi threading technologies for offline browsing and application use.

I don’t find it at all surprising that Google have invested heavily in trying to find a solution to the problem of we can use online web based applications offline. Although they launched Google Apps last year the take up has been quite slow, I read a few months back that the Commonwealth Bank has suspended a trial of Google Apps which it was thinking of rolling out to its 50,000-strong workforce, and many analysts insist that one of the major reasons for this is that there is no offline availability of these applications. Or as Carl Sjogreen, Google Senior Product Manager, sums the problem up when says:

As more and more people are depending on web applications to manage their lives and get information about what’s going on, it becomes and increasing problem when you can’t access those applications when you’re offline.

Enter Google Gears! this new technology certainly strengthens Google’s  position in going after Microsoft’s lucrative Office franchise, which makes commercial sense, More importantly though the technology actually makes the web and browsers a more attractive platform for building applications that can be used anywhere, anytim regardless of whether you have a connection to the internet or not.

Or as Eric Schmidt, CEO of Google, put it:

With Google Gears, we’re tackling the key limitation of the browser in order to make it a stronger platform for deploying all types of applications and enabling a better user experience

There decision to Open Source Gears is also quite an important one. By making the technology Open Source from a relatively early stage Google are inviting others to help improve the technology and build a community around it, and move towards developing with others an industry standard for these hybrid programmes that work both online and offline.

This is quite an exciting development.

Microsoft Surface

Rob mentioned Microsoft Surface to me at lunch time, I had seen it on several blogs but   haven’t really had a chance to have a look at it. It’s very impressive technonology. as Rob points out its a combination of many different muli touch techniques that we’ve seen in other demonstrations over the last six or so months. As far as I’m aware this is the first commercial product to enter the market, and they’ve done a great marketing piece on it over at http://www.microsoft.com/surface

However if you want to see it an action, I found this product demo on YouTube. I was very impressed with how the surface interacts with real world objects like camera’s, for example, placing a digital camera on the table will automatically grab the photos off it.

Below is another demonstration of Surface, this time over at PopularMechanics

There more I see this in action the more I want one!

Google Launches "Streetside View" and "Mapplets"

Google have revamped their 2D Maps with a new a feature they are calling Street View. When viewing maps of certain cities around the world you’ll get a street side view of the area your currently in, and it isn’t static! You can interact with the image to move along the street it even allows you to change your angle and move in a new direction.  Google have developed this new technology with Immersive Media, and all I can say is, it’s very very impressive.

If you want to try it out here’s a map of San Francisco that has side views, and here’s a map of Las Vegas , I really recommend trying it!

Google have also launched their new Mapplets service. Mapplets are a special kind of XML/Javascript based Google Gadget that you can add directly to Google Maps. Here’s a link to a special preview page where you can try out a handful of Mapplets. The official blurb from Google on this new feature is copied below:

Mapplets enables third party developers to create mini applications that can be displayed on Google Maps, much like Google Gadgets are displayed on iGoogle. These Mapplets contain a variety of information, from housing listings to crime data, and tools like distance measurement. Users can select from a wide range of Google and third party Mapplets to display on the Map, essentially creating their own “mashup of mashups” directly on the Google Maps site, while still enjoying the built-in functionality of Google Maps, such as local search and driving directions. A number of our partners, including WeatherBug, Booking.com and Platial have already created Mapplets.

UFC 71 – ‘Rampage’ knocks out the Iceman

Managed to watch UFC 71 late last night and was hugely impressed with Quinton ‘Rampage’ Jackson. I predicted a few months back that in my opinion he would defeat the reigning champion Chuck Liddell when the two of them finally fought for the title.  Last night rampage proved me right with a devastating first round knockout of Liddell.

You can see highlights from the fight here.