Tuesday, 17 February 2009

The cutest astronomy EVER


If I didn't have a blog, I would create one just to link to this. 

https://www.galaxyzoo.org/

In the galaxy zoo, members of the public can help astronomers by looking at pictures of far-flung galaxies and - so sweet! - tagging them.

Turns out that good old pattern recognition still requires human eyeballs. Computers just couldn't pull off this level of complexity, but an army of starloving office workers on their lunch break? Absolutely. Job done.

(For the sake of this post, I have chosen to define visual tags as metadata, so yes, it does count.)

Sunday, 15 February 2009

Powerset

I like it. It's got potential.

As described on ReadWriteWeb:

Powerset is a much-hyped semantic search engine that uses natural language processing to "understand" concepts in web content and match pages to queries. Right now it only searches Wikipedia (and Freebase). 

www.powerset.com

The string 'Semantic search' always makes my ears prick up. I had a play with powerset, and it is not a bad start in the whole Natural Language Processing search experience. (Incidentally, I am so sad that NLP, which is one of my Favourite Things, shares an acronym with corrupt, pseudo-scientific, fraudulent, thieving, and cultish self-help psycholbabble. Oh well.)

Powerset has a smashing feature for information discovery: Factz. A search for 'Gorilla' (NB: 'Gorillas' takes you to the band 'Gorillaz') gives us this: 

1. A short overview ('Gorillas are the largest of the living primates'...)
2. Scientific name, Taxon rank, etc. 
3. Factz. (This is the fun bit.)

The factz, each of which are linked to info tell us that...

Gorilla uses: tools, branches, lick, rocks, stick, saplings, and trunk
Gorilla eats: plants, fruits, shoots, bamboo, herbs, and leaves
Gorilla live in: forests, groups, corners, troops, and park.

Not bad. (And if you're wondering - Gorillas lick objects to identify them. Who knew? I didn't, hence me being impressed by the discoverability potential - you can learn by accident, which is my favourite way.)

It all gets a bit stickier with more complex topics - like people. A search for Marlon Brando opens with his bio, provides his Date of Birth, Date of Death, Place of Birth, Nationality... very impressive. But then we go to factz:

Marlon Brando played: Jor-El, role, owner, survivor, movie, Corleone, drums, characters,
Marlon Brando said something about: Kashfi, Tango, Paris, Brando, Last, Bertolucci, call, Marilyn Monroe
Marlon Brando portrayed: father, leader, Don Vito Corleone, Johnney Strabler, Jor-El 

So... what's the semantic difference between 'portrayed' and 'played'? And how did 'role' get through the net? (Answer: the sentence '...in the role eventually played by Marlon Brando'.)

But that's a quibble. I think the problem can be solve in the first instance by not paying heed to obviously off-target factz (like 'role'). And I love 'said something about' - it's a little misrepresentative because it is, by definition, limited to available quotes, but still - how nifty!

I hope this one takes off, it's terrific. If it does fly, the big danger is that it may be so good that people take the results as being comprehensive - let's all promise not to do that, shall we?

Black ice and collaboration

I ride my bike to work. Last week, that process was hampered by a huge fall of snow. The snow quickly turned, as snow tends to, into ice.

Ice and bikes do not make a good combination.

My route to work, across a field, became a death trap. There was one particular stretch, some sixty meters long, where getting across with ankles intact became impossible. The ice was thick and treacherous, and - worse - rutted with wheel tracks seemingly designed to send you flying.

Then, on the third day, something amazing happened.

There was a clear path, about twenty centimeters across, straight down the middle of the path, with ice either side. How?

Let's assume that each cyclist is acting in his/her own interest. That interest is 'not falling off'. They pick the clearest path. The clearest path is the one with least ice. Wheels create friction as they go, eroding the ice, meaning that the clearest path is the one taken most often by people who went before. 

So - each individual cyclist uses the clearest path, and by doing so, makes it clearer for the next person until the route is safe.

No-one consulted on this. No-one 'took one for the team'. No-one planned it. Everyone acted independetly in their own interest, and yet, the result was a collaborative solution to a difficult and, initially, intractable problem.

The analogy I'm reaching for here is Open metadata standards. I would argue that it is in the self interest of all cataloguers and indexers to use them - they're comprehensive, supported by a community, and (most importantly) they mean you don't have to reinvent the wheel. There's no need to break your brain creating a model that will accomodate aggregation when IEEE LOM provides one. That alone saves both time and money. 

And by following this self-interest, something collaborative happens that solves an intractable problem. The problem is interoperability, and the solution is standards. Any option that is not based in standards means hitting a wall every time the data has to be exploited in a new environment, which it always, always will be (even if it's an upgrade to internal/proprietary software). And if there's a seismic shift in technology, and a new standard is required, well, everyone will be in the same boat - and better solutions to data migration can be generated better, faster, and - compared to converting proprietary formats - much cheaper. That's the 'avoiding danger' part of the analogy - we all want to get through the data management ice patch without breaking our leg.

It's the one thing no-one ever thinks to say about open standards - they're good for business. For publishers, I don't think there's any excuse left not to use them. 

Saturday, 14 February 2009

Twitter

I have always been late onto bandwagons. It's a tradition with me. So I am proud to say that I have - finally - joined twitter.

I'm a newbie, and I'm only following twenty odd people, but already I have some questions regarding the structure of the feed flow.

I may be missing something, but is there a way to categorise feeds? If not, why not?

My feed contains mostly elearning types. It also contains Stephen Fry. Why? Becuase I love him. Also, he's the second most followed person after Barack Obama, and who am I to doubt the wisdom of the crowd?

Now I like face-to-face collaboration as much as online, and I'm looking forward to sharing my feed with colleagues. I plan to actually show them, i.e. with two of us looking at the same screen and clicking things. But do they need to know I follow Stephen Fry? Especially when he's not always temperate in his tweets? Also - what if I was following my actual friends? (They're not on the site yet, but they might be eventually.) I wouldn't want them all mixed up in conference announcements.

On the other hand, maybe I would. What a lovely melange, to have real life and work life in the same bubbly pot. But it would stop me sharing - at least with my colleagues - and isn't sharing the point of twitter? 

How strange, that a service that is only about sharing could, through it's own structure, stop me from sharing. 

I'm going to investigate twitter clients now - maybe I'll find a solution there. 

Wednesday, 11 February 2009

Google hacks

Discoverability - it's inescapable. Every time you use google, you are discovering. With that in mind, here is my favourite underutilised google hack: Search in site.

Say you're looking for an article about digital archivists that you read in the New York Times. You can try any number of strings, including string "new york times", and get nowhere. Try this instead:

digital archivist site:nytimes.com

Using the site: function, Google will only search www.nytimes.com. Neat, huh?

Tuesday, 3 February 2009

Ada Lovelace day

As documented at http://findingada.com/:

Ada Lovelace Day is an international day of blogging to draw attention to women excelling in technology.

All you need to do is sign the pledge, pick your tech heroine and then publish your blog post any time on Tuesday 24th March 2009. It doesn’t matter how new or old your blog is, what gender you are, what language you blog in, or what you normally blog about - everyone is invited.

To help us keep track of the conversation about Ada Lovelace Day ahead of the event, and to pull together everything on the day, please use these tags:

  • AdaLovelaceDay09 for Delicious, Technorati etc. It’s long, but clear.
  • #ALD09 for Twitter hashtags.

I already know who my tech heroine is, and while I'll write this again on the day, I'm happy to nominate... LUCILLE BALL!!

No, I'm not joking.

Lucille Ball is one of the great unrecognised media figures of our time. Media is a technology, and technology is increasingly a medium, so why not? Amazingnesses include:

1. Lucille Ball invented the repeat. And if you think that's a so-so achievement, get yourself a copy of 'Everything Bad is Good for You' and get yourself some learning about the power of repeatability. The more times a consumer can watch a show, the more potentially profitable it can be over time, and the greater incentive there is for producers to improve the quality. DVD box sets, people. And yes, I am saying Lucille Ball is responsible for the Sopranos.

2. Lucille Ball opened people's minds & broke down prejudices. Desi Arnaz (Ricky) was Cuban, people. And this was the 50s. (And yes they were actually married, but did divorce after 20 years or so.)

3. Lucille Ball was the first female head of a TV production company (DesiLu). 

4. Lucille Ball produced Star Trek.

HA! Bet you didn't know that last one, did you? Totally true, and she gets the credit for Mission: Impossible, too. 

Saturday, 31 January 2009

I love wordle

Here's a wordle of this blog. Looks like 'information' is the winner!
Wordle: metadatamonkey
For those who haven't met it yet, wordle counts the words in any document and distributes them graphically with incidence count shown by text size. It's a little like a tag cloud that way.

The good people at www.wordle.net describe it as a 'toy', but I think it's better than that. It gives you an immediate insight into where the bulk of the text lies. It's not perfect, because individual words don't always represent semantic categories - 'Library of Congress' would come out 'library' and 'congress' in wordle, giving completely the wrong idea. Also note that 'journal' and 'journals' are divided in the above wordle, even though they are a semantic match. (If they WERE united as a semantic match, the relative importance of the term in the context of the whole would be much clearer.)

But these are quibbles. This is an excellent technology, and I for one am hopeful that means will be found to improve it semantically. A user generated controlled vocabulary of semantically unified terms ('controlled vocabulary' itself springs to mind) could make this extremely powerful. After all, the search engines are beginning to get the hang of meaningful phrases that contain whitespace - why not the rest of us?


UPDATE: It's been pointed out to me that I am far from the only person who thinks this is more than a toy. Courtesy of the New York Times, visualised word counts from all presidential inagural speeches since 1789: http://www.nytimes.com/interactive/2009/01/17/washington/20090117_ADDRESSES.html

And yes, the results are very telling.