This blog is highly personal, makes no attempt at being politically correct, will occasionaly offend your sensibility, and certainly does not represent the opinions of the people I work with or for.
Camlistore, a personal storage system for life

Apparently some people at Google have the same problems as I have and came up with something which, in spirit, is very close to the set of personal conventions and tools I have around Galaxy and Nyx, in an attempt to have a unified (logical) view of all my personal data, across machines and interfaces.

Introducing Camlistore (for "Content-Addressable Multi-Layer Indexed Storage"). I particularly like the fact that Google people came up with the same idea of having a part of your personal website, and in particular your weblog, simply being a facet of a larger dataset that naturally exists on your laptop, and only somehow exists as a weblog from the point of view of one particular URL. Also, the fact that you can always mount your data as a classical file system using, say, FUSE is also something I have explored in the past. They also talk about using this as a permanent storage for emails, which is also an idea I had few days ago and tried to implement but failed because I could not get a ruby daemon to work properly with Google's IMAP server (will try again another time...)

My favourite extracts from the Summary section of the project overview page.

  • ... not always be forced into a POSIX-y filesystem model. That involves thinking of where to put stuff, and most the time I don't even want filenames. If I take a bunch of photos, those don't have filenames (or not good ones, and not unique). They just exist. They don't need a directory or a name. Likewise with blog posts, comments, likes, bookmarks, etc. They're just objects.
  • ... have both a web UI and command-line tools, as well as a FUSE filesystem.
These are also obviously two of the goals of my own Nyx.

The video mostly makes use of the command line and presents the underlying ideas, structures and principles, the DNA and logic of the system if you want. I guess that (graphical) tools will have to be built on the top of the presented layer, but already I can see that definitively other people have similar approach than mine... I cannot guaranty that Camlistore itself will survive as a project, but the underlying ideas are definitively the next step in (personal) data management.

[ add a comment ]