Dion Hinchcliffe's Web 2.0 Blog
TamTamy by Reply

Blog Feed

Subscribe By E-Mail

Enter your email address:

Delivered by FeedBurner

Dion's Speaking Calendar:

Dion Hinchcliffe Speaking at NKU on Web 2.0 and Mobility

Dion Hinchcliffe Speaking at CeBIT 2009 on the Future Enterprise Workplace

Dion Hinchcliffe Speaking at QCon London 2009 on Web Architecture

JAOO Web 2.0 Days Keynote Speaker Dion Hinchcliffe

Dion Hinchcliffe Speaking at Web 2.0 Expo San Francisco 2009

Dion Hinchcliffe Keynotes at Interactive Austin 2009

Dion Hinchcliffe Instructor at Web 2.0 University Week in Las Vegas in May, 2009

Enterprise 2.0 Conference 2008 Speaker Dion Hinchcliffe
Dion Hinchcliffe on Twitter

    Recent Readers

    Web 2.0 Ajax SOA Power Panel

    Web 2.0, Ajax and SOA Power Panel with Dion Hinchcliffe and Jeremy Geelan
    Click above to watch a SYS-CON Power Panel discussion on Web 2.0, Ajax, and SOA with Dion Hinchcliffe, Jeremy Geelan, and other industry notables including SOA Web Services Journal Editor-in-Chief, Sean Rhody. Taped on Dec 7th, 2005 from the Reuter's TV studio in Times Square.

     

    Online Information Storage: Completing the Web as Platform

    posted Friday, 12 May 2006

    I've written several times in the past (most particularly here) about online storage and its importance to the next generation of the Web.  The developments in this space over the last year have been fascinating indeed.  For true Web 2.0 software (which I'll define here simply as networked applications that explicitly leverage network effects) or plain old Software as a Service (SaaS), key platform services are still not available on the Web as they would be in a traditional computing system.  In this particular case I'm referring to the fact that unlike regular software that runs on your PC, most online software today will not use the storage location of your choice.  Instead, these applications tend to prefer storing things in a location of the online software provider's choice, usually on their servers.  This can be far from desirable.


    Open Online Storage


    Now, while there certainly are some online applications that don't require you to store your data on the software provider's servers (Basecamp comes to mind), it brings up a related set of crucial issues that haven't been addressed very well by the SaaS and Web 2.0 community yet.  Specifically, these are the ability to 1) choose an own online storage provider in conjunction with an online software provider, 2) support for portable information formats, and the 3) resulting freedom to provider switch including controlling the hosting domain/URL.  Here's a quick run-down of what these possibilities would (and should) provide to end users:



    • Online Software Support for Open Storage Providers:  Whether I use Writely or Writeboard, I should be able to choose to store files created by my online software on Omnidrive or Openomy or whatever other storage provider I choose, including myself.  This brings up a related but separate issue of standard APIs, which is another discussion I don't cover here.  The bottom line: Users must be able to choose the location of a trusted, 3rd party storage vendor or storage devices under their own control.  Not having this will continue to affect online software adoption, since data storage has numerous implications for trust, privacy, long-term security, etc.

    • Adopting Portable Information Formats:  Even with the advent of XML and the countless XML standards for vertical and horizontal data formats of almost every description (OpenDocument being just one tiny but important example), online software generally doesn't use open methods today and rarely supports storage of data in widely recognized formats (there are exceptions here too; Writely does a pretty good job writing files out in Word format, probably a major success factor for the service.)  Online software suppliers that support open storage but not portable formats provide limited value to their customers since it's difficult to convert proprietary or poorly known formats to something useful. Or just take the data and use it elsewhere (such as easily being able to use your Salesforce data in NetSuite, for example.)

    • Freedom to Provider Switch: Without the first two, provider switching is difficult because users must have both access to and control of the data created by their online software, but it has to be in a format that's relatively useful.  Blogs are one good example of this increasingly common issue.  Between well-populized downtime and outright denial of service attacks, customers should be able to almost effortlessly switch services to a working provider, quickly and painlessly, and then keep right on working.  Disruption of service to a lot of people dependent on the data and online software is costly, and the lack of control in today's online software can be a major source of frustration.  Provider switching has implications such for URL provisioning as well.  It makes little sense to be able to provider switch without having URL portability.  While structured URL standards for online software are a long way off, the ability to control a URL, the domain name of which at least belongs to the provider itself, is a non-trivial problem.  This implies that online software in the future will be provisioned off of URLs with domains owned and controlled by the users of the software themselves.


    I beat the drum of maturing open, 3rd party online storage every few months, even though the market isn't quite ready to tackle these issues yet.  And though the online storage market is still barely burgeoning, I do this because not being in a posture to address them when the market is ready will impede the adoption of online software for so-called "serious" uses (enterprise use, critical private uses, etc.) until they are addressed.

    In any case, the state of online information is rapidly changing with the likes of Google's
    forthcoming GDrive, Microsoft's rumoured Live Drive, and Amazon's already available online storage service, S3.  Never mind the almost infinite selection of smaller providers that already exist today, many of which can even integrate with your local operating system desktop and look exactly like a hard drive attached to the your computer.

    A Brief Survey of Online Storage Services

    It was actually pretty hard to find a good list of online storage services, particular pure services that don't specialize in a particular type of data.  Some services like Ofoto and Flickr prefer a limited set of choices related to a particular media type.  What I'm referring to here is general purpose online storage that can be used for storage of data of arbitrary types and in any volume (from 1 byte to multi-gigabyte.)  While S3 is one of the few big players already shipping, here's a rundown of what's available today. 


    Online Storage Vendors



    • AllMyData: The free version offers unlimited backup, supports backup and sharing, but actually requires sharing or payment to increase storage size. Could not ascertain if an API is avaialble.

    • Box.net:  Online storage with 1GB free and more available for purchase.  Offers an API, file backup and synchronization, and sub-accounts and RSS feeds for groups.

    • esnips: Holds everything from bits and pieces of Web content to entire media files and documents.  Supports sharing, tagging, 1GB of free storage, and has desktop integration.  No API information was available.

    • IBackup: A variety of options and services are provided by IBackup including IDrive which provides 128-bit encryption, proxy support, caching, collaborative access and much more.

    • Mozy: Offers automatic backup, strong encryption, and integration with PCs.  While free, it is primarily aimed at backup and not as much at generic online storage.
    • Omnidrive: This service is in beta, but provides online storage with Web and some desktop integration.  Notably, Omnidrive makes much of security including compressing and encrypting all data.  Omnidrive supports several different popular API formats including SOAP, REST, RSS, and more.


    • Openomy: Is a completely free online storage service with 1GB of storage.  Openomy offers an API and tag based organization.

    • Amazon's S3: Web-scale online storage for developers.  End-user interfaces are created by others on top of S3.  S3 can store objects by key up to 5GB in size, is relatively secure, supports REST and SOAP.  Interestingly, multiple open protocols are supported including HTTP and BitTorrent.  Highly innovative.  Some extensions for developers and end-users include:


    • Streamload: An online service for storing media and non-media files with up to 25GB of storage capacity for free, and virtually unlimited storage for a price.  Streamload does not appear to support an API.

    • Strongspace: Provide a secure online location to store any type of file.  Sharing is supports along with SFTP, provides support for Basecamp storage.  Does not provide encrypted storage and does not appear to support an API beyond SFTP.

    • Xdrive: Provides 10GB of storage for a small fee, has Web and desktop integration both, and has file backups services.


    Of course, the premise of all this is that more and more of our information will continue to flow online along with the software that we use.  Our personal data, work documents, images, audio, video, and everything else is more useful to us and others if we move it online, making it accessible anywhere, taking advantage of professional data center backup, and getting off of the hard drive upgrade treadmill.  Particularly as our personal archives of digital content become large and highly valuable as we aggregate them over the years, they become irreplaceable assets that require better care than we might be able to give them without professional help.


    As always, please add any online storage sites that I missed in the comments below. I'll add them to the list if they have any general purpose utility.

    links: del.icio.us    



    AddThis Social Bookmark Button

    1. Rachel left...
    Friday, 12 May 2006 4:24 pm

    Great blog. Another online storage site is Mozy.com which offers 2gb free with a referral program that increases both yours and your friends storage size. More storage can be purchased as well. Check it out.


    2. pade96 left...
    Monday, 15 May 2006 2:41 pm

    Hi Don, really love your blog and your view on web 2.0. Also love your 'visualisations', the diagrams that you make. Sorry for the off-topic question, but what software or tool do you use for that? Or are you just a graphic artist who can do this in any kind of software?


    3. Niven left...
    Thursday, 25 May 2006 7:07 am

    I am happy to find <a href='http://www.ibackup.com'>IBackup</a> in your list, because I am a big fan of their service. From my experience with them, I don’t have to think twice to categorically state that IBackup is one of the best and the most flexible online storage and backup solutions available today.

    IBackup has several features to backup and share your critical data withy others. I use <a href='http://www.ibackup.com/ibwin_new.htm'>IBackup for Windows</a> for my regular backups. All backups using IBackup for Windows are safe as they employ the highest level of 128-bit SSL encryption on transmission. If you want online backup of MS Exchange Server databases without interrupting the running MS Exchange Server services, then IBackup has options for that too.

    The <a href='http://www.ibackup.com/IBDrive_new.htm'>IDrive</a> application lets you map your online account as a local drive on your PC. IDrive also supports concurrent operations for Access and other office applications. They also give historical read only view of user data for up to ten days through <a href='http://www.ibackup.com/snapshots_info.htm'>snapshots</a>.

    <a href='http://www.ibackup.com/webmanager.htm'>Webmanager</a> allows you to create folders, webload, rename, delete and share files or folders with others for collaborative access. With Web Manager, you can create a Sub-Account, which is an IBackup account that can be created on any folder in your online backup account to provide access only to files (and folders) within that folder to colleagues and business partners.


    4. cbrown left...
    Friday, 14 July 2006 3:34 pm

    You should also check out Data Deposit Box for <a href="http://www.datadepositbox.com">online data backup</a>. It's inexpensive and very easy to use. It takes about 2 minutes to install the <a href="http://www.datadepositbox.com">online backup</a> agent. Once installed it's fully automatic with nothing to remember and no procedures to follow. You can access your <a href="http://www.datadepositbox.com/factsheet.asp">online data storage</a> easily with a web browser.


    5. Renato left...
    Friday, 28 July 2006 8:49 am

    There is another one at www.carbonite.com . Seems cheap looking at most of the options. Just USD 5 per month for umlimited storage. The best part is that the backups are automatic and continuous which means you are updated in realtime.


    6. online backup left...
    Thursday, 5 October 2006 12:12 pm :: http://remote-backup.com

    Interesting. We have launched a service based on the software by Remote Backup Systems, Inc. http://remote-backup.com

    We will offer a much more comprehensive service than what these ‘cheapos’ are offering, and will exclusively target the business sector. Our online backup software natively supports open and in-use Exchange and SQL databases, among other advanced functionality that is best suited to SMB/SMEs.


    7. Ellie left...
    Sunday, 5 November 2006 1:49 pm

    I tried most of the services on your list and like a few of them. But I just tried Diino and must say it is a bit different. Diino gives 2GB free online storage, email, personal blog, automatic back up, 2048bit encryption. The easy client makes it must faster than most web based solutions. try it. www.diino.com


    8. C3 left...
    Wednesday, 8 November 2006 3:26 pm

    Don, a very nice roll up of some of the emerging services out there and the additional comments added more as well. There is one data point that should be considered and discussed and that's the availability of a wide pipe into users homes to be able to send and receive all of this information. Based upon broadband penetration in the US specifically, there's not a lot of hope of truly developing a fully hosted storage model in the "cloud" for some time to come, exluding the ability to trickle out backups and keep deltas current as local information changes. There is some hope with the deployment of FTTH like Verizon's FIOS coming to a neighborhood near you, if you're lucky enough, but the basic DSL or Cable high speed links that are generally avaialble significantly limit the amount of data that can be transferred in a reasonable timeframe, thus presenting a natural limit on the scale and scope of services that can be delivered, at least today.


    9. Kenny left...
    Friday, 19 January 2007 11:33 am :: http://www.myotherdrive.com

    Another great service is http://www.myotherdrive.com


    10. James C. Mizzo left...
    Wednesday, 14 February 2007 11:05 am

    Great post. Backups are essential for all work. For important work, two or three backup sets are advisable. The free backup solutions offer the fundamental features -(apps like BackupLite, NVBackup, Innerbackup...) Best regard, James c. Mizzo Network consultant http://www.all-internet-security.com/


    11. fredrik left...
    Friday, 1 June 2007 7:27 am

    I use diino and it works really well. it has a drag-and-drop feature and a 2048bit encryption, so my back-ups and e-mails are secure. it also has streaming possibilities so I can listen to music on my cell phone now, through my diino client. check it out, www.diino.com


    12. Craig Newt left...
    Tuesday, 16 October 2007 3:15 am :: http://backupreview.googlepages.com/defa

    Well, clearly the author didn't test a lot of online storage services. Reading the comments, many people list missing websites. I have been following this industry for a long time and have tried many different online storage services. Most services are geared for free users. But a few of them do have very good features, reliable service and great client software. Please read my reviews at: http://backupreview.googlepages.com/default.html

    http://ftpreview.googlepages.com/index.html