Amazon S3 Tools

This is a remake of the list done by Jeremy Zawodny (and brought to my attention by Martin), but i'll try to keep an up to date list. You should check the original list as there are alot of useful comments and ideeas over there and also check the list at amazon.

So, free tools:

S3/fuse interface, not really a tool, but an "infinitely large disk device". This will be awsome when it will have a stable release.

s3DAV is "a webDAV server which allows you to access a virtual file system using your Amazon s3 account". Using a third party application you can do back-ups through Webdav.

s3sync.rb and s3cmd ; s3sync "is a ruby program that easily transfers directories between a local" and s3cmd "is a ruby program that wraps S3 operations into a simple command-line tool.
It is inspired by things like rsh3ll, #sh3ll, etc., but shares no code from them. It's meant as a companion utility to s3sync.rb but could be used on its own directory and an S3 bucket:prefix. It behaves somewhat, but not precisely, like the rsync program".

jets3t - "building on the Java library provided by Amazon, the toolkit aims to simplify interaction with S3 while providing powerful additional features".
Cockpit "is a graphical Java application for viewing and managing the contents of an Amazon S3 account".
Synchronize "is a console (text mode) Java application for synchronizing directories on a computer with an Amazon S3 account".

S3Fox Organizer For Amazon."This firefox extension(browser plugin) provides an user friendly interface for Amazon's S3 (Simple Storage Service) . Its interface is very much similar to the FTP interface that lists local folders in the left panel and S3 buckets/files/folders in the right panel. Files/folders can be moved from the local computer to Amazon's storage space and vice versa".

Jungle Disk Gui client for S3, works on Windows, Linux, Mac , stores files in a proprietary format. Provides file encryption and a local WebDav server too.

Brackup is a command line tool written in perl, some of the features are: "encrypted, over-the-net, multi-versioned backup" . Additional details here

Backup Manager "Backup Manager is a command line backup tool for GNU/Linux, designed to help you make daily archives of your file system. Written in bash and perl, it can make tar, tar.gz, tar.bz2, and zip archives and can be run in a parallel mode with different configuration files. Archives are kept for a given number of days and the upload system can use ftp or scp to transfer the generated archives to a list of remote hosts."

SUCHWERK S3Drive "The S3Drive is listed as any other network drives on your computer, you will see and feel no difference.You can access the drive with all Windows application and all program languages."

jSh3ll, #Sh3ll and rSh3ll are a set of command line shells for managing your Amazon S3 objects. They are written in Java, C# and respectively Ruby.

NS3 Manager is a Windows GUI client.

S3 Tools by Hanzo . "A set of *nix like command line tools for working with s3. They are backed by a simple python library that can be used to work with the material you have uploaded to S3".
Some of the commands are: s3mkbucket , s3ls, s3put, s3get , etc.

s3browse "provides a user friendly web interface for the Amazon Simple Storage Service". Seems ok but i wouldn't trust a third party with my amazon credentials.

JS3tream "JS3tream was written to provide easy streaming of data to and from Amazons S3 data storage service. JS3tream is NOT a backup solution by itself. But, coupled with tar or zip, JS3tream provides a very powerfull backup solution. Think of JS3tream as a bridge between Amazons S3 and your backup software. JS3tream will read STDOUT from your tar utility, and storge the stream on S3. Then, JS3tream can read the stream back from S3, and pipe it to tar on STDIN. Voila... Reliable TAR archives to a reliable offsite data store!".

Comercial applications:

S3InfiDisk "S3InfiDisk for EC2 lets you mount any number of file systems on your EC2 instances. Each file system is stored on S3. This essentially gives you an infinite storage disk for your EC2 instances. S3InfiDisk for EC2 uses an advanced in memory and local disk based caching system that makes file access close to, and in some cases better than, normal file system access. Since your data resides on S3, the data is never lost, and you can remount the file system on any running EC2 instance."
It uses fuse and it allows to use S3 as a mountable filesystem, this seems to be the commercial (and running, and stable) counterpart of S3/fuse. This company also
has another product called S3DFS

S3DFS is "a true distributed file system for EC2, backed on S3. S3DFS allows you to start any number of EC2 instances, and have all of them share the same file system. In the background, S3DFS uses a transactional distributed cache to keep a consistent view of the file system across all instances.".

S3 Backup is Gui tool for windows, mac (and linux is planned too). Features: syncronize, differential backup, encryption,"database of file hashes is stored inside S3 bucket, so you can backup from multiple locations to the same destination folder", "filemasks to exclude some files and folders"

Sync2S3 Windows GUI client, provides file encryption, syncronization, etc .

Openfount S3 Explorer. Web Based Application

Interarchy is a Mac OS X GUI Client. "
Interarchy supports pretty much everything you can imagine: long file names, long URLs, long files, automatic and manual mirroring, Dashboard widgets, Automator actions, Bonjour, AppleScript (including recording), FTP, SFTP, HTTP, WebDAV (including iDisk), Amazon S3, ping, packet sniffing, you name it, Interarchy can probably do it, all with a user interface designed to keep you productive."

S3Safe is a windows GUI "full Windows Explorer style file manipulation".

Super Flexible Backup "is used to back up data and to synchronize PCs, servers, and notebooks. The settings are stored in multiple profiles, and the software comes with support for FTP servers, ZIP compression, data encryption, and a scheduler for automated backups. On Windows NT/2000 or higher, the scheduler can run as a service - without users having to log on. This file synchronization tool features the ability to freely select files and folders across the whole folder hierarchy in tree-views and it has support for e-mail notification, profile categories, and various filters." Since version 3.30 it supports Amazon S3 .
It seems to be very powerfull but i didn't have the time to test it (there is a 30-day trial available)

S3-Ftp" is an FTP server that uses S3 for storage. Because it's a standard FTP server, you can use any FTP client to transfer files to S3 ".
Windows only and i don't know under what type of licence is released.

Jungledisk is closed-source

Submitted by Anonymous (not verified) on Tue, 2006-12-19 09:12.

Jungledisk is closed-source is going to cost you money, it's a commercial application. It also "calls back" to jungledisk.com with some info from your computer, maybe you S3 ids? If you block that connection it doesn't start.

» reply