How to Use Cyberduck with Object Storage

Successful cloud storage management is crucial for individuals and organizations dealing with large volumes of data. Object storage, as opposed to conventional file systems, keeps data in the format of objects instead of hierarchical directories, providing scalability, resilience, and distant access. It's widely utilized in data backup, media hosting, big data analytics, and web application infrastructure.

Though object storage is reliable, sometimes one has to handle it with command-line interfaces, which is not very easy for non-techies. This is where the free and easy-to-use Cyberduck comes into play to make storage management easy.

Understanding Object Storage

Object storage is a cloud-based, scalable resource pool used to hold large quantities of unstructured data. Unlike file systems, it stores documents as objects, not as hierarchical directories. Some of the popular providers are:

• Amazon S3
• Microsoft Azure Blob 
• Google Cloud
• Contabo Object Storage

What Is Cyberduck

Cyberduck is an open-source storage browser that supports several protocols, such as FTP, SFTP, WebDAV, and S3-compatible cloud repositories. It provides users with a graphical interface for accessing remote data, eliminating the need for complex terminal commands. Cloud computing professionals and organizations prefer this application for its transparency, extensive compatibility, and user-friendly design. 

Why Use Cyberduck 

Using Cyberduck with object storage provides several benefits. Some are given below:

• Graphical Interface: It's possible to organize storage graphically instead of commands.
• Drag-and-Drop Transfers: Enables easy uploading and downloading of files.
• Public Link Generation: Facilitates convenient file sharing through the generation of direct URLs to stored objects. 
• Encryption Options: It supports Cryptomator, providing client-side encryption to further secure data. 
• Bookmark Management: Users can bookmark frequently used storage locations for easy retrieval.

Installing Cyberduck on Windows and macOS

Before you can use Cyberduck, first install the software on your system.

1. Visit the Cyberduck official website. 

2. Download the installer for your platform. 

3. Open the installer file and proceed with the on-screen installation instructions.
4. Launch Cyberduck from your Applications menu.

The tool is now ready for object storage connection establishment.

Connecting Cyberduck to Object Storage

Post installation, the next step is how to use Cyberduck and log in to your storage provider. Object storage is not the same as the default file system, it requires authentication and endpoint configuration before you can transfer files. Follow the steps below:

1. Click the Open Connection button in the top-left corner.

2. Select a correct storage protocol, depending on your provider:

• • Cyberduck S3 works with other S3-compatible storage options like Contabo and Wasabi. You can use API-based authentication with an access key and a secret key.
  • Cyberduck SFTP server is a secure file sending method that keeps your data safe using SSH. It's usually a better fit for private servers, not so much for flexible cloud storage.
  • For third-party services that don’t use the standard S3 URLs, you can set up a custom endpoint URL if you need to configure it manually.

3. Enter connection details:

• • Server Address: e.g., s3.contabo.com, s3.amazonaws.com.
  • Access Key ID: Your personal storage identifier.
  • Secret Access Key: Password-like credential.

After all the data has been accurately input, press Connect.

For this tutorial, we have configured Cyberduck with Hostman S3 Storage, a high-performance, scalable, and stable storage system. It allows data to be stored, managed, and accessed securely with full support of Amazon S3 APIs.

You can find more information on working with Cyberduck in Hostman in our documentation.

Once you've made the connection, you'll see a tree directory view of your storage bucket in the Cyberduck environment. That's all the stored files and directories within the storage container. You'll be able to:

• Browse local files available as a local file system.
• Upload new data by dragging and dropping files.
• Download currently available files through an easy right-click option.
• Modify permissions as needed, with adequate access controls.

How to Upload Files on Cyberduck

Once the application is connected to your storage, transferring files is easy. Here's how to do it:

1. Navigate to your storage bucket. After connecting, it will display a list of available buckets or folders.

2. Upload files: 

• • Drag & drop files from your local drive into the application window. 
  • Alternatively, click the Upload button, select your files, and confirm the transfer.

This will show transfer progress, doc sizes, and estimated completion time.

Note: Many services, including Amazon S3, default to virtual-hosted-style URLs, meaning the bucket name is part of the hostname (e.g., <bucketname>.s3.amazonaws.com). However, some providers only support path-style requests, where the bucket name is appended after the domain (e.g., s3.amazonaws.com/<bucketname>). Here is the solution to cope it:

1. Open Preferences.
2. Navigate to Profiles.
3. Enable Deprecated Path Style Requests.

Once done, select the S3 (Deprecated Path Style Requests) option from the list and repeat the above steps again. 

Download Files from Object Storage

Retrieving files from storage follows a similar process.

1. Locate stored files. Once connected, browse your buckets and find the files you need.

2. Download files using GUI.

• • Right-click on the document and select Download.
  • Choose a destination location on your local machine.
  • Cyberduck will transfer the document while displaying real-time progress.

Generate Public URLs for Sharing

To generate direct URLs for stored files, use the following instructions.

1. Locate the file you want to share.
2. Generate a public link:

• • Right-click the file.
  • Select Copy URL.
  • Choose the format (HTTPS, FTP, or others).

Paste the copied link into a browser or document to share the file with others.

Advanced Features

Cyberduck does more than just file transfers; it has some cool extra features like encryption, scripting, and automation.

Encryption with Cryptomator

With Cyberduck, you can use Cryptomator to encrypt your files before you upload them. This helps keep your data safe from unauthorized access.

Automating Bulk Transfers

Cyberduck's command line interface (CLI) lets you send multiple files at once with scripts. You can set up regular backups and sync tasks automatically.

When Does Cyberduck Require Administrative Privileges

• Installation & Updates: Installing Cyberduck for the initial time or updating it may require admin privileges, particularly on Windows.
• Accessing Protected System Locations: Admin access may be necessary if Cyberduck is accessing protected system directories.
• Network & Firewall Settings: Some users may need admin permissions to change the firewall settings or configure network-related options.
• Mounting Volumes (Mountain Duck & Cyberduck): While mounting remote storage as a local drive with Mountain Duck (Cyberduck sidekick), admin privileges might be necessary.

Using Cyberduck with Command-Line Interface (CLI)

Cyberduck provides a CLI tool (duck) that allows advanced users to automate storage tasks:

• Automated Uploads & Downloads: Run commands such as duck --upload s3://your-bucket/file.txt.
• Syncing Folders: Keep local and cloud storage synchronized with the --sync command.
• Batch Processing: Execute multiple storage operations in one script.

Managing Cyberduck Bookmarks

You can also create bookmarks for quick access to your favorite storage spots using the below-given instructions:

1. Open Cyberduck and establish a connection.
2. Click Bookmarks → New Bookmark.

3. Enter details and save.

Final Thoughts

Cyberduck makes it easy to manage your cloud storage without getting stuck in complicated command-line stuff. If you're using Amazon S3, Contabo Object Storage, or another service, Cyberduck’s user-friendly interface helps you with transferring, access settings, and sharing.

This tutorial will guide you on how to set up Cyberduck, transfer files, fix common issues, and boost your workflow.