gsutil Vs Storage Transfer Service Vs Transfer Appliance

When transferring data from an on-premiss location, use gsutil

When transferring data from another cloud storage provider, use storage transfer service

gsutil is a Python application that lets you access Cloud Storage from the command line. You can use gsutil to do a wide range of bucket and object management tasks, including:

  • Creating and deleting buckets.
  • Uploading, downloading, and deleting objects.
  • Listing buckets and objects.
  • Moving, copying, and renaming objects.
  • Editing object and bucket ACLs.

gsutil performs all operations, including uploads and downloads, using HTTPS and transport-layer security (TLS).

For a complete list of guides to completing tasks with gsutil, see Cloud Storage How-to Guides.


Storage Transfer Service is a product that enables you to:

  • Move or backup data to a Cloud Storage bucket either from other cloud storage providers or from your on-premises storage.

  • Move data from one Cloud Storage bucket to another, so that it is available to different groups of users or applications.

  • Periodically move data as part of a data processing pipeline or analytical workflow.

Storage Transfer Service provides options that make data transfers and synchronization easier. For example, you can:

  • Schedule one-time transfer operations or recurring transfer operations.

  • Delete existing objects in the destination bucket if they don't have a corresponding object in the source.

  • Delete data source objects after transferring them.

  • Schedule periodic synchronization from a data source to a data sink with advanced filters based on file creation dates, file-names, and the times of day you prefer to import data.

Storage Transfer Service does the following by default:

  • Storage Transfer Service copies a file from the data source if the file doesn't exist in the data sink or if it differs between the version in the source and the sink.

  • Retains files in the source after the transfer operation.

  • Uses TLS encryption for HTTPs connections. The only exception is if you specify an HTTP URL for a URL list transfer.

Transfer Appliance is a hardware appliance you can use to securely migrate large volumes of data (from hundreds of terabytes up to 1 petabyte) to Google Cloud Platform without disrupting business operations. 

Comments

Popular posts from this blog

SQL basic interview question