How to perform checksums during a SFTP file transfer for data integrity?

by

With the SFTP, running over an encrypted SSH session, there’s negligible chance the file contents could get corrupted while transferring. The SSH itself does data integrity verification.

So unless the contents gets corrupted, when reading the local file or writing the remote file, you can be pretty sure that the file was uploaded correctly, if no error is reported. That implies that a risk of data corruption as about the same as if you were copying the files between two local drives.

If you would not consider it necessary to verify data integrity after copying the files from one local drive to another, then I do not think, you need to verify integrity after an SFTP transfer, and vice versa.

If you want to test explicitly anyway:

While there’s the check-file extension to the SFTP protocol to calculate a remote file checksum, it’s not widely supported. Particularly it’s not supported by the most widespread SFTP server implementation, the OpenSSH. See What SFTP server implementations support check-file extension.

Not many clients/client libraries support it either. You didn’t specify, what client/library you are using, so I cannot provide more details.

For details about some implementations, see:

Other than that, your only option is to download the file back (if uploading) and compare locally.

If you have a shell access to the server, you can of course try to run some shell checksum command (e.g. sha256sum) over a separate shell/SSH connection (or the “exec” channel) and parse the results. But that’s not an SFTP solution anymore.

Examples:

More Related Contents:

  1. How can I copy/duplicate a file to another directory using SFTP?
  2. JSch SFTP security with session.setConfig(“StrictHostKeyChecking”, “no”);
  3. scp or sftp copy multiple files with single command
  4. Transfer files to/from session I’m logged in with PuTTY
  5. Getting a File’s MD5 Checksum in Java
  6. SFTP Libraries for .NET [closed]
  7. SFTP in Python? (platform independent)
  8. Generating an MD5 checksum of a file
  9. FTP/SFTP access to an Amazon S3 Bucket [closed]
  10. Python pysftp get_r from Linux works fine on Linux but not on Windows
  11. pysftp vs. Paramiko
  12. JSchException: Algorithm negotiation fail
  13. SFTP file lock mechanism
  14. How does Git compute file hashes?
  15. What is the fastest way to create a checksum for large files in C#
  16. Is it possible to get identical SHA1 hash? [duplicate]
  17. How can I force ssh to accept a new host fingerprint from the command line?
  18. Paramiko’s SSHClient with SFTP
  19. CRC Calculation Of A Mostly Static Data Stream
  20. Multi-factor authentication (password and key) with Paramiko
  21. FTP Over SSH (SFTP) In delphi 2010
  22. Can a TCP checksum fail to detect an error? If yes, how is this dealt with?
  23. JavaScript CRC32
  24. Google Cloud Platform solution for serverless log ingestion (files downloading) from a SFTP server
  25. Determine whether .NET assemblies were built from the same source
  26. Batch file for PuTTY/PSFTP file transfer automation
  27. Implementing Luhn algorithm using C#
  28. List files on SFTP server matching wildcard in Python using Paramiko
  29. Authentication with PPK key in SSH.NET
  30. How to check Azure Storage BLOB file uploaded correctly?

Leave a Comment