Managing large binary files with Git

by

I discovered git-annex recently which I find awesome. It was designed for managing large files efficiently. I use it for my photo/music (etc.) collections. The development of git-annex is very active. The content of the files can be removed from the Git repository, only the tree hierarchy is tracked by Git (through symlinks). However, to get the content of the file, a second step is necessary after pulling/pushing, e.g.:

$ git annex add mybigfile
$ git commit -m'add mybigfile'
$ git push myremote
$ git annex copy --to myremote mybigfile ## This command copies the actual content to myremote
$ git annex drop mybigfile ## Remove content from local repo
...
$ git annex get mybigfile ## Retrieve the content
## or to specify the remote from which to get:
$ git annex copy --from myremote mybigfile

There are many commands available, and there is a great documentation on the website. A package is available on Debian.

More Related Contents:

  1. Locking binary files using git version control system
  2. How do I rename a local Git branch?
  3. How can I reset or revert a file to a specific revision?
  4. How to change the author and committer name and e-mail of multiple commits in Git?
  5. Definition of “downstream” and “upstream”
  6. Recovering added/staged file after doing git reset –hard HEAD^?
  7. Insert a commit before the root commit in Git?
  8. What is this Git warning message when pushing changes to a remote repository?
  9. How do I find the next commit in Git? (child/children of ref)
  10. How do you make Git ignore files without using .gitignore?
  11. Are Git’s pack files deltas rather than snapshots?
  12. Gitlab repository mirroring
  13. View a file in a different Git branch without changing branches
  14. How do I delete all Git branches which have been merged?
  15. Git log output to XML, JSON, or YAML?
  16. Should composer.lock be committed to version control?
  17. Git keyword substitution like those in Subversion?
  18. Git push: “fatal ‘origin’ does not appear to be a git repository – fatal Could not read from remote repository.”
  19. Git rebase – commit select in fork-point mode
  20. How to list branches that contain an equivalent commit
  21. How can I push a local Git branch to a remote with a different name easily?
  22. Git On Custom SSH Port
  23. Should I add the Visual Studio 2015 .vs folder to source control?
  24. Git: How to squash all commits on branch
  25. git reset asks ‘more?’
  26. How does git track source code moved between files?
  27. Push and pull my conda environment using git
  28. How do I remove a single file from the staging area (undo git add)?
  29. How to convert a Git repo to a submodule, which is nested in another (parent) Git repo?
  30. Limiting file size in git repository

Leave a Comment