How about letting OS do it for you: long long int getFolderSize(string path) { // command to be executed std::string cmd(“du -sb “); cmd.append(path); cmd.append(” | cut -f1 2>&1″); // execute above command and get the output FILE *stream = popen(cmd.c_str(), “r”); if (stream) { const int max_size = 256; char readbuf[max_size]; if (fgets(readbuf, max_size, … Read more
You may either call the mount command and parse its output to find the longest common prefix with your path, or use the stat system call to get the device a file resides on and go up the tree until you get to a different device. In Python, stat may be used as follows (untested … Read more
On a 32 bits system (i.e. the OS is 32 bits), by default, fopen and co are limited to 32 bits size/offset/etc… You need to enable the large file support, or use the *64 bits option: http://www.gnu.org/software/libc/manual/html_node/Opening-Streams.html#index-fopen64-931 Then your fs needs to support this, but except fat and other primitive fs, all of them support … Read more
As has already been mentioned, this is basicly a hardware problem. Disk access is always slow, and most file systems aren’t really designed to handle directories with that many files. If you for some reason have to store all the files in the same directory, I think you’ll have to maintain your own cache. This … Read more
Say you have a file with many empty bytes \x00. These many empty bytes \x00 are called holes. Storing empty bytes is just not efficient, we know there are many of them in the file, so why store them on the storage device? We could instead store metadata describing those zeros. When a process reads … Read more
Boost v1.48 and above You can use boost::filesystem::canonical: path canonical(const path& p, const path& base = current_path()); path canonical(const path& p, system::error_code& ec); path canonical(const path& p, const path& base, system::error_code& ec); http://www.boost.org/doc/libs/1_48_0/libs/filesystem/v3/doc/reference.html#canonical v1.48 and above also provide the boost::filesystem::read_symlink function for resolving symbolic links. Boost versions prior to v1.48 As mentioned in other answers, … Read more
Use os.path.expandvars to expand the environment variables in the string, for example: >>> os.path.expandvars(‘$C/test/testing’) ‘/stackoverflow/test/testing’
Read: MySQL Binary Storage using BLOB VS OS File System: large files, large quantities, large problems To Do or Not to Do: Store Images in a Database which concludes If you on occasion need to retrieve an image and it has to be available on several different web servers. But I think that’s pretty much … Read more
How you approach this is going to depend a lot on how frequently you’re writing. If you’re writing a relatively small amount of text fairly infrequently, then just use a static lock and be done with it. That might be your best bet in any case because the disk drive can only satisfy one request … Read more
There are a couple of ways: pathlib.Path().rglob() Use pathlib.Path().rglob() from the pathlib module, which was introduced in Python 3.5. from pathlib import Path for path in Path(‘src’).rglob(‘*.c’): print(path.name) glob.glob() If you don’t want to use pathlib, use glob.glob(): from glob import glob for filename in glob(‘src/**/*.c’, recursive=True): print(filename) For cases where matching files beginning with … Read more