What is the Fastest Method for High Performance Sequential File I/O in C++?

by

Are there generally accepted guidelines for achieving the fastest possible sequential file I/O in C++?

Rule 0: Measure. Use all available profiling tools and get to know them. It’s almost a commandment in programming that if you didn’t measure it you don’t know how fast it is, and for I/O this is even more true. Make sure to test under actual work conditions if you possibly can. A process that has no competition for the I/O system can be over-optimized, fine-tuned for conditions that don’t exist under real loads.

  1. Use mapped memory instead of writing to files. This isn’t always faster but it allows the opportunity to optimize the I/O in an operating system-specific but relatively portable way, by avoiding unnecessary copying, and taking advantage of the OS’s knowledge of how the disk actually being used. (“Portable” if you use a wrapper, not an OS-specific API call).

  2. Try and linearize your output as much as possible. Having to jump around memory to find the buffers to write can have noticeable effects under optimized conditions, because cache lines, paging and other memory subsystem issues will start to matter. If you have lots of buffers look into support for scatter-gather I/O which tries to do that linearizing for you.

Some possible considerations:

  • Guidelines for choosing the optimal buffer size

Page size for starters, but be ready to tune from there.

  • Will a portable library like boost::asio be too abstracted to expose the intricacies
    of a specific platform, or can they be assumed to be optimal?

Don’t assume it’s optimal. It depends on how thoroughly the library gets exercised on your platform, and how much effort the developers put into making it fast. Having said that a portable I/O library can be very fast, because fast abstractions exist on most systems, and it’s usually possible to come up with a general API that covers a lot of the bases. Boost.Asio is, to the best of my limited knowledge, fairly fine tuned for the particular platform it is on: there’s a whole family of OS and OS-variant specific APIs for fast async I/O (e.g. epoll, /dev/epoll, kqueue, Windows overlapped I/O), and Asio wraps them all.

  • Is asynchronous I/O always preferable to synchronous? What if the application is not otherwise CPU-bound?

Asynchronous I/O isn’t faster in a raw sense than synchronous I/O. What asynchronous I/O does is ensure that your code is not wasting time waiting for the I/O to complete. It is faster in a general way than the other method of not wasting that time, namely using threads, because it will call back into your code when I/O is ready and not before. There are no false starts or concerns with idle threads needing to be terminated.

More Related Contents:

  1. How to write a large buffer into a binary file in C++, fast?
  2. How to shift characters to ASCII values in a file based on user input c++ [closed]
  3. Read file line by line using ifstream in C++
  4. Read whole ASCII file into C++ std::string [duplicate]
  5. How do I read an entire file into a std::string in C++?
  6. Why does changing 0.1f to 0 slow down performance by 10x?
  7. How to “return an object” in C++?
  8. Is std::vector so much slower than plain arrays?
  9. Difference between files written in binary and text mode
  10. Why is transposing a matrix of 512×512 much slower than transposing a matrix of 513×513?
  11. Is it better to use std::memcpy() or std::copy() in terms to performance?
  12. Fast textfile reading in c++
  13. Which is faster: Stack allocation or Heap allocation
  14. C++ : Catch a divide by zero error
  15. mixing cout and printf for faster output
  16. What’s your favorite profiling tool (for C++) [closed]
  17. How much is the overhead of smart pointers compared to normal pointers in C++?
  18. Why does this delay-loop start to run faster after several iterations with no sleep?
  19. Why does GCC generate 15-20% faster code if I optimize for size instead of speed?
  20. Efficiency of the STL priority_queue
  21. Intercept windows open file
  22. Performance of qsort vs std::sort?
  23. What’s the fastest way to pack 32 0/1 values into the bits of a single 32-bit variable?
  24. fstream won’t create a file [duplicate]
  25. Writing function definition in header files in C++
  26. Is Python faster and lighter than C++? [closed]
  27. Reading files larger than 4GB using c++ stl
  28. Simple for() loop benchmark takes the same time with any loop bound
  29. New (std::nothrow) vs. New within a try/catch block
  30. C++ most efficient way to convert string to int (faster than atoi)

Leave a Comment