How to read a binary file into a vector of unsigned chars

by

When testing for performance, I would include a test case for:

std::vector<BYTE> readFile(const char* filename)
{
    // open the file:
    std::ifstream file(filename, std::ios::binary);

    // Stop eating new lines in binary mode!!!
    file.unsetf(std::ios::skipws);

    // get its size:
    std::streampos fileSize;

    file.seekg(0, std::ios::end);
    fileSize = file.tellg();
    file.seekg(0, std::ios::beg);

    // reserve capacity
    std::vector<BYTE> vec;
    vec.reserve(fileSize);

    // read the data:
    vec.insert(vec.begin(),
               std::istream_iterator<BYTE>(file),
               std::istream_iterator<BYTE>());

    return vec;
}

My thinking is that the constructor of Method 1 touches the elements in the vector, and then the read touches each element again.

Method 2 and Method 3 look most promising, but could suffer one or more resize‘s. Hence the reason to reserve before reading or inserting.

I would also test with std::copy:

...
std::vector<byte> vec;
vec.reserve(fileSize);

std::copy(std::istream_iterator<BYTE>(file),
          std::istream_iterator<BYTE>(),
          std::back_inserter(vec));

In the end, I think the best solution will avoid operator >> from istream_iterator (and all the overhead and goodness from operator >> trying to interpret binary data). But I don’t know what to use that allows you to directly copy the data into the vector.

Finally, my testing with binary data is showing ios::binary is not being honored. Hence the reason for noskipws from <iomanip>.

More Related Contents:

  1. How to read / write a struct in Binary Files?
  2. How to read a file into vector in C++?
  3. How do I take values from text file and input into a 2D array? c++
  4. How to enforce move semantics when a vector grows?
  5. What is the easiest way to initialize a std::vector with hardcoded elements?
  6. std::vector versus std::array in C++
  7. Best way to extract a subvector from a vector?
  8. c++ vector size. why -1 is greater than zero
  9. Arrays vs Vectors: Introductory Similarities and Differences [closed]
  10. C write in the middle of a binary file without overwriting any existing content
  11. Vectors and polymorphism in C++
  12. Does vector::erase() on a vector of object pointers destroy the object itself?
  13. Elegant ways to count the frequency of words in a file
  14. What is the difference between std::array and std::vector? When do you use one over other? [duplicate]
  15. how do you insert the value in a sorted vector?
  16. C++ for-loop – size_type vs. size_t
  17. Bjarne Stroustrup says we must avoid linked lists
  18. Reorder vector using a vector of indices [duplicate]
  19. C++ std::vector vs array in the real world
  20. Vector that can have 3 different data types C++
  21. c++: can vector contain objects of type Derived?
  22. What is the Fastest Method for High Performance Sequential File I/O in C++?
  23. How to downsize std::vector?
  24. Is std::vector memory freed upon a clear?
  25. Getting a vector into a function that expects a vector
  26. How can I get the maximum or minimum value in a vector?
  27. Initializing a ublas vector from a C array
  28. Benefits of using reserve() in a vector – C++
  29. Checking if all elements of a vector are equal in C++
  30. are “seekp” & “seekg” interchangeable?

Leave a Comment