“Proper” way to store binary data with C++/STL

by

vector of char is nice because the memory is contiguious. Therefore you can use it with a lot of C API’s such as berkley sockets or file APIs. You can do the following, for example:

  std::vector<char> vect;
  ...
  send(sock, &vect[0], vect.size());

and it will work fine.

You can essentially treat it just like any other dynamically allocated char buffer. You can scan up and down looking for magic numbers or patters. You can parse it partially in place. For receiving from a socket you can very easily resize it to append more data.

The downside is resizing is not terribly efficient (resize or preallocate prudently) and deletion from the front of the array will also be very ineficient. If you need to, say, pop just one or two chars at a time off the front of the data structure very frequently, copying to a deque before this processing may be an option. This costs you a copy and deque memory isn’t contiguous, so you can’t just pass a pointer to a C API.

Bottom line, learn about the data structures and their tradeoffs before diving in, however vector of char is typically what I see used in general practice.

More Related Contents:

  1. Erasing elements from a vector
  2. Why can’t I make a vector of references?
  3. Concise explanation of reference collapsing rules requested: (1) A& & -> A& , (2) A& && -> A& , (3) A&& & -> A& , and (4) A&& && -> A&&
  4. Why are Standard iterator ranges [begin, end) instead of [begin, end]?
  5. Why do I get the same sequence for every run with std::random_device with mingw gcc4.8.1?
  6. Using custom std::set comparator
  7. Nice way to append a vector to itself
  8. In STL maps, is it better to use map::insert than []?
  9. Why use non-member begin and end functions in C++11?
  10. std::fstream doesn’t create file
  11. Stack-buffer based STL allocator?
  12. Is std::vector copying the objects with a push_back?
  13. how-to initialize ‘const std::vector’ like a c array
  14. Is hash_map part of the STL?
  15. How to use std::sort with a vector of structures and compare function?
  16. Why does storing references (not pointers) in containers in C++ not work?
  17. Can std::begin work with array parameters and if so, how?
  18. Checking if an iterator is valid
  19. Iterate keys in a C++ map
  20. Reading and writing a std::vector into a file correctly
  21. initializing std::string from char* without copy
  22. does (w)ifstream support different encodings
  23. C++11 STL containers and thread safety
  24. Is std::pair ordering well-defined?
  25. std::string length() and size() member functions
  26. Can I have polymorphic containers with value semantics in C++?
  27. Erase/Remove contents from the map (or any other STL container) while iterating it
  28. what is the difference between const_iterator and iterator? [duplicate]
  29. Why vector access operators are not specified as noexcept?
  30. list of polymorphic objects

Leave a Comment