Performance issue for vector::size() in a loop in C++

In theory, it is called each time, since a for loop:

for(initialization; condition; increment)
    body;

is expanded to something like

{
    initialization;
    while(condition)
    {
        body;
        increment;
    }
}

(notice the curly braces, because initialization is already in an inner scope)

In practice, if the compiler understands that a piece of your condition is invariant through all the duration of the loop and it does not have side-effects, it can be smart enough to move it out. This is routinely done with strlen and things like that (that the compiler knows well) in loops where its argument isn’t written.

However it must be noted that this last condition isn’t always trivial to prove; in general, it’s easy if the container is local to the function and is never passed to external functions; if the container is not local (e.g. it’s passed by reference – even if it’s const) and the loop body contains calls to other functions, the compiler often has to assume that such functions may alter it, thus blocking the hoisting of the length calculation.

Doing that optimization by hand is worthy if you know that a part of your condition is “expensive” to evaluate (and such condition usually isn’t, since it usually boils down to a pointer subtraction, which is almost surely inlined).


Edit: as others said, in general with containers it’s better to use iterators, but for vectors it’s not so important, because random access to elements via operator[] is guaranteed to be O(1); actually with vectors it usually is a pointer sum (vector base+index) and dereference vs the pointer increment (preceding element+1) and dereference of iterators. Since the target address is still the same, I don’t think that you can gain something from iterators in terms of cache locality (and even if so, if you’re not walking big arrays in tight loops you shouldn’t even notice such kind of improvements).

For lists and other containers, instead, using iterators instead of random access can be really important, since using random access may mean walk every time the list, while incrementing an iterator is just a pointer dereference.

Leave a Comment