TL;DR There is an analogy with a cold engine and warm engine of the car. Cold cache – doesn’t have any values and can’t give you any speedup because, well, it’s empty. Warm cache has some values and can give you that speedup.
A cache is a structure that holds some values (inodes, memory pages, disk blocks, etc.) for faster lookup.
Cache works by storing some kind of short references in a fast search data structure (hash table, B+ Tree) or faster access media (RAM memory vs HDD, SSD vs HDD).
To be able to do this fast search you need your cache to hold values. Let’s look at an example.
Say, you have a Linux system with some filesystem. To access files in the filesystem you need to know where your file starts at the disk. This information stored in the inode. For simplicity, we say that the inode table is stored somewhere on disk (so-called “superblock” part).
Now imagine, that you need to read file /etc/fstab. To do this you need to read inode table from disk (10 ms) then parse it and get start block of the file and then read the file itself(10ms). Total ~20ms
This is way too many operations. So you are adding a cache in form of a hash table in RAM. RAM access is 10ns – that’s 1000(!) times faster. Each row in that hash table holds 2 values.
(inode number or filename) : (starting disk block)
But the problem is that at the start your cache is empty – such cache is called cold cache. To exploit the benefits of your cache you need to fill it with some values. How does it happen? When you’re looking for some file you look in your inode cache. If you don’t find inode in the cache (cache miss) you’re saying ‘Okay’ and do full read cycle with inode table reading, parsing it and reading file itself. But after parsing part you’re saving inode number and parsed starting disk block in your cache. And that’s going on and on – you try to read another file, you look in cache, you get cache miss (your cache is cold), you read from disk, you add a row in the cache.
So cold cache doesn’t give you any speedup because you are still reading from disk. In some cases, the cold cache makes your system slower because you’re doing extra work (extra step of looking up in a table) to warm up your cache.
After some time you’ll have some values in your cache, and by some time you try to read the file, you look up in cache and BAM! you have found inode (cache hit)! Now you have starting disk block, so you skip reading superblock and start reading the file itself! You have just saved 10ms!
That cache is called warm cache – cache with some values that give you cache hits.