Thank you for feedback!
Yes, you absolutely right, currently tile cache performance is far from optimal, it's just initial version of it. (even so, it works much faster with such simple cache, than with standart qt "url" cache). Tile cache performance will be optimized in future version of plugin, and it will solve mentioned problems. Unfortunately, I can't tell when it will be released; I think feedback and community interest will speed-up this process