When using cache bursting what happens to cached files?

When we are using cache bursting for css and javascript files lets say by changing filename or query string, what happens to already cached file in users hard disk. Will that old cached file be deleted after caching newer version. Or browser holds copy of older and newer versions of file??