Visual Studio web installer takes long time before commit

I have a Visual Studio web installer project 2017 with custom actions. It passes through Install event smoothly, but before landing into commit event, it takes around 15 minutes, even 45 minutes on some machines. When I check in Task Manager, IIS is taking up more memory.

Any idea for such a weird behavior?