Google is Showing non existing URLs

I have a website running on Django, Python.

A week ago I made few changes in the main urls of website. For example https://example.com/user/account/profile is changed to https://example.com/profile.

Now, when I saw my website in google search results, it's showing both of the URLs in search results.

What can I do to remove the page with URL https://example.com/user/account/profile from search results?

Also, is it a good idea to add the noarchive meta tag on every page in order to prevent further caching?