Embed Lines of HTML from a given file

Sorry if this is answered already, I couldn't find the answer to this anywhere so help would be much appreciated.

I'm running a simple website with a bunch of very similar HTML files, each with the same group of clickable links which change depending on what I'm doing with the website.

If I need to add/remove/change a line of HTML, I need to do it similarly for each file.

I was wondering if there was an include type built into HTML where I can specify the varying lines in one file, and reference them into each HTML file so that I only need to change the reference file itself.

I know you can do this using JS, but is there any way using pure HTML?

Thanks.