What is the best web framework for developing a large-display multitouch application?

Immagine you are developing an interactive exposition for a museum. What you know is:

• It's going to be run on a big wall-display. It won't need to be responsive
• It's going to be interacted with via native multitouch input on windows
• It needs to be a web-based app (no requirements on frameworks/technologies)
• Most of the UI is going to be dynamic components showing data, and an interactive map showing other data (the data is not the focus, the interaction is) The data can be prototyped for now.
• Most of the interaction is based on gestures, for example dragging stuff around, pinching and zooming in places.

A good example of this would be a board where kids can lay out various flags(/books/famous people) on a map; and later on verify if the positioning of each flag was right. Another example could be a dashboard that shows various info on the museum's expositions. Kids could then drag the expositions around in order to give an opinion, such as positioning the "knitting" exposition on the boring side and the "dinosaurs" exposition in the fun side. :)

What technologies/javascript frameworks/web-design patterns would you use for implementing such a thing?

Some more info below: I am a complete beginner with web-technologies. I have experience with Java and Obj-C. The current status (and multitude of JS frameworks) really confuses me. Especially the app-logic and how everything ties together.

Should I use a single-page app and combine a framework like react or backbone with a javascript framework for getting multitouch events? Most of the stuff I find online is made for mobile and the gestures seem to be predefined! Or should I use pure HTML5? Or draw it myself using a JS canvas?

Thanks to everyone who will contribute!