Making web app with Restful API

I'm making web app using node.js express with Restful API.

And, to use my web app, the user must login. If user doesn't login, he always stays in login page.

But, I heard that restful api doesn't use session or cookie information to maintain user login.

So, I heard that it use JWT. So, I want to use this. But, I saw that it has to compare token information when user access Restful API.

Then, in my case, should the user always have to request token information to the web app server to use my web service?