creating an simple API to fetch data from mysql to populate material ui table

I am trying to fetch data from mysql database which contains about thousand's of record I am trying to populate my table using those records how do i do it? do i have to develop an API on my own if so then how do I develop an API that would fetch all the data's from my database??? I am completely new to java and react. could anyone please brief me about the process also the table should support infinite scrolling