Best Web Front End Solution for filtering an SQL Table

I have a table with around 80 columns and 18 million records. I need approximately 10 users with no programming knowledge whatsoever to do filters on some columns for that table like in a report. We think that doing a Web Solution would be the best, but we have a problem: We don't know the best way to do this in terms of speed and costs.

For Front End, we've thought of implementing our own interface using React or something but we don't know what alternatives we have. We also know about Metabase which is fairly easy but we're looking for more suggestions.

For the SQL Database, we've thought of Azure but we think it is overkill and we don't know if MySQL in a webpage would handle this amount of records in terms of space.

We're looking for the best way to create a Front End for this table and the best DBMS to host our table.

This is intended to be a long-term solution. What do you recommend to implement this? Feel free to comment/discuss any solution