linkedin wont scrape meta tags because page data is too large?

im trying to debug a weird problem and cant seem to figure out what's going on.

My website has meta tags to all social networks , og, twitter etc. For some reason, Linkedin previews sometimes get the data and sometimes don't. when it doesn't - the error displayed is "We did not scrape the content because it was larger than our threshold of 3.00M bytes."

Its trying to take all the data from the page for some reason, because the data I provide at the head tags is not 3mb, and when its successful - it displays alot of option he could have used, and I can see its scraping all data from the page (images, text and more).

Is there any way to make it take only the data provided from the meta tags? Anyway its a weird problem, because when it does get the data properly, the pages are very similar to what it cant take. Thanks.