where I can find an information about develop web document collecter?

I'm a student majoring in computer engineering lived in Korea. I wonder that how many the articles have no worth to read made in everyday. I want to collect the articles and analyze, and identify the worthless.

So, I wonder that where I can find the contents about how to make web document collecter? blogs, books, or codes, I want some information about that.

I guess it has some grammos, so I really appreciate reading my question. Have a nice day :-)