How to make a web crawler that crawls web pages automatically?

I want to make a search engine and to make it first i need a web crawler. So i am asking how to make a web crawler that automatically crawls all web pages on Internet.
It is like how yahoo, Google, duckduckgo works.