i want to make crawler/spider for generate pdf report

How can I make crawler/spider in php

i am developing crawler/spider but sometimes not working so can you help me for crawler/spider its the part with finding the urls we lack the crawler we have is ok in testing but sometimes it has trouble spidering and finding the urls on the site

thanks.