SCHYDLOWSKY ANDREW

System and method for reducing crawl frequency and memory usage for an autonomous internet crawler