PEÑA LUIS RICARDO

System and method for reducing crawl frequency and memory usage for an autonomous internet crawler