Methods and devices for preloading webpages

Abstract

Embodiments of the present disclosure disclose a method and a device for webpage preloading. The method includes: conducting webpage preloading according to a current preloading policy, in which the preloading policy includes: a preloading time range, a preloading region, a preloading page depth, and an available caching space for preloading; counting historical data within a pre-set time period, in which the historical data includes: information about an accessed webpage, information about a preloaded webpage, and state information of a local cache; and updating the preloading policy based on the historical data. In the present disclosure, by way of counting the preloading historical data within a pre-set time period, and based on the changes in the historical data, the preloading policy is automatically updated, so that the preloading policy can adapt to network and user access conditions in real time, thereby improving the hit accuracy of webpage preloading.

What is claimed is: 
     
       1. A method for webpage preloading, the method comprising:
 conducting webpage preloading according to a current preloading policy, the preloading policy comprising: a preloading time range, a preloading region, a preloading page depth, and an available caching space for preloading; 
 counting historical data within a pre-set time period, the historical data comprising: information about an accessed webpage, information about a preloaded webpage, and state information of a local cache; and 
 updating the preloading policy based on the historical data. 
 
     
     
       2. The method according to  claim 1 , wherein
 the information about an accessed webpage comprises: an access quantity of the accessed webpage, an accessed time range, and a service deployment region to which a terminal that conducts webpage accessing belongs; 
 the information about the preloaded webpage comprises: an access quantity of the preloaded webpage; and 
 the state information of the local cache comprises: a capacity of a current free space in the local cache and a capacity of a repeatedly useable space in the local cache. 
 
     
     
       3. The method according to  claim 2 , wherein the updating the preloading policy based on the historical data comprises:
 based on the access quantity and the accessed time range of the accessed webpage, calculating a time range when an access quantity of the accessed webpage is higher than a first threshold value; and based on the time range, adjusting the preloading time range; 
 based on the access quantity of the accessed webpage and the service deployment region, calculating whether an access quantity of the accessed webpage in a pre-set region is higher than a second threshold value; if yes, setting the pre-set region as the preloading region; if not, excluding the pre-set region from the preloading region; 
 based on the access quantity of the accessed webpage and the access quantity of the preloaded webpage, calculating a user usage rate of the preloaded webpage, and based on the user usage rate, adjusting the preloading page depth; and 
 calculating the capacity of a current free space and the capacity of the repeatedly useable space in the local cache, generating a target space capacity; and based on the target space capacity, adjusting a capacity of the available caching space for preloading. 
 
     
     
       4. The method according to  claim 3 , further comprising:
 when the webpage preloading process is in an initial state, selecting a target domain name from a pre-set domain name list based on priority for domain name selection, and selecting the preloaded webpage from webpages contained in the target domain name. 
 
     
     
       5. The method according to  claim 4 , further comprising:
 counting access parameters of each domain name in the domain name list within the pre-set time period, the access parameters comprising: a webpage page view (PV) quantity, a domain name user quantity, a users' mean access quantity, and/or a length of users' stay time; and 
 adjusting priority of the domain name in the domain name list based on the access parameters. 
 
     
     
       6. A device for webpage preloading, the device comprising a storage device and one or more processors, the device further comprising:
 a pre-loading unit stored in the storage device and executed by the one or more processors to conduct webpage preloading according to a current preloading policy, the preloading policy comprising: a preloading time range, a preloading region, a preloading page depth, and an available caching space for preloading; 
 a counting unit stored in the storage device and executed by the one or more processors to count historical data within a pre-set time period, the historical data comprising: information about an accessed webpage, information about a preloaded webpage, and state information of a local cache; and 
 an updating unit stored in the storage device and executed by the one or more processors to update the preloading policy based on the historical data counted by the counting unit. 
 
     
     
       7. The device according to  claim 6 , wherein the counting unit comprises:
 a first counting sub-unit that counts the information about the accessed webpage, comprising: an access quantity of the accessed webpage, an accessed time range, and a service deployment region to which a terminal that conducts webpage accessing belongs; 
 a second counting sub-unit that counts the information about the preloaded webpage, comprising: an access quantity of the preloaded webpage; and 
 a third counting sub-unit that counts the state information of the local cache, comprising: a capacity of a current free space in the local cache and a capacity of a repeatedly useable space in the local cache. 
 
     
     
       8. The device according to  claim 7 , wherein the updating unit comprises:
 a first calculating sub-unit that calculates a time range when an access quantity of the accessed webpage is higher than a first threshold value based on the access quantity and the accessed time range of the accessed webpage; 
 a first adjusting sub-unit that adjusts the preloading time range based on the calculated time range; 
 a second calculating sub-unit that calculates whether an access quantity of the accessed webpage in a pre-set region is higher than a second threshold value based on the access quantity of the accessed webpage and the service deployment region; 
 a second adjusting sub-unit that sets the pre-set region as the preloading region if the access quantity in the pre-set region is higher than the second threshold value; and otherwise, excludes the pre-set region from the preloading region; 
 a third calculating sub-unit that calculates a user usage rate of the preloaded webpage based on the access quantity of the accessed webpage and the access quantity of the preloaded webpage; 
 a third adjusting sub-unit that adjusts the preloading page depth based on the user usage rate; 
 a fourth calculating sub-unit that calculates the capacity of a current free space and the capacity of the repeatedly useable space in the local cache; and 
 a fourth adjusting sub-unit that generates a target space capacity based on the capacity of the current free space and the capacity of the repeatedly useable space, and adjusts the capacity of the available caching space for preloading based on the target space capacity. 
 
     
     
       9. The device according to  claim 8 , wherein:
 when the webpage preloading process is in an initial state, the pre-loading unit selects a target domain name from a pre-set domain name list based on priority, and selects the preloaded webpage from webpages contained in the target domain name. 
 
     
     
       10. The device according to  claim 9 , wherein
 the counting unit further comprises: a fourth counting sub-unit that counts access parameters of each domain name in the domain name list within the pre-set time period, the access parameters comprising: a webpage page view (PV) quantity, a domain name user quantity, a users' mean access quantity, and/or a length of users' stay time; and 
 the updating unit further comprises: a fifth adjusting sub-unit that adjusts priority of the domain name in the domain name list based on changes of the access parameters. 
 
     
     
       11. A computer-readable storage medium, stored with computer-executable instructions, wherein when a processor executes the computer-executable instructions, the processor performs the following steps:
 conducting webpage preloading according to a current preloading policy, the preloading policy comprising: a preloading time range, a preloading region, a preloading page depth, and an available caching space for preloading; 
 counting historical data within a pre-set time period, the historical data comprising: information about an accessed webpage, information about a preloaded webpage, and state information of a local cache; and 
 updating the preloading policy based on the historical data. 
 
     
     
       12. A method for webpage preloading, the method comprising the following steps:
 acquiring historical data containing one or more types of information, comprising information about an accessed webpage, information about a preloaded webpage, and state information of a local cache; 
 counting the historical data within a pre-set time period and updating a pre-reading policy based on the historical data; and 
 conducting webpage preloading according to the pre-reading policy. 
 
     
     
       13. The method according to  claim 12 , further comprising:
 parsing URLs in a reference page, selecting URLs of one or more webpages according to the pre-reading policy, and sending the selected URLs to a URL queue; and 
 preloading webpage data corresponding to the selected URLs in the URL queue. 
 
     
     
       14. The method according to  claim 12 , wherein the information about the accessed webpage comprises: an access quantity of the accessed webpage and an accessed time range. 
     
     
       15. The method according to  claim 14 , wherein the updating of the pre-reading policy based on the historical data counted within the pre-set time period comprises:
 based on the access quantity and the accessed time range of the accessed webpage, calculating a time range when an access quantity of the accessed webpage is higher than a first threshold value; and 
 based on the time range, adjusting a preloading time range. 
 
     
     
       16. The method according to  claim 12 , wherein the information about the accessed webpage comprises: an access quantity of the accessed webpage and an access quantity of the preloaded webpage. 
     
     
       17. The method according to  claim 16 , wherein the updating of the pre-reading policy based on the historical data counted within the pre-set time period comprises:
 based on the access quantity of the accessed webpage and/or the access quantity of the preloaded webpage, calculating a user usage rate of the preloaded webpage, and 
 based on the user usage rate, adjusting a preloading page depth. 
 
     
     
       18. The method according to  claim 12 , wherein the historical data comprises: a service deployment region to which a terminal that conducts webpage accessing belongs. 
     
     
       19. The method according to  claim 18 , wherein the updating of the pre-reading policy based on the historical data counted within a pre-set time period comprises:
 based on the access quantity of the accessed webpage and the service deployment region, calculating whether the access quantity of the accessed webpage in a pre-set region is higher than a second threshold value;
 if yes, setting the pre-set region as a preloading region; and 
 if not, excluding the pre-set region from the preloading region. 
 
 
     
     
       20. The method according to  claim 12 , the state information of the local cache comprises: a capacity of a current free space and/or a capacity of a repeatedly useable space in the local cache. 
     
     
       21. The method according to  claim 20 , wherein the updating of the pre-reading policy based on the historical data counted within the pre-set time period comprises:
 calculating the capacity of the current free space and the capacity of the repeatedly useable space in the local cache, 
 generating a target space capacity; and 
 based on the target space capacity, adjusting a capacity of an available caching space for preloading. 
 
     
     
       22. The method according to  claim 12 , wherein the method further comprises: in an initial state, selecting a domain name from a pre-set domain name list, and loading a webpage corresponding to the domain name to act as a reference webpage. 
     
     
       23. The method according to  claim 22 , wherein the domain name is selected from the domain name list based on domain name factors, comprising: one or more of an access quantity of a domain name, a domain name RTT, a domain name user quantity, a length of users' mean stay time, and a users' mean accessed URL quantity.