Comparative Analysis Before and After Optimization of URL Detection Program

3rd International Symposium on Resource Exploration and Environmental Science

生态环境科学

Yan, Yi^1 ; Zhan, Lichao^1 ; Zhong, Susheng^1 ; Lin, Xijun^1 ; Mai, Xiaohui^1 ; Zhou, Kaidong^1

Information Center Guangdong Power Grid Company Limited, Guangdong, China^1

关键词: Comparative analysis;    Log file;    Number of threads;    Power grids;    Program construction;    Total length;    Whole process;   

Others  :  https://iopscience.iop.org/article/10.1088/1755-1315/300/4/042120/pdf
DOI  :  10.1088/1755-1315/300/4/042120

学科分类：环境科学（综合）

来源: IOP

【 摘 要 】

Perform URL detection on the three major systems of the power grid, and obtain the program for the detection results. The whole process of the project has gone through two stages, namely the original program construction and the optimized program construction. The original program was built in a cluster with 918 menus and 36 ips and ports. Since there is not a proper number of threads, a large number of URLs are waiting in serial during URL detection; the final data is exported to excel, resulting in The detection of the cluster resources is wasted, the total length of the probe is about 35 minutes; the optimized program adds enough threads, and the data is exported to the excel mode, the data is exported to the log file through the log framework, and finally A total of 2 minutes, the efficiency increased by 1650%.