楼上说(shuō )的很多,我补充(chōng )一(yī )下,正确的应(yīng )该叫网(wǎng )络蜘蛛(zhū ),又称爬虫,本质是搜索引擎(qíng )派出(chū )的(de )一个(gè )执行(háng )抓取任(rèn )务(wù )的程序(xù )蜘蛛(zhū )池的(de )本质是大(dà )量的网站(zhàn )互相链接,每个站单独产(chǎn )生大(dà )量的内容吸引(yǐn )蜘(zhī )蛛来爬(pá ),几(jǐ )千(qiān )个(gè )网站互链时,可以(yǐ )想象蜘蛛(zhū )的链(liàn )接(jiē )
Copyright © 2008-2018