1. 论坛系统升级为Xenforo，欢迎大家测试！
    Dismiss Notice

装了一个开源的蜘蛛程序

Discussion in '源码讨论' started by 小叶, Oct 25, 2005.

  1. 小叶

    小叶 New Member

    Joined:
    Sep 4, 2005
    Messages:
    17,941
    Likes Received:
    33
    http://www.92key.com/s/

    老外做的开源系统,
    国内汉化的一塌糊涂,,,除了界面外,
    连编码都没转换.
     
    #1 小叶, Oct 25, 2005
  2. wm_chief

    wm_chief New Member

    Joined:
    Sep 5, 2005
    Messages:
    17,890
    Likes Received:
    46
    过后研究。帝国搜索引擎也将不久面市
     
    #2 wm_chief, Oct 25, 2005
  3. jcking

    jcking Well-Known Member

    Joined:
    Aug 30, 2005
    Messages:
    22,282
    Likes Received:
    70
    哦,
     
    #3 jcking, Oct 25, 2005
  4. 小叶

    小叶 New Member

    Joined:
    Sep 4, 2005
    Messages:
    17,941
    Likes Received:
    33
    你可以对这个进行二次开发就不错了,,
    开源的东西,,有一些技术已经很成熟,
    一些缩略,快照没有,还有一些关键字区分不好,,
     
    #4 小叶, Oct 25, 2005
  5. jcking

    jcking Well-Known Member

    Joined:
    Aug 30, 2005
    Messages:
    22,282
    Likes Received:
    70
    :eek:
    :eek:
     
    #5 jcking, Oct 25, 2005
  6. wm_chief

    wm_chief New Member

    Joined:
    Sep 5, 2005
    Messages:
    17,890
    Likes Received:
    46
    搜索好像不是很好。我主要研究蜘蛛织网。。。
     
    #6 wm_chief, Oct 25, 2005
  7. 小叶

    小叶 New Member

    Joined:
    Sep 4, 2005
    Messages:
    17,941
    Likes Received:
    33
    好像就是OE技术,,而且速度和效率很低,,
    我怀疑这个开源程序的官方自己用Exe这样的实体软件做爬行..
     
    #7 小叶, Oct 25, 2005
  8. wm_chief

    wm_chief New Member

    Joined:
    Sep 5, 2005
    Messages:
    17,890
    Likes Received:
    46
    机器开着，影响不大，不过用exe可实现多线程，效果会更好
     
    #8 wm_chief, Oct 25, 2005
  9. 小叶

    小叶 New Member

    Joined:
    Sep 4, 2005
    Messages:
    17,941
    Likes Received:
    33
    但数据库膨胀急剧厉害...一个站爬下就几百M了..
     
    #9 小叶, Oct 25, 2005
  10. wm_chief

    wm_chief New Member

    Joined:
    Sep 5, 2005
    Messages:
    17,890
    Likes Received:
    46
    嗯，是个比较大的问题
     
    #10 wm_chief, Oct 25, 2005
  11. 小叶

    小叶 New Member

    Joined:
    Sep 4, 2005
    Messages:
    17,941
    Likes Received:
    33
    以前落伍一个叫bigfoot的开发过一个独立引擎的搜索,,
    还不是找人赞助带宽和服务器,,
    数据膨胀太快了,蜘蛛都不敢随便放出去咬人.
     
    #11 小叶, Oct 25, 2005
  12. 老林

    老林 New Member

    Joined:
    Sep 6, 2005
    Messages:
    10,580
    Likes Received:
    36
    只要摸透中文分词　下一个百度也就来鸟
     
    #12 老林, Oct 25, 2005
  13. wm_chief

    wm_chief New Member

    Joined:
    Sep 5, 2005
    Messages:
    17,890
    Likes Received:
    46
    主要要有钱砸。：）
     
    #13 wm_chief, Oct 25, 2005
  14. 3web.com.cn

    3web.com.cn New Member

    Joined:
    Oct 24, 2005
    Messages:
    337
    Likes Received:
    0
    关注学习中。。。
    下回请教
     
    #14 3web.com.cn, Oct 25, 2005
  15. 老林

    老林 New Member

    Joined:
    Sep 6, 2005
    Messages:
    10,580
    Likes Received:
    36
    拿下一个专利　钱马上跟着来　这东东喜欢的人多了
     
    #15 老林, Oct 25, 2005
(You must log in or sign up to post here.)
Toggle Width
Language
English (US)