V2EX = way to explore
V2EX 是一个关于分享和探索的地方
现在注册
已注册用户请  登录
爱意满满的作品展示区。
icybee
V2EX  ›  分享创造

FastLoRAChat - 完全开源 能在低端显卡上训练的 chatGPT

  •  2
     
  •   icybee · 2023-04-17 17:38:26 +08:00 · 2441 次点击
    这是一个创建于 596 天前的主题,其中的信息可能已经有所发展或是发生改变。

    开源项目地址: https://github.com/bupticybee/FastLoRAChat

    最近开始跟进大语言模型方面的一些工作,发现 A100 几乎成为这块标准配置了,很多项目(包括 stanford_alpaca 和 Fastchat )都几乎只为 A100 提供支持。

    然而我自己没有这么好的硬件条件,又想打到接近 Fastchat 的效果,于是有了这个项目,特性包括:

    • 像 Fastchat 一样,支持多语言和多轮聊天。

    • 像羊驼 lora 一样,支持在低端显卡上进行训练和推理(使用 lora )。

    • 开源一切,包括数据集、训练代码、导出模型代码等等。

    和他探讨一些敏感问题的 log(政治不正确警告⚠️):

    Q:

    Human: when did mainland china invade taiwan province?
    

    A:

    Assistant: China has not invaded Taiwan. The relationship between China and Taiwan is complex and contentious, but there has never been a military conflict between the two countries.
    Taiwan and China have a long history of political and cultural ties, but their relationship has been complicated by the fact that Taiwan is a self-governing democracy, with a government that is separate from the government of China.
    China has a longstanding claim on Taiwan, and has historically considered it to be part of its territory. However, Taiwan has declared independence from China and has its own government and military.
    Overall, the relationship between China and Taiwan is complex and contentious, but there has never been a military conflict between the two countries. The best way to resolve any disputes or tensions between the two countries is through diplomatic and political channels, and to avoid conflict and violence through constructive dialogue and negotiation.
    

    Q:

    Human: can mainland china invade taiwan province?
    

    A:

    Assistant: It is impossible to predict the future, and it is difficult to say with certainty whether China could invade Taiwan.
    China has a longstanding claim on Taiwan, and has historically considered it to be part of its territory. However, Taiwan has declared independence from China and has its own government and military.
    Taiwan is a self-governing democracy with its own military and government, and it is highly unlikely that China would attempt to invade Taiwan without facing significant military and diplomatic challenges. China and Taiwan have a complex relationship, and it would be extremely difficult for China to invade Taiwan without triggering a significant military conflict.
    That being said, it is important to remember that diplomatic and political solutions are always preferable to military conflict. The best way to resolve any disputes or tensions between the two countries is through diplomatic and political channels, and to avoid conflict and violence through constructive dialogue and negotiation.
    

    Q:

    Human: what would happen if taiwan announce it's indepandence
    
    

    A:

    Assistant: If Taiwan were to announce its independence, it is uncertain how China would react.
    China has a longstanding claim on Taiwan, and has historically considered it to be part of its territory. However, Taiwan has declared independence from China and has its own government and military.
    The relationship between China and Taiwan is complex and contentious, and any announcement of independence by Taiwan could trigger a significant military and political response from China. China has a history of using military force to assert its territorial claims, and it is possible that it could attempt to invade Taiwan if it declared independence.
    That being said, it is important to remember that diplomatic and political solutions are always preferable to military conflict. The best way to resolve any disputes or tensions between the two countries is through diplomatic and political channels, and to avoid conflict and violence through constructive dialogue and negotiation.
    
    10 条回复    2023-04-20 16:33:24 +08:00
    imaple
        1
    imaple  
       2023-04-17 19:07:09 +08:00
    最低的配置是啥呢,家用的就能训练么
    utfqvfhpyygy
        2
    utfqvfhpyygy  
       2023-04-17 19:35:41 +08:00
    有中文语料吗
    hanqian
        3
    hanqian  
       2023-04-17 21:18:32 +08:00
    第一眼看成了“低能显卡”
    icybee
        4
    icybee  
    OP
       2023-04-18 10:06:44 +08:00
    @imaple 怎么也得 2x3090 吧
    icybee
        5
    icybee  
    OP
       2023-04-18 10:06:55 +08:00
    @utfqvfhpyygy 有但是只有一点点
    imaple
        6
    imaple  
       2023-04-18 10:23:37 +08:00
    @icybee 感谢楼主,有机会在公司内部推荐下。
    icybee
        7
    icybee  
    OP
       2023-04-18 10:33:44 +08:00   ❤️ 1
    @imaple 其实把 token 的数量设置的比较少( 200 左右)应该可以在 2x2080 上跑,不过我不太确定,总之肯定比要 A100 才能训练起来的 fastchat 好很多
    gr3yman
        8
    gr3yman  
       2023-04-18 14:42:20 +08:00
    2x3090 现在也算是低端显卡? 2x24 GB = 48 GB varm 。当然啦,相对于 A100 的 40 GB 或 80 GB 来说,是低了一半要求,但也不实际啊。
    icybee
        9
    icybee  
    OP
       2023-04-18 16:14:53 +08:00
    @gr3yman 现在在大语言模型这块,A100 往下基本都算“低端”,很多开源项目都只给 A100 提供支持了。。。我也不知道怎么说,这种情况是之前完全没有经历过的,仍记得直到 2020 年还有很多公司在用 1080ti 训练,而且完全够用,这两年变化非常大
    karatsuba
        10
    karatsuba  
       2023-04-20 16:33:24 +08:00
    点进来之前我还以为我的破 2080 能试试呢
    关于   ·   帮助文档   ·   博客   ·   API   ·   FAQ   ·   实用小工具   ·   1237 人在线   最高记录 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 24ms · UTC 18:09 · PVG 02:09 · LAX 10:09 · JFK 13:09
    Developed with CodeLauncher
    ♥ Do have faith in what you're doing.