Skip to main content

LLM跑在边缘芯片上

  1. 模型工具,转换,加载等等
    1.  Distributed Llama   https://github.com/b4rtaz/distributed-llama?tab=readme-ov-file