On-Device Local LLM

The BJTU Edge Computing & Edge Intelligence Group is pioneering the integration of large language models with edge devices. Our current focus areas include:

LLM compression 压缩
Model fine-tuning 微调
Edge-Cloud inference 云边
LLM applications 应用

Jetson Deployment

Llama2 on Jetson Orin Nano

Windows Optimization

DeepSeek-R1 on Windows Laptop

Android Demo

Gemma on Android Phone