Commit Graph

7 Commits (c908968ceaef1602a851762d115fc8d1ee340295)

Author SHA1 Message Date
梦典 f3d7c69be2
Update finetune.py
Just lora finetuing need low cpu memory usage
梦典 67b3f949b6
Update finetune.py For lower cpu memory
1.Change default device_map to "auto"
device_map = "auto"
2.For lower cpu memory, add parameter at load model
low_cpu_mem_usage=True,
Junyang Lin 00dceebbaa
Update finetune.py
Junyang Lin f7681f9e77
Update finetune.py
Junyang Lin 75cc160f74
Update finetune.py
JustinLin610 b5fad3d561 fix single-gpu qlora, and add profiling
JustinLin610 af22d5e0ce add finetuning