Commit Graph

8 Commits (3e63f107fa072858ae863cc35293707e0a000f09)

Author SHA1 Message Date
Junyang Lin 3e63f107fa
Update finetune.py
梦典 f3d7c69be2
Update finetune.py
Just lora finetuing need low cpu memory usage
梦典 67b3f949b6
Update finetune.py For lower cpu memory
1.Change default device_map to "auto"
device_map = "auto"
2.For lower cpu memory, add parameter at load model
low_cpu_mem_usage=True,
Junyang Lin 00dceebbaa
Update finetune.py
Junyang Lin f7681f9e77
Update finetune.py
Junyang Lin 75cc160f74
Update finetune.py
JustinLin610 b5fad3d561 fix single-gpu qlora, and add profiling
JustinLin610 af22d5e0ce add finetuning