Update README.md

Added notes due to recent peft update.
main
Ren Xuancheng 12 months ago committed by GitHub
parent b792917925
commit d40742b004
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

@ -693,6 +693,8 @@ model = AutoPeftModelForCausalLM.from_pretrained(
).eval() ).eval()
``` ```
> NOTE: If `peft>=0.8.0`, it will try to load the tokenizer as well, however, initialized without `trust_remote_code=True`, leading to `ValueError: Tokenizer class QWenTokenizer does not exist or is not currently imported.` Currently, you could downgrade `peft<0.8.0` or move tokenizer files elsewhere to workaround this issue.
If you want to merge the adapters and save the finetuned model as a standalone model (you can only do this with LoRA, and you CANNOT merge the parameters from Q-LoRA), you can run the following codes: If you want to merge the adapters and save the finetuned model as a standalone model (you can only do this with LoRA, and you CANNOT merge the parameters from Q-LoRA), you can run the following codes:
```python ```python

Loading…
Cancel
Save