Description of the feature request:
Hey,
Im following [Gemma_2]Finetune_with_Torch_XLA.ipynb
This notebook is outdated so much. all libraries updated and getting many deprecated errors.
also torch-xla 2.8.0/2.8.1/2.9.0rc released, can you please update this notebook to follows updates?
im using this notebook, and after upgrading torch-xla to 2.8.0/2.8.1 my train time increased x3 times.
i think i missing something about new torch-xla/tpu
What problem are you trying to solve with this feature?
- many deprecated parameters errors
- train time increased x3 more times
Any other information you'd like to share?
- transformers / trl / peft updated too much'
- torch and torch-xla updated