Skip to content

[Feature] Please update Finetune_with_Torch_XLA.ipynb #248

@steveepreston

Description

@steveepreston

Description of the feature request:

Hey,
Im following [Gemma_2]Finetune_with_Torch_XLA.ipynb
This notebook is outdated so much. all libraries updated and getting many deprecated errors.
also torch-xla 2.8.0/2.8.1/2.9.0rc released, can you please update this notebook to follows updates?
im using this notebook, and after upgrading torch-xla to 2.8.0/2.8.1 my train time increased x3 times.
i think i missing something about new torch-xla/tpu

What problem are you trying to solve with this feature?

  • many deprecated parameters errors
  • train time increased x3 more times

Any other information you'd like to share?

  • transformers / trl / peft updated too much'
  • torch and torch-xla updated

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions