Customizations for LLaMa-Factory

[TanyaChutani]

Reminder

• I have read the above rules and searched the existing issues.

Description

Overall, looks powerful! Just a few things I’m curious about:

• Can we go beyond the UI for custom setups?

• How well does it handle big models like LLaMA 3–70B on multi-GPU setups?

• Is it smooth with large or custom datasets?

• Does it track experiments well for reproducibility?

Pull Request

No response

[hiyouga]

The first two questions can be answered by the examples and the FAQs.

Large datasets are supported as long as they meet the requirements described in the data README.

You can enable TensorBoard or Wandb for better reproducibility.