Vision fine-tuning

[2U1]

This issue is for a: (mark with an x)

- [ ] bug report -> please search issues before submitting
- [X] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

Mention any other details that might be useful

When fine-tuning the vision-model I think it's possible for fine-tuning the vision model with non-lora and fine-tune the language model with lora.

I've made a code for this by borrowing code from llava. I hope this could be helpful for updating the training script for fine-tuning vision model.

https://github.com/2U1/Phi3-Vision-ft

[leestott]

@2U1 Hi would like make a pull request with you addition?

[franperezlopez]

@2U1 please 🙌

[2U1]

@leestott @franperezlopez Yes sure!