AraGPT2 & AraELECTRA

[israakhalil]

Hello,
Can I use AraGPT2 & AraELECTRA for text Classification ?

[WissamAntoun]

Yes of course, But i don't think AraGPT2 will perform well

[israakhalil]

How can I use them
Is it the same as using AraBert in this example https://colab.research.google.com/drive/1P9iQHtUH5KUbTVtp8B4-AopZzEEPE0lw?usp=sharing
But with changing the name of the model?

[WissamAntoun]

This notebook will work for AraELECTRA and not for AraGPT2. For araGPT2 you will have to edit the BERTdataset class, and remove the [CLS] token.