diff --git a/README.md b/README.md index 0f1ea86..a6d707a 100644 --- a/README.md +++ b/README.md @@ -20,11 +20,12 @@ and [java](https://github.com/tree-sitter/tree-sitter-java). `prepare_data.sh`. 2. Concatenate the vectors created in the previous step to the original sequence, resulting in the data that is used for training, by running `preprocess_data.sh`. -3. Finally, run `finetuneT5[unique].sh` to start training the model. This step uses the instructions as +3. Finally, run `run.sh` (found in CodeT5/sh) to start training the model. This step uses the instructions as described by codeXGLUE. ## Results +Java to C#: | Method | BLEU | Acc (100%) | [CodeBLEU](https://github.com/microsoft/CodeXGLUE/blob/main/Code-Code/code-to-code-trans/CodeBLEU.MD) | | ---------- | :--------: | :-------: | :-------: | | Naive copy | 18.54 | 0.0 | - | @@ -32,11 +33,12 @@ described by codeXGLUE. | Transformer | 55.84 | 33.0 | 63.74 | | Roborta (code) | 77.46 | 56.1 | 83.07 | | CodeBERT | **79.92** | **59.0** | **85.10** | -| CodeBERT + T5 | | | | -| CodeBERT + T5Unique | | | | +| Baseline | 12.44 | 0 | - | +| CodeBERT + T5 | 0 | 0 | - | +| CodeBERT + T5Unique | 0 | 0 | - | -C# to Java: +C# to Java: | Method | BLEU | Acc (100%) | [CodeBLEU](https://github.com/microsoft/CodeXGLUE/blob/main/Code-Code/code-to-code-trans/CodeBLEU.MD) | | ---------- | :--------: | :-------: | :-------: | | Naive copy | 18.69 | 0.0 | - | @@ -44,5 +46,7 @@ C# to Java: | Transformer | 50.47 | 37.9 | 61.59 | | Roborta (code) | 71.99 | 57.9 | **80.18** | | CodeBERT | **72.14** | **58.0** | 79.41 | -| CodeBERT + T5 | | | | -| CodeBERT + T5Unique | | | | \ No newline at end of file +| Baseline | 12.14 | 4.41 | - | +| CodeBERT + T5 | 0 | 0.4 | - | +| CodeBERT + T5Unique | 0 | 1.4 | - | +