Skip to content

API reference: Models V0.3a

Jump to bottom
Jetic Gu edited this page Jun 23, 2017 · 3 revisions

Introduction

The Aligner contains several available models that one could use instantly, but you can also write your own model to run with the Aligner.

Here are the descriptions of the models API, if you write your own model and wishes to use it with the Aligner, it will need to fit the API requirements described below.

The description here is of module version 0.3a.

Dependency

Compatibility

  • Specifications for Models of type 1 remain unchanged from 0.1a

  • Specifications for Models of type 2 remain unchanged from 0.2a

Changes in v0.3a

  • removed dependencies of evaluators on test dataset.

Where do I place the model file (MyModel.py)?

In src/models/.

API requirements

In your MyModel.py, the only thing required is a class called AlignmentModel, which contains the following methods. In the Aligner, before loading the model, Aligner will call the checkAlignmentModel function in src/models/modelChecker.py to check if the model meets the requirement. If you wish your model's API to look a bit different(for example more parameters) you'll need to modify checkAlignmentModel as well.

Type 1 model

def train(self, bitext, iterations)

Parameters:

This is the method that will be called to do the training. Currently the parameters has to be these two and these two only. If you wish otherwise you'll need to modify checkAlignmentModel in src/models/modelChecker.py.

def decode(self, bitext)

Parameters:

Return:

This is the method that will be called to do the training. Currently the parameters has to be these two and these two only. If you wish otherwise you'll need to modify checkAlignmentModel in src/models/modelChecker.py.

Type 2 model

def train(self, formTritext, tagTritext, iterations)

Parameters:

  • formTritext : Tritext, detail of this format This is the tritext of 1) source language text; 2) target language text; 3) gold alignment with type.
  • tagTritext : Tritext , detail of this format This is the tritext of 1) source language text POS tags; 2) target language text POS tags; 3) gold alignment with type.
  • iterations: int, number of iterations to run.

This is the method that will be called to do the training. Currently the parameters has to be these two and these two only. If you wish otherwise you'll need to modify checkAlignmentModel in src/models/modelChecker.py.

def decode(self, bitext)

Parameters:

  • formBitext: Bitext, detail of this format This is the Bitext of 1) source language text; 2) target language text.
  • tagBitext: Bitext, detail of this format This is the Bitext of 1) source language text POS tag; 2) target language text POS tag.

Return:

This is the method that will be called to do the training. Currently the parameters has to be these two and these two only. If you wish otherwise you'll need to modify checkAlignmentModel in src/models/modelChecker.py.

Use the checkAlignmentModel

The checkAlignmentModel exists to make sure the aligner can at least call the model to run training and decoding without modification, it also gives hints on what doesn't fit in a model. It will if successful return the type of the model, otherwise return -1.

If you have multiple models to add you can add your their names to the supportedModels list in modelChecker.py, and run

python modelChecker.py

to check the APIs of all of the models at once.

Evaluator

In addition, you can also add an evaluator of your choosing should you wish to evaluate your model.

The provided evaluators are under src/evaluators/. (You can also run them directly, see all options by python EVALUATOR.py -h)

To do so, simply add the following line to your class:

class AlignmentModel():
    def __init__(self):
        ... ...
        self.evaluate = myEvaluationFunction
        return

The requirement of myEvaluationFunction:

Parameter:

Return:

  • dict: containing the results(scores etc.).

For example:

return {
    "Precision": precision,
    "Recall": recall,
    "AER": aer,
    "F-score": fScore
}
Clone this wiki locally