Skip to content

Commit

Permalink
altered fusion model explanations on docs
Browse files Browse the repository at this point in the history
  • Loading branch information
florencejt committed Nov 8, 2023
1 parent e6361c6 commit 64424f1
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions docs/fusion_model_explanations.rst
Original file line number Diff line number Diff line change
Expand Up @@ -9,15 +9,15 @@ where appropriate.

.. figure:: _static/cui_diagram.jpeg
:align: left
:width: 80%
:width: 100%
:alt: Model fusion diagram

The diagram above shows the categorisation of the fusion models available in this library. This image has been taken from `Cui et al. (2023) <https://iopscience.iop.org/article/10.1088/2516-1091/acc2fe>`_.

The table below shows the categorisation of the models available in this library. It is important to note that some of the methods in this library can probably be categorised in more than one way. For example, the :class:`.ConcatImgLatentTabDoubleTrain` model can be considered both an subspace-based model and an operation-based model. This is because it uses an autoencoder to learn an image latent space, which is then concatenated with the tabular data. However, the model also uses an operation (concatenation) to combine the modalities. Therefore, it is important to understand the categorisation of the models as a guide, rather than a strict rule.
The table below shows the categorisation of the models available in this library. It is important to note that some of the methods in this library can probably be categorised in more than one way. For example, the :class:`.ConcatImgLatentTabDoubleTrain` model can be considered both an subspace-based model and an operation-based model. This is because it uses an autoencoder to learn an image latent space, which is then concatenated with the tabular data. However, the model also uses an operation (concatenation) to combine the modalities. The categorisation of the models are a guide, rather than a strict rule.

.. list-table::
:widths: 20 80
:widths: 15 85
:header-rows: 1

* - Fusion type
Expand Down Expand Up @@ -48,7 +48,7 @@ This tabular-tabular fusion model works by passing each tabular modality through
.. image:: _static/ConcatTabularFeatureMaps.png
:align: left

-----
------

:class:`.ConcatTabularData`
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Expand Down

0 comments on commit 64424f1

Please sign in to comment.