Added VicReg - Variance-Invariance-Covariance Regularization for SSL #1030
Conversation
added link
sorry
@sachinprasadhs I really want to thank you for letting me know with regards to updates - i completely overlooked this PR and the change that was requested by @fchollet. |
|
@sachinprasadhs @fchollet I rebased the PR accordingly and it should be fine now. |
…into vicreg-branch
sachinprasadhs
added
keras-team-review-pending
and removed
stat:awaiting response from contributor
labels
sachinprasadhs
added
stat:awaiting keras-eng
awaiting review
and removed
keras-team-review-pending
labels
|
@dewball345 I see the following request from @fchollet:
Can you submit the |
|
@pcoet I did, the barlow twins files were files that I brought back by rebasing my PR(there were some weird git related things that occurred and the barlow twins notebooks were deleted in this PR so I had to bring them back by a rebase). Those aren't new files, I just brought them back. Only vicreg.py is the file related to vicreg. |
|
Great, thanks @dewball345! I'll go ahead and assign this to @fchollet. |
There was a problem hiding this comment.
@dewball345 Thanks for the ping on this. I made a couple of nitty suggestions on the Markdown content. Can you make those changes, and then we'll ask @fchollet to do a review?
examples/vision/barlow_twins.py
Outdated
|
|
||
|
|
||
| """ | ||
| ### From-Scratch implementation(for understanding purposes) |
There was a problem hiding this comment.
Missing space: "implementation(for" -> "implementation (for"
examples/vision/barlow_twins.py
Outdated
| Modified from | ||
| Responsible for the Resnet 34 architecture. | ||
| Modified from | ||
| https://www.analyticsvidhya.com/blog/2021/08/how-to-code-your-resnet-from-scratch-in-tensorflow/#h2_2. |
There was a problem hiding this comment.
It looks like there's a copy-paste error here(?). Is this the same URL repeated several times? Please check and clean up, as needed.
examples/vision/barlow_twins.py
Outdated
| @@ -605,9 +603,15 @@ def plot_values(batch: tuple): | |||
|
|
|||
| After this the two parts are summed together. | |||
|
|
|||
| We will be using the [BarlowLoss](https://github.com/tensorflow/similarity/blob/master/tensorflow_similarity/lo | |||
| sses/barlow.py) | |||
There was a problem hiding this comment.
The Markdown link can't be broken across lines. Please keep the entire link on a single line. See https://github.com/keras-team/keras-io/blob/master/contributor_guide.md#markdown-links.
examples/vision/vicreg.py
Outdated
| primarily store information from the images that differentiate the cat from its canine | ||
| counterpart. For example, it could keep the shape of the ears of both images, or maybe | ||
| the tail length, and so on. When used in a downstream task, | ||
| like a classification model, these embeddings(which have the curated measurements |
There was a problem hiding this comment.
Missing space: "embeddings(which" -> "embeddings (which".
examples/vision/vicreg.py
Outdated
| [Barlow Twins Paper](https://arxiv.org/abs/2103.03230) | ||
|
|
||
| [Barlow Twins Example(Some of the architecture code is copied from | ||
| it)](https://keras.io/examples/vision/barlow_twins/) |
There was a problem hiding this comment.
Markdown links have to be on a single line.
|
@dewball345 Also, I apologize for not requesting these changes earlier. Thanks for your patience! |
|
@pcoet Hi, it has been a while. I forgot about this PR for a while but I went back and made the fixes. Please have a look |
|
@dewball345 , We have migrated from Keras 2 to Keras 3, could you please consider migrating this tutorial to Keras 3. |
This is a reupload(sorry about that). Saw that the original PR was a little hard to find so I created a new updated one.
@owenvallis approved the code but it needs @fchollet's approval to merge into main.
For reference here is the original PR: #847