-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
20 changed files
with
3,423 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,16 @@ | ||
# Nerfies | ||
|
||
This is the repository that contains source code for the [Nerfies website](https://nerfies.github.io). | ||
|
||
If you find Nerfies useful for your work please cite: | ||
``` | ||
@article{park2021nerfies | ||
author = {Park, Keunhong and Sinha, Utkarsh and Barron, Jonathan T. and Bouaziz, Sofien and Goldman, Dan B and Seitz, Steven M. and Martin-Brualla, Ricardo}, | ||
title = {Nerfies: Deformable Neural Radiance Fields}, | ||
journal = {ICCV}, | ||
year = {2021}, | ||
} | ||
``` | ||
|
||
# Website License | ||
<a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/"><img alt="Creative Commons License" style="border-width:0" src="https://i.creativecommons.org/l/by-sa/4.0/88x31.png" /></a><br />This work is licensed under a <a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/">Creative Commons Attribution-ShareAlike 4.0 International License</a>. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,324 @@ | ||
<!DOCTYPE html> | ||
<html> | ||
<head> | ||
<meta charset="utf-8"> | ||
<meta name="description" | ||
content="MILL: Mutual Verification with Large Language Models for Zero-Shot Query Expansion."> | ||
<meta name="keywords" content="Query expansion, Large language models, Information retrieval"> | ||
<meta name="viewport" content="width=device-width, initial-scale=1"> | ||
<title>MILL: Mutual Verification with Large Language Models for Zero-Shot Query Expansion</title> | ||
|
||
<!-- Global site tag (gtag.js) - Google Analytics --> | ||
<script async src="https://www.googletagmanager.com/gtag/js?id=G-PYVRSFMDRL"></script> | ||
<script> | ||
window.dataLayer = window.dataLayer || []; | ||
|
||
function gtag() { | ||
dataLayer.push(arguments); | ||
} | ||
|
||
gtag('js', new Date()); | ||
|
||
gtag('config', 'G-PYVRSFMDRL'); | ||
</script> | ||
|
||
<link href="https://fonts.googleapis.com/css?family=Google+Sans|Noto+Sans|Castoro" | ||
rel="stylesheet"> | ||
|
||
<link rel="stylesheet" href="./static/css/bulma.min.css"> | ||
<link rel="stylesheet" href="./static/css/bulma-carousel.min.css"> | ||
<link rel="stylesheet" href="./static/css/bulma-slider.min.css"> | ||
<link rel="stylesheet" href="./static/css/fontawesome.all.min.css"> | ||
<link rel="stylesheet" | ||
href="https://cdn.jsdelivr.net/gh/jpswalsh/academicons@1/css/academicons.min.css"> | ||
<link rel="stylesheet" href="./static/css/index.css"> | ||
<!-- <link rel="icon" href="./static/images/favicon.svg"> --> | ||
|
||
<script src="https://ajax.googleapis.com/ajax/libs/jquery/3.5.1/jquery.min.js"></script> | ||
<script defer src="./static/js/fontawesome.all.min.js"></script> | ||
<script src="./static/js/bulma-carousel.min.js"></script> | ||
<script src="./static/js/bulma-slider.min.js"></script> | ||
<script src="./static/js/index.js"></script> | ||
</head> | ||
<body> | ||
|
||
<nav class="navbar" role="navigation" aria-label="main navigation"> | ||
<div class="navbar-brand"> | ||
<a role="button" class="navbar-burger" aria-label="menu" aria-expanded="false"> | ||
<span aria-hidden="true"></span> | ||
<span aria-hidden="true"></span> | ||
<span aria-hidden="true"></span> | ||
</a> | ||
</div> | ||
<div class="navbar-menu"> | ||
<div class="navbar-start" style="flex-grow: 1; justify-content: center;"> | ||
<a class="navbar-item" href="https://jia-py.github.io"> | ||
<span class="icon"> | ||
<i class="fas fa-home"></i> | ||
</span> | ||
</a> | ||
|
||
</div> | ||
|
||
</div> | ||
</nav> | ||
|
||
|
||
<section class="hero"> | ||
<div class="hero-body"> | ||
<div class="container is-max-desktop"> | ||
<div class="columns is-centered"> | ||
<div class="column has-text-centered"> | ||
<h1 class="title is-1 publication-title">MILL: Mutual Verification with Large Language Models for Zero-Shot Query Expansion</h1> | ||
<div class="is-size-5 publication-authors"> | ||
<span class="author-block"> | ||
<a href="https://jia-py.github.io">Pengyue Jia</a><sup>1</sup>,</span> | ||
<span class="author-block"> | ||
<a href="https://liuyiding.net/">Yiding Liu</a><sup>2</sup>,</span> | ||
<span class="author-block"> | ||
<a href="https://zhaoxyai.github.io/">Xiangyu Zhao</a><sup>1</sup>, | ||
</span> | ||
<span class="author-block"> | ||
<a href="https://xiaopengli1.github.io/">Xiaopeng Li</a><sup>1</sup>, | ||
</span> | ||
<span class="author-block"> | ||
Changying Hao<sup>2</sup>, | ||
</span> | ||
<span class="author-block"> | ||
<a href="http://wangshuaiqiang.net/">Shuaiqiang Wang</a><sup>2</sup>, | ||
</span> | ||
<span class="author-block"> | ||
<a href="https://www.yindawei.com/">Dawei Yin</a><sup>2</sup> | ||
</span> | ||
</div> | ||
|
||
<div class="is-size-5 publication-authors"> | ||
<span class="author-block"><sup>1</sup>City University of Hong Kong,</span> | ||
<span class="author-block"><sup>2</sup>Baidu Inc.</span> | ||
</div> | ||
|
||
<div class="column has-text-centered"> | ||
<div class="publication-links"> | ||
<!-- PDF Link. --> | ||
<span class="link-block"> | ||
<a href="https://arxiv.org/pdf/2310.19056.pdf" | ||
class="external-link button is-normal is-rounded is-dark"> | ||
<span class="icon"> | ||
<i class="fas fa-file-pdf"></i> | ||
</span> | ||
<span>Paper</span> | ||
</a> | ||
</span> | ||
<span class="link-block"> | ||
<a href="https://arxiv.org/abs/2310.19056" | ||
class="external-link button is-normal is-rounded is-dark"> | ||
<span class="icon"> | ||
<i class="ai ai-arxiv"></i> | ||
</span> | ||
<span>arXiv</span> | ||
</a> | ||
</span> | ||
<!-- Video Link. --> | ||
<!-- <span class="link-block"> | ||
<a href="https://www.youtube.com/watch?v=MrKrnHhk8IA" | ||
class="external-link button is-normal is-rounded is-dark"> | ||
<span class="icon"> | ||
<i class="fab fa-youtube"></i> | ||
</span> | ||
<span>Video</span> | ||
</a> | ||
</span> --> | ||
<!-- Code Link. --> | ||
<span class="link-block"> | ||
<a href="" | ||
class="external-link button is-normal is-rounded is-dark"> | ||
<span class="icon"> | ||
<i class="fab fa-github"></i> | ||
</span> | ||
<span>Code - Coming soon</span> | ||
</a> | ||
</span> | ||
<!-- Dataset Link. --> | ||
<span class="link-block"> | ||
<a href="https://ir-datasets.com/index.html" | ||
class="external-link button is-normal is-rounded is-dark"> | ||
<span class="icon"> | ||
<i class="far fa-images"></i> | ||
</span> | ||
<span>Data</span> | ||
</a> | ||
</div> | ||
|
||
</div> | ||
</div> | ||
</div> | ||
</div> | ||
</div> | ||
</section> | ||
|
||
<!-- <section class="hero teaser"> | ||
<div class="container is-max-desktop"> | ||
<div class="hero-body"> | ||
<video id="teaser" autoplay muted loop playsinline height="100%"> | ||
<source src="./static/videos/teaser.mp4" | ||
type="video/mp4"> | ||
</video> | ||
<h2 class="subtitle has-text-centered"> | ||
<span class="dnerf">Nerfies</span> turns selfie videos from your phone into | ||
free-viewpoint | ||
portraits. | ||
</h2> | ||
</div> | ||
</div> | ||
</section> --> | ||
|
||
|
||
<!-- <section class="hero is-light is-small"> | ||
<div class="hero-body"> | ||
<div class="container"> | ||
<div id="results-carousel" class="carousel results-carousel"> | ||
<div class="item item-steve"> | ||
<video poster="" id="steve" autoplay controls muted loop playsinline height="100%"> | ||
<source src="./static/videos/steve.mp4" | ||
type="video/mp4"> | ||
</video> | ||
</div> | ||
<div class="item item-chair-tp"> | ||
<video poster="" id="chair-tp" autoplay controls muted loop playsinline height="100%"> | ||
<source src="./static/videos/chair-tp.mp4" | ||
type="video/mp4"> | ||
</video> | ||
</div> | ||
<div class="item item-shiba"> | ||
<video poster="" id="shiba" autoplay controls muted loop playsinline height="100%"> | ||
<source src="./static/videos/shiba.mp4" | ||
type="video/mp4"> | ||
</video> | ||
</div> | ||
<div class="item item-fullbody"> | ||
<video poster="" id="fullbody" autoplay controls muted loop playsinline height="100%"> | ||
<source src="./static/videos/fullbody.mp4" | ||
type="video/mp4"> | ||
</video> | ||
</div> | ||
<div class="item item-blueshirt"> | ||
<video poster="" id="blueshirt" autoplay controls muted loop playsinline height="100%"> | ||
<source src="./static/videos/blueshirt.mp4" | ||
type="video/mp4"> | ||
</video> | ||
</div> | ||
<div class="item item-mask"> | ||
<video poster="" id="mask" autoplay controls muted loop playsinline height="100%"> | ||
<source src="./static/videos/mask.mp4" | ||
type="video/mp4"> | ||
</video> | ||
</div> | ||
<div class="item item-coffee"> | ||
<video poster="" id="coffee" autoplay controls muted loop playsinline height="100%"> | ||
<source src="./static/videos/coffee.mp4" | ||
type="video/mp4"> | ||
</video> | ||
</div> | ||
<div class="item item-toby"> | ||
<video poster="" id="toby" autoplay controls muted loop playsinline height="100%"> | ||
<source src="./static/videos/toby2.mp4" | ||
type="video/mp4"> | ||
</video> | ||
</div> | ||
</div> | ||
</div> | ||
</div> | ||
</section> --> | ||
|
||
<!-- <section class="section"> | ||
<div class="container is-max-desktop"> | ||
<div class="columns is-centered has-text-centered"> | ||
<div class="column is-four-fifths"> | ||
<h2 class="title is-3">Abstract</h2> | ||
<div class="content has-text-justified"> | ||
<p> | ||
We present the first method capable of photorealistically reconstructing a non-rigidly | ||
deforming scene using photos/videos captured casually from mobile phones. | ||
</p> | ||
<p> | ||
Our approach augments neural radiance fields | ||
(NeRF) by optimizing an | ||
additional continuous volumetric deformation field that warps each observed point into a | ||
canonical 5D NeRF. | ||
We observe that these NeRF-like deformation fields are prone to local minima, and | ||
propose a coarse-to-fine optimization method for coordinate-based models that allows for | ||
more robust optimization. | ||
By adapting principles from geometry processing and physical simulation to NeRF-like | ||
models, we propose an elastic regularization of the deformation field that further | ||
improves robustness. | ||
</p> | ||
<p> | ||
We show that <span class="dnerf">Nerfies</span> can turn casually captured selfie | ||
photos/videos into deformable NeRF | ||
models that allow for photorealistic renderings of the subject from arbitrary | ||
viewpoints, which we dub <i>"nerfies"</i>. We evaluate our method by collecting data | ||
using a | ||
rig with two mobile phones that take time-synchronized photos, yielding train/validation | ||
images of the same pose at different viewpoints. We show that our method faithfully | ||
reconstructs non-rigidly deforming scenes and reproduces unseen views with high | ||
fidelity. | ||
</p> | ||
</div> | ||
</div> | ||
</div> | ||
<div class="columns is-centered has-text-centered"> | ||
<div class="column is-four-fifths"> | ||
<h2 class="title is-3">Video</h2> | ||
<div class="publication-video"> | ||
<iframe src="https://www.youtube.com/embed/MrKrnHhk8IA?rel=0&showinfo=0" | ||
frameborder="0" allow="autoplay; encrypted-media" allowfullscreen></iframe> | ||
</div> | ||
</div> | ||
</div> | ||
</div> | ||
</section> --> | ||
|
||
|
||
<section class="section" id="BibTeX"> | ||
<div class="container is-max-desktop content"> | ||
<h2 class="title">BibTeX</h2> | ||
<pre><code>@misc{jia2023mill, | ||
title={MILL: Mutual Verification with Large Language Models for Zero-Shot Query Expansion}, | ||
author={Pengyue Jia and Yiding Liu and Xiangyu Zhao and Xiaopeng Li and Changying Hao and Shuaiqiang Wang and Dawei Yin}, | ||
year={2023}, | ||
eprint={2310.19056}, | ||
archivePrefix={arXiv}, | ||
primaryClass={cs.IR} | ||
}</code></pre> | ||
</div> | ||
</section> | ||
|
||
|
||
<footer class="footer"> | ||
<div class="container"> | ||
<div class="content has-text-centered"> | ||
<a class="icon-link" | ||
href="./static/videos/nerfies_paper.pdf"> | ||
<i class="fas fa-file-pdf"></i> | ||
</a> | ||
<a class="icon-link" href="https://github.com/keunhong" class="external-link" disabled> | ||
<i class="fab fa-github"></i> | ||
</a> | ||
</div> | ||
<div class="columns is-centered"> | ||
<div class="column is-8"> | ||
<div class="content"> | ||
<p> | ||
This website is built based on <a href="https://github.com/nerfies/nerfies.github.io">Nerfies</a> | ||
</p> | ||
</div> | ||
</div> | ||
</div> | ||
</div> | ||
</footer> | ||
|
||
</body> | ||
</html> |
Binary file not shown.
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Oops, something went wrong.
Oops, something went wrong.