Skip to content

Commit

Permalink
add InterAct research website
Browse files Browse the repository at this point in the history
  • Loading branch information
@leohku
leohku committed May 25, 2024
1 parent 2bd3edb commit 06611ea
Show file tree
Hide file tree
Showing 15 changed files with 3,326 additions and 0 deletions.
202 changes: 202 additions & 0 deletions static/interact/index.html
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,202 @@
<html>
<head>
<meta charset="utf-8">
<meta name="description"
content="InterAct: Capture and Modelling of Realistic, Expressive and Interactive Activities between Two Persons in Daily Scenarios">
<meta name="keywords" content="Diffusion Models, Motion Dataset, Motion Capture, Motion Generation, Digital Humans, Interactive Motion, Facial Expressions, Yinghao Huang, Leo Ho, Dafei Qin, Mingyi Shi, Taku Komura, Diffusion Probabilistic Models">
<meta name="viewport" content="width=device-width, initial-scale=1">
<title>InterAct: Capture and Modelling of Realistic, Expressive and Interactive Activities between Two Persons in Daily Scenarios</title>

<link href="https://fonts.googleapis.com/css?family=Google+Sans|Noto+Sans|Castoro"
rel="stylesheet">

<link rel="stylesheet" href="./static/css/bulma.min.css">
<link rel="stylesheet" href="./static/css/bulma-carousel.min.css">
<link rel="stylesheet" href="./static/css/bulma-slider.min.css">
<link rel="stylesheet" href="./static/css/fontawesome.all.min.css">
<link rel="stylesheet"
href="https://cdn.jsdelivr.net/gh/jpswalsh/academicons@1/css/academicons.min.css">
<link rel="stylesheet" href="./static/css/index.css">
<link rel="icon" href="./static/images/favicon.svg">


<script defer src="./static/js/fontawesome.all.min.js"></script>
<script src="./static/js/bulma-carousel.min.js"></script>
<script src="./static/js/bulma-slider.min.js"></script>

</head>
<body>

<section class="hero">
<div class="hero-body">
<div class="container is-max-desktop">
<div class="columns is-centered">
<div class="column has-text-centered">
<h1 class="title is-1 publication-title">InterAct: Capture and Modelling of Realistic, Expressive and Interactive Activities between Two Persons in Daily Scenarios</h1>
<p style="padding-bottom: 10px;">
<!-- <span class="is-size-5" style="font-weight: bold;">arXiv</span> -->
<p>
<div class="is-size-5 publication-authors">
<span class="author-block">
<a href="https://github.com/YinghaoHuang91">Yinghao Huang</a><sup>*</sup><sup>1</sup><sup>,</sup><sup>2</sup>,</span>
<span class="author-block">
<a href="https://haskel.io/">Leo Ho</a><sup>*</sup><sup>1</sup>,</span>
<span class="author-block">
<a href="https://dafei-qin.github.io/">Dafei Qin</a><sup>1</sup>,
</span>
<span class="author-block">
<a href="https://rubbly.cn/">Mingyi Shi</a><sup>1</sup>,
</span>
<span class="author-block">
<a href="https://i.cs.hku.hk/~taku/">Taku Komura</a><sup>1</sup>,
</span>
</div>

<div class="is-size-5 publication-authors">
<span style="font-size: 18px;" class="footnote"><sup>*</sup>Equal contribution</span>
<div class="is-size-6 publication-authors">
<span class="author-block"><sup>1 </sup>The University of Hong Kong,</span>
<span class="author-block"><sup>2 </sup>Centre for Transformative Garment Production</span>
</div>
</div>

<div class="column has-text-centered">
<div class="publication-links">
<span class="link-block">
<a href="https://arxiv.org/abs/2405.11690"
class="external-link button is-normal is-rounded is-dark">
<span class="icon">
<i class="ai ai-arxiv"></i>
</span>
<span>ArXiv</span>
</a>
</span>
<!-- PDF Link. -->
<!-- Code Link. -->
<span class="link-block">
<a href="#"
class="external-link button is-normal is-rounded is-dark" >
<span class="icon">
<i class="fa fa-database"></i>
</span>
<span>Dataset</span>
</a>
</span>
<span class="link-block">
<a href="#"
class="external-link button is-normal is-rounded is-dark">
<span class="icon">
<i class="fab fa-github"></i>
</span>
<span>Code (coming soon)</span>
</a>
</span>
</div>

</div>
</div>
</div>
</div>
</div>
</section>


<section class="section" style="background-color: #f5f5f5;">
<div class="container is-max-desktop">
<!-- Abstract. -->

<div class="columns is-centered has-text-centered">
<div class="column is-four-fifths">
<h2 class="title is-3">Abstract</h2>
<div class="content has-text-justified">
<p>
We address the problem of accurate capture and expressive modelling of interactive behaviors happening between two persons in daily scenarios. Different from previous works which either only consider one person or focus on conversational gestures, we propose to simultaneously model the activities of two persons, and target objective-driven, dynamic, and coherent interactions which often span long duration and cover big space. To this end, we capture a new dataset dubbed InterAct, which is composed of 241 motion sequences where two persons perform a realistic, dynamic, and coherent scenario over each whole sequence. The audios, body motions, and facial expressions of both persons are all captured in our dataset. We also demonstrate the first diffusion model based approach that directly estimates the interactive motions between two persons from their audios alone. All the data and code will be available for research purposes upon acceptance of the paper.
</p>
</div>
</div>
</div>
</div>
<!--/ Abstract. -->
</section>

<section class="section">
<div class="container is-max-desktop">
<div class="columns is-centered has-text-centered">
<div class="column is-four-fifths">
<h2 class="title is-3">Dataset</h2>
<div class="content has-text-justified">
<p>
To be written
</p>
</div>
</div>
</div>
</div>
</section>

<section class="section" style="background-color: #f5f5f5;">
<div class="container is-max-desktop">
<div class="columns is-centered has-text-centered">
<div class="column is-four-fifths">
<h2 class="title is-3">Method</h2>
<div class="content has-text-justified">
<p>
To be written
</p>
</div>
</div>
</div>
</div>
</section>

<section class="section">
<div class="container is-max-desktop">
<div class="columns is-centered has-text-centered">
<div class="column is-four-fifths">
<h2 class="title is-3">Results</h2>
<div class="content has-text-justified">
<p>
To be written
</p>
</div>
</div>
</div>
</div>
</section>

<section class="section" id="BibTeX" >
<div class="container is-max-desktop content">
<h2 class="title">BibTeX</h2>
<pre>
<code>
@article{huang2024interact,
title={InterAct: Capture and Modelling of Realistic, Expressive and Interactive Activities between Two Persons in Daily Scenarios},
author={Yinghao Huang and Leo Ho and Dafei Qin and Mingyi Shi and Taku Komura},
year={2024},
eprint={2405.11690},
archivePrefix={arXiv},
primaryClass={cs.CV}
}
</code></pre>
</div>
</section>


<footer class="footer">
<div class="container">
<div class="columns is-centered">
<!-- <div class="column is-8"> -->
<div class="content">
<p>
This website is constructed using the source code provided by <a href="https://github.com/nerfies/nerfies.github.io">Nerfies</a>,
allow us to express our appreciation for their contribution.
</p>

</div>
</div>
</div>
</div>
</footer>

</body>
</html>
1 change: 1 addition & 0 deletions static/interact/static/css/bulma-carousel.min.css
View file

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading

0 comments on commit 06611ea

Please sign in to comment.