-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathstories.html
151 lines (119 loc) · 6.8 KB
/
stories.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
<!doctype html>
<html lang="en">
<head>
<!-- Required meta tags -->
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no">
<!-- Bootstrap CSS -->
<link href="resources/bootstrap.min.css" rel="stylesheet">
<link href="resources/stylesheet.css" rel="stylesheet">
<title>Snap Video</title>
<link rel="icon" type="image/x-icon" href="resources/cvr_logo_notext.png">
</head>
<body>
<section class="jumbotron text-center pb-2">
<div class="container">
<h1 class="jumbotron-heading">Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesis</h1>
<h4 class="font-italic pt-2" style="font-weight: normal">
<a href="https://www.willimenapace.com/">Willi Menapace</a><sup>1,2,*</sup>
<a href="https://github.com/AliaksandrSiarohin">Aliaksandr Siarohin</a><sup>1</sup>
<a href="https://universome.github.io/">Ivan Skorokhodov</a><sup>1</sup>
<a href="https://edeyneka.github.io/">Ekaterina Deyneka</a><sup>1</sup>
<a href="https://tsaishien-chen.github.io/">Tsai-Shien Chen</a><sup>1,3,*</sup></br>
<a href="https://anilkagak2.github.io/">Anil Kag</a><sup>1</sup>
<a href="https://yuwfan.github.io/">Yuwei Fang</a><sup>1</sup>
<a href="https://scholar.google.com/citations?user=PVZ0-dEAAAAJ&hl=en">Aleksei Stoliar</a><sup>1</sup>
<a href="http://elisaricci.eu/">Elisa Ricci</a><sup>2,4</sup>
<a href="https://alanspike.github.io/">Jian Ren</a><sup>1</sup>
<a href="http://www.stulyakov.com/">Sergey Tulyakov</a><sup>1</sup>
</h4>
<p class="pb-4 mt-3">
Snap Inc.<sup>1</sup> University of Trento<sup>2</sup> UC Merced<sup>3</sup> Fondazione Bruno Kessler<sup>4</sup>
Work performed while interning at Snap Inc.<sup>*</sup><br>
</p>
</div>
</section>
<div class="container-md">
<div class="row pt-1 justify-content-center">
<a class="sm-1 mx-1 btn btn-primary mt-2" href="http://arxiv.org/abs/2402.14797" role="button">Paper</a>
<a class="sm-1 mx-1 btn btn-primary mt-2" href="index.html" role="button">Overview</a>
<a class="sm-1 mx-1 btn btn-primary mt-2" href="stories.html" role="button">Stories</a>
<div class="btn-group">
<a class="sm-1 mx-1 btn btn-primary mt-2 dropdown-toggle" href="#" role="button" id="dropdownMenuLink1" data-toggle="dropdown" aria-haspopup="true" aria-expanded="false">Our Samples</a>
<div class="dropdown-menu" aria-labelledby="dropdownMenuLink1">
<a class="dropdown-item" href="our_samples.html" role="button">More Samples</a>
<a class="dropdown-item" href="our_samples_3d.html" role="button">Novel Views</a>
<a class="dropdown-item" href="our_samples_diversity.html" role="button">Samples Diversity</a>
<a class="dropdown-item" href="our_samples_hierarchical.html" role="button">Hierarchical Generation</a>
</div>
</div>
<div class="btn-group">
<a class="sm-1 mx-1 btn btn-primary mt-2 dropdown-toggle" href="#" role="button" id="dropdownMenuLink2" data-toggle="dropdown" aria-haspopup="true" aria-expanded="false">Comparisons</a>
<div class="dropdown-menu" aria-labelledby="dropdownMenuLink2">
<a class="dropdown-item" href="gen2_pikalab_floor33.html" role="button">Gen2-PikaLab-Floor33</a>
<a class="dropdown-item" href="imagen_video.html" role="button">Imagen Video</a>
<a class="dropdown-item" href="pyoco.html" role="button">PYoCo</a>
<a class="dropdown-item" href="video_ldm.html" role="button">Video LDM</a>
<a class="dropdown-item" href="make_a_video.html" role="button">Make-A-Video</a>
</div>
</div>
</div>
</div>
<div class="container">
<hr class="mt-5">
<h2 class="pt-4">Our Stories</h2>
<p class="lead text-justify">Snap Video can assist designers in the generation of long stories. We make use of an LLM to generate a story plot, video prompts for different scenes, and scripts for audio narrations. We generate all video assets using our model while tuning the video prompts to obtain the desired visuals, and synthesize the audio narration.</p>
<p class="lead text-justify">Postproduction software is used to assemble the final video. The generated video assets are trimmed and composed into a sequence to form the video track, to which text overlays are added. Background music is inserted and the synthesized audio narration is aligned to the video content to generate the final result.</p>
<!-- Grid row -->
<div class="row mt-5 pt-5 nopadding">
<!-- Grid column -->
<div class="col-sm-6 col-md-6 col-xl-6 col-lg-6 p-0 text-center containeroverlay">
<h3 class="pt-4">Invasion <img src="resources/speaker_icon.png"></h3>
<video class="video-fluid w-100 flex" controls>
<source src="video_samples/stories/Invasion_1.mp4" type="video/mp4" />
</video>
</div>
<!-- Grid column -->
<!-- Grid column -->
<div class="col-sm-6 col-md-6 col-xl-6 col-lg-6 p-0 text-center containeroverlay">
<h3 class="pt-4">Detective Whiskers <img src="resources/speaker_icon.png"></h3>
<video class="video-fluid w-100 flex" controls>
<source src="video_samples/stories/Whiskers.mp4" type="video/mp4" />
</video>
</div>
<!-- Grid column -->
<!-- Grid column -->
<div class="col-sm-6 col-md-6 col-xl-6 col-lg-6 p-0 text-center containeroverlay">
<h3 class="pt-4">Medieval Rom-com <img src="resources/speaker_icon.png"></h3>
<video class="video-fluid w-100 flex" controls>
<source src="video_samples/stories/Medieval_romcom.mp4" type="video/mp4" />
</video>
</div>
<!-- Grid column -->
<!-- Grid column -->
<div class="col-sm-6 col-md-6 col-xl-6 col-lg-6 p-0 text-center containeroverlay">
<h3 class="pt-4">Breakfast Burrito <img src="resources/speaker_icon.png"></h3>
<video class="video-fluid w-100 flex" controls>
<source src="video_samples/stories/breakfast_burrito.mp4" type="video/mp4" />
</video>
</div>
<!-- Grid column -->
</div>
<!-- Grid row -->
</div>
<div class="container-md mt-4">
<div class="row pt-1 justify-content-center">
<a class="sm-1 mx-1 btn btn-primary mt-2" href="index.html" role="button">Back</a>
<a class="sm-1 mx-1 btn btn-primary mt-2" href="our_samples.html" role="button">Next</a>
</div>
</div>
<!-- Footer -->
<section class="jumbotron text-center py-7 mt-5 mb-0">
</section>
<!-- Optional JavaScript -->
<!-- jQuery first, then Popper.js, then Bootstrap JS -->
<script src="resources/jquery-3.4.1.slim.min.js"></script>
<script src="resources/popper.min.js"></script>
<script src="resources/bootstrap.min.js"></script>
</body>
</html>