forked from StartBootstrap/startbootstrap-modern-business
-
Notifications
You must be signed in to change notification settings - Fork 0
/
services.html
221 lines (198 loc) · 9.69 KB
/
services.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
<!DOCTYPE html>
<html lang="en"><head>
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no">
<meta name="description" content="">
<meta name="author" content="">
<title>Modern Business - Start Bootstrap Template</title>
<!-- Bootstrap core CSS -->
<link href="services_files/bootstrap.css" rel="stylesheet">
<!-- Custom styles for this template -->
<link href="services_files/modern-business.css" rel="stylesheet">
</head>
<body data-gr-c-s-loaded="true">
<!-- Navigation -->
<nav class="navbar fixed-top navbar-expand-lg navbar-dark bg-dark fixed-top">
<div class="container">
<a class="navbar-brand" href="index.html">Sparse-MVS Leaderboard</a>
<button class="navbar-toggler navbar-toggler-right" type="button" data-toggle="collapse" data-target="#navbarResponsive" aria-controls="navbarResponsive" aria-expanded="false" aria-label="Toggle navigation">
<span class="navbar-toggler-icon"></span>
</button>
<div class="collapse navbar-collapse" id="navbarResponsive">
<ul class="navbar-nav ml-auto">
<li class="nav-item">
<a class="nav-link" href="index.html">Home</a>
</li>
<li class="nav-item">
<a class="nav-link" href="about.html">Description</a>
</li>
<li class="nav-item active">
<a class="nav-link" href="services.html">Submission</a>
</li>
<li class="nav-item">
<a class="nav-link" href="leaderboard.html">Leaderboard</a>
</li>
<li class="nav-item">
<a class="nav-link" href="contact.html">Contact</a>
</li>
</ul>
</div>
</div>
</nav>
<!-- Page Content -->
<div class="container">
<!-- <!-- Page Heading/Breadcrumbs -->
<h1 class="mt-4 mb-3">Submission
<!-- <small>Subheading</small> -->
</h1>
<ol class="breadcrumb">
<li class="breadcrumb-item">
<a href="index.html">Home</a>
</li>
<li class="breadcrumb-item active">Submission</li>
</ol>
<div class="row">
<div class="col-lg-12">
<p>
The following instructions shows how to make a reconstruction
in the sparse-mvs setting and submit a evaluation result.
</p>
<br>
<br>
<h2>1. Prepare the data</h2>
<hr>
<p>
Download the image set and evaluation code (Distance matrix) of DTU dataset from <a href="http://roboimagedata.compute.dtu.dk/?page_id=36">the download page</a>. Pick the testing set from all scan models following <a href="https://arxiv.org/abs/2005.12690">the paper SurfaceNet+</a>. Reconstruct all the models and save the results into ply files.
</p>
<br>
<br>
<h2>2. Evaluation </h2>
<hr>
<h3>2.1 Description </h3>
<p>
The precision and recall have two metrics: the distance
metric and the percentage metric. The distance metric is the original
DTU dataset matlab code (<a href="http://roboimagedata.compute.dtu.dk/?page_id=36">download</a>). The percentage metric is changed by the evaluation code provided by <a href="https://www.tanksandtemples.org/tutorial/">Tanks and Temples</a> (<a href="https://github.com/intel-isl/TanksAndTemples/tree/master/python_toolbox/evaluation">download</a>).
The overall score for the percentage metric is measured as the f-score,
and a similar measurement for the distance metric overall is given by
the average of the mean precision and mean recall.
</p>
<h3>2.2 Offline evaluation </h3>
<p>
Use the distance metric to count the mean precision(accuracy)
and recall(completeness) of each model and count total the mean value
of all model in the testing dataset. Use the percentage metric to count
the value only at 1mm and 2mm. Count the precision, recall and f-score
and count the mean value of all model in the testing dataset.
</p>
<h3>2.3 Qualitative evaluation </h3>
<div class="row">
<div class="col-lg-6 mb-3">
<p>
To better show the performance comparison and variation tendency between among methods under different sparsity, we also provide quantitative demonstration with the specific camera poses. The following figure shows the comparision of scan 23 among three different methods under four sparsity:1,3,5,7.
Here we only pick one view of one scan for comparison. We use Meshlab software for our visualization tool. You should show one specific view provided by us of three models in DTU dataset: scan 1, scan 23 and scan 114. The corresponding camera poses in meshlab of each scan are:
</p>
</div>
<div class="col-lg-6 mb-3">
<!-- <div class="card h-100 text-center"> -->
<img class="card-img-top" src="about_files/qualitative_example.png" alt="">
<div class="card-body">
<!-- <center><h4 class="card-title">DTU</h4></center> -->
<!-- <h6 class="card-subtitle mb-2 text-muted">Position</h6> -->
<p class="card-text"></p>
</div>
</div>
<!-- </div> -->
</div>
<b>scan 1 : </b>
<pre>
<!DOCTYPE ViewState>
<project>
<VCGCamera TranslationVector="-243.076 -83.7638 -411.173 1" LensDistortion="0 0" ViewportPx="1575 978" PixelSizeMm="0.0369161 0.0369161" CenterPx="787 489" FocalMm="31.2669" RotationMatrix="0.55268 -0.754127 0.354735 0 -0.438307 -0.625053 -0.645908 0 0.708825 0.201497 -0.675993 0 0 0 0 1 "/>
<ViewSettings NearPlane="1.03109" TrackScale="0.00816228" FarPlane="13.0311"/>
<Render Lighting="0" DoubleSideLighting="0" SelectedVert="0" ColorMode="3" SelectedFace="0" BackFaceCull="0" FancyLighting="0" DrawMode="2" TextureMode="0"/>
</project>
</pre>
<br>
<b>scan 23 : </b>
<pre>
<!DOCTYPE ViewState>
<project>
<VCGCamera TranslationVector="-282.768 -47.9743 -516.996 1" LensDistortion="0 0" ViewportPx="1575 978" PixelSizeMm="0.0369161 0.0369161" CenterPx="787 489" FocalMm="31.2669" RotationMatrix="0.354282 -0.851435 0.386708 0 -0.276822 -0.490484 -0.826314 0 0.893226 0.185699 -0.409466 0 0 0 0 1 "/>
<ViewSettings NearPlane="1.03109" TrackScale="0.00875987" FarPlane="13.0311"/>
<Render Lighting="0" DoubleSideLighting="0" SelectedVert="0" ColorMode="3" SelectedFace="0" BackFaceCull="0" FancyLighting="0" DrawMode="2" TextureMode="0"/>
</project>
</pre>
<br>
<b>scan 114 : </b>
<pre>
<!DOCTYPE ViewState>
<project>
<VCGCamera TranslationVector="-161.594 -152.165 -483.126 1" LensDistortion="0 0" ViewportPx="1575 978" PixelSizeMm="0.0369161 0.0369161" CenterPx="787 489" FocalMm="31.2669" RotationMatrix="0.791183 -0.530364 0.304538 0 -0.0815598 -0.585006 -0.806918 0 0.606117 0.613582 -0.506103 0 0 0 0 1 "/>
<ViewSettings NearPlane="1.03109" TrackScale="0.0090205" FarPlane="13.0311"/>
<Render Lighting="0" DoubleSideLighting="0" SelectedVert="0" ColorMode="3" SelectedFace="0" BackFaceCull="0" FancyLighting="0" DrawMode="2" TextureMode="0"/>
</project>
</pre>
<br>
<p>
Here you can just copy the above camera pose text and past it into the <a href="https://www.meshlab.net/">meshlab</a> software, then the viewing direction will automatically ture in to the desired angle. Then clip the "save snapshot" button to record the image.
</p>
<br>
<br>
<h2>3. Submission </h2>
<hr>
</div>
</div>
</div>
<!-- Image Header -->
<!-- <img class="img-fluid rounded mb-4" src="http://placehold.it/1200x300" alt=""> -->
<!-- Marketing Icons Section -->
<!-- <div class="row">
<div class="col-lg-4 mb-4">
<div class="card h-100">
<h4 class="card-header">Card Title</h4>
<div class="card-body">
<p class="card-text">Lorem ipsum dolor sit amet, consectetur adipisicing elit. Sapiente esse necessitatibus neque.</p>
</div>
<div class="card-footer">
<a href="#" class="btn btn-primary">Learn More</a>
</div>
</div>
</div>
<div class="col-lg-4 mb-4">
<div class="card h-100">
<h4 class="card-header">Card Title</h4>
<div class="card-body">
<p class="card-text">Lorem ipsum dolor sit amet, consectetur adipisicing elit. Reiciendis ipsam eos, nam perspiciatis natus commodi similique totam consectetur praesentium molestiae atque exercitationem ut consequuntur, sed eveniet, magni nostrum sint fuga.</p>
</div>
<div class="card-footer">
<a href="#" class="btn btn-primary">Learn More</a>
</div>
</div>
</div>
<div class="col-lg-4 mb-4">
<div class="card h-100">
<h4 class="card-header">Card Title</h4>
<div class="card-body">
<p class="card-text">Lorem ipsum dolor sit amet, consectetur adipisicing elit. Sapiente esse necessitatibus neque.</p>
</div>
<div class="card-footer">
<a href="#" class="btn btn-primary">Learn More</a>
</div>
</div>
</div>
</div> -->
<!-- /.row --> -->
<!-- /.container -->
<!-- Footer -->
<footer class="py-5 bg-dark">
<div class="container">
<p class="m-0 text-center text-white">Copyright © luvision.net</p>
</div>
<!-- /.container -->
</footer>
<!-- Bootstrap core JavaScript -->
<script src="services_files/jquery.js"></script>
<script src="services_files/bootstrap.js"></script>
</body></html>