-
Notifications
You must be signed in to change notification settings - Fork 1
/
dataProds.html
229 lines (185 loc) · 13.8 KB
/
dataProds.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
<!DOCTYPE HTML>
<!--
Theory by TEMPLATED
templated.co @templatedco
Released for free under the Creative Commons Attribution 3.0 license (templated.co/license)
-->
<html>
<head>
<title>Data Products</title>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1" />
<link rel="stylesheet" href="assets/css/main.css" />
</head>
<body class="subpage">
<!-- Header -->
<header id="header">
<div class="inner">
<!--<a href="index.html" class="logo">Theory</a>-->
<nav id="nav">
<a href="index.html">Home</a>
<a href="about.html">About</a>
<a href="news.html">News</a>
<a href="codeofconduct.html">Code of Conduct</a>
<a href="charter.html"> Charter </a>
<a href="publication_policy.html"> Publication Policy </a>
<a href="workinggroups.html">Working Groups</a>
<a href="sciCases.html">Science Cases</a>
<a href="dataProds.html">Data Products</a>
<a href="impDocs.html">Docs</a>
<a href="gettingStarted.html">Getting Started</a>
<a href="membership.html">Membership</a>
<a href="software.html">Software</a>
<a href="https://lsstsssc.wordpress.com/">Blog</a>
</nav>
<a href="#navPanel" class="navPanelToggle"><span class="fa fa-bars"></span></a>
</div>
</header>
<!-- Three -->
<section id="three" class="wrapper">
<div class="inner">
<header class="align-center">
<h2>Data Products</h2>
<p>Below you will find information of the pixel data products that will be produced by the LSST software stack.
As well, you will find information on the potential added value user-generared products the SSSC is planning as well as the data products to be provided by the LSST project calculated via the LSST stack.</p>
</header>
<p> <h2> How Rubin Observatory Approaches LSST Solar System Processing Data Products</h3>
<p> The goal is to provide products to the community that enable science in four guiding science themes; making a census of the Solar System is one of the four. LSST project therefore design products that are:
<ol>
<li> Broadly useful for delivering unique LSST-enabled science
<li> Capture aspects that the LSST team is uniquely position to deliver
</ol>
<p> <H2> Key LSST Project Deliverables for Solar System Science </H2>
<ul>
<li> <b> Within 60 seconds of each observation: </b> A real-time stream of observation reports (alerts) with information about astrometry, photometry, and shape including trailing, direction of motion. </li>
<li> <b>Every day: </b> A stream of linked tracks reported to the <a href="https://www.minorplanetcenter.net/">Minor Planet Center (MPC)</a>. </li>
<li> <b> Every day:</b> A catalog of orbits for LSST-discovered objects. </li>
<li> <b> Annually: </b>Precisely calibrated photometric catalog (ugrizy bands) accurate to 5 mmag (systematics limited), with every data release. </li>
</p>
<p>**The observatory code assigned by the MPC for the Simonyi Survey Telescope at Rubin Observatory (the main 8.4m telescope). The code is X05 and is further details are available in the MPC's <a href="https://minorplanetcenter.net/iau/lists/ObsCodesF.html"> observatory codes list </a>.** </p>
<p> A short overview of Rubin LSST Solar System data products can be found <a href="https://docushare.lsst.org/docushare/dsweb/Get/Document-29545" target="_blank"> here </a>. <a href="https://docushare.lsstcorp.org/docushare/dsweb/Get/LSE-163/">The Data Products Definition Document (DPDD) </a> defines what the nightly and yearly catalogs will contain. You can find a handy outline of the proposed database schema for the LSST SSObject table <a href="https://docushare.lsstcorp.org/docushare/dsweb/Get/LSE-163/">here</a> . More information on the Rubin Observatory's Solar System Data Processing can be found <a href="http://lsst-sssc.github.io/software.html"> here </a>.
<div class="align-center">
<img class="contain" src="Files/obtaining_LSST_Solar_System_Data_Products.png" alt="Obtaining LSST Solar System Data Products figure" style="width:818px;height:444px"">
<p>Image Credit: Rubin Observatory Data Management/Mario Jurić </p>
</div>
<div class="align-center">
<img class="contain" src="images/real_time_alerts.png" alt="Real time alerts Solar System data" style="width:981px;height:532px">
<p>Image Credit: Rubin Observatory Data Management/Mario Jurić </p>
</div>
<div class="align-center">
<img class="contain" src="images/prompt_products_daily_catalog.png" alt="Daily Solar System Catalog Structure" style="width:981px;height:532px">
<p>Image Credit: Rubin Observatory Data Management/Mario Jurić </p>
</div>
<div class="align-center">
<img class="contain" src="images/data_release_products.png" alt="Data Release Solar System Products" style="width:981px;height:532px">
<p>Image Credit: Rubin Observatory Data Management/Mario Jurić </p>
</div>
<h2>LSST Project Data Product Levels</h2>
The LSST stack will produce data products at three levels, which are broadly defined below. <br> <br>
<p><strong>Prompt</strong> data products produced on nightly or shorter timescales which will consist of basic images, source catalogs, transient identifications, moving object identifications, and event alerts.</p>
<p><strong>Data Release </strong> annual data release products including refinements to calibrations and photometry, calibration images, image co-adds and catalogs. </p>
<p><strong>User Generated/Added Value</strong> are user-generated added value products.</p>
<p> Exactly what parameters will be automatically provided within Prompt and Data Release products are still being discussed. You can learn more about the current status on planned Solar System Data Products from LSST in this <a href="https://www.youtube.com/watch?v=nSUTitsqdJ0">recorded presentation </a> by Mario Jurić.
More information on all LSST data products can be found <a href="https://www.lsst.org/about/dm/data-products">here.</a></p>
<p> Annual release will have all LSST observations run through one version of the LSST data pipelines. The version of software run on the nightly observations can change, and old observations won't be rerun through the updated pipelines until the annual release.
<div class="align-center">
<img class="contain" src="images/data_products.png" alt="yield" style="width:818px;height:444px">
<p>Image Credit: Rubin Observatory Data Management </p>
</div>
<p> Additional information on LSST data processing pipelines and data products can be found on the <a href="https://www.lsst.org/scientists/">LSST Information for Scientists page</a>.
<H2> The LSST Alert Stream </H2>
<p> After an LSST image is taken, the image subtraction pipeline will identify transient sources
(stuff that moves or varies in brightness). These Difference Image Analysis Sources (DIASources) will be
sent out in the public LSST Alert Stream within 60s of the observation's end.
<div class="align-center">
<img class="contain" src="images/alert_streams.png" alt="yield" style="width:818px;height:444px">
<p>Image Credit: LSST Data Management/Leanne Guy </p>
</div>
<div class="align-center">
<img class="contain" src="images/LSST_Alert_Packets.png" alt="yield" style="width:818px;height:444px">
<p>Image Credit: LSST Data Management/Leanne Guy </p>
</div>
<div class="align-center">
<img class="contain" src="images/community_brokers.png" alt="yield" style="width:818px;height:444px">
<p>Image Credit: LSST Data Management/Leanne Guy </p>
</div>
<p> More about the alert stream can be found in this <a href="https://gallery.lsst.org/bp/#/folder/3308857/71032625"> talk</a> by Eric Bellm, <a href="../Files/2018-07-10-SSSC-LSSTAlerts-LeanneGuy.pdf"> this talk </a> by Leanne Guy at the 2018 LSST Solar System Readiness Sprint, and the <a href="https://docushare.lsst.org/docushare/dsweb/Get/LDM-151"> LSST Data Management Science Pipelines
Design Document </a>.
<p> An overview of Plans and Policies for LSST Alert Distribution can be found <a href="https://docushare.lsst.org/docushare/dsweb/Get/LDM-612" target="_blank"> here </a>.
<h2> Rubin Data Products Abridged September 2022 </h2>
<p> Slides from this presentation can be cited and found <a href="https://www.lsst.org/about/dm/data-products"> here </a>.
<h2> DP0.3 Simulated Rubin Solar System Data Products </h2>
<p> On the Rubin Science Platform (RSP), LSST data rights holders can test software and database queries with DP0.3, simulated Rubin Solar System Data Products. The RSP has both a jupyter notebook environment, a data portal environment, and API programmatic access.
DP0.3 was generated by members of the Rubin Solar System Pipelines and Commissioning teams, with help from the SSSC. Further details on DP 0.3 including tutorials and getting access to the RSP, can be found <a href="https://dp0-3.lsst.io/">here</a>. </p>
<h2> Early Science and Year One Data Products </h2>
<p> "Early Science is defined as any science enabled by Rubin for its community through and including the first data release, Data Release 1 (DR1)." - Leanne Guy Rubin Observatory Data Management Scientist and Interim AD for System Performance. </p>
<p> Rubin Observatory has released the <a href="https://rtn-011.lsst.io/">Rubin Observatory Plans for an Early Science Program </a> document. This is a living doocumentation outlining the plan for commissioning observations, draft plans for Year 1 science operations, and plans for alert production in the first year of LSST.
A summary presentation of the contents of this document was presented in October 2022 and available online <a href="https://community.lsst.org/uploads/short-url/Ah3WdEGm0Yw9rPUqWBeJp2tS0K0.pdf">here</a>. </p>
<p> Do consider submitting your prediction papers and papers describing your software tools to < a href="http://lsst-sssc.github.io/focusissues.html">our AAS Journals Focus Issues</a>.
<h2> Proposed Rubin-Euclid Joint Data Products </h2>
There is on-going discussion about some joint Rubin-Euclid data products, including Solar System data products, that would be available to both surveys' data rights holder. A document with initial recommendations from the joint Rubin-Euclid working group is available <a href="https://arxiv.org/abs/2201.03862">here</a>.
<iframe width="560" height="315" src="https://www.youtube.com/embed/vWXb63RVgz8" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>
<br>
<br>
<h2> Expected Advanced LSST/User Generated Data Products Useful for Solar System Science </h2>
<ul>
<li>Where in the sky LSST is expected the next night will be accessible via an API/software routine. One can estimate for new Solar System discoveries whether LSST will be able to do self follow-up. </li>
<li> SSSC members are working on a dedicated code to identify nightly tracklets from streaks and submit those to the MPC. </li>
</ul>
<h2>Proposed SSSC Generated Solar System-Specific Data Products</h2>
<p> More information of proposed SSSC user-generated data products and software can be found in our <a href='https://iopscience.iop.org/article/10.3847/2515-5172/ab0e10'>software roadmap </a>,
published in the Research Notes of the American Astronomical Society.</p>
<!--
<div class="flex flex-2">
<article>
<div class="image fit">
<img src="images/pic01.jpg" alt="Pic 01" />
</div>
<header>
<h3>Praesent placerat magna</h3>
</header>
<p>Praesent dapibus, neque id cursus faucibus, tortor neque egestas augue, eu vulputate magna eros eu erat. Aliquam erat volutpat. Nam dui mi, tincidunt quis, accumsan porttitor lorem ipsum.</p>
<footer>
<a href="#" class="button special">More</a>
</footer>
</article>
<article>
<div class="image fit">
<img src="images/pic02.jpg" alt="Pic 02" />
</div>
<header>
<h3>Fusce pellentesque tempus</h3>
</header>
<p>Sed adipiscing ornare risus. Morbi est est, blandit sit amet, sagittis vel, euismod vel, velit. Pellentesque egestas sem. Suspendisse commodo ullamcorper magna non comodo sodales tempus.</p>
<footer>
<a href="#" class="button special">More</a>
</footer>
</article>
</div> -->
</div>
</section>
<!-- Footer -->
<footer id="footer">
<div class="inner">
<div class="flex">
<div class="copyright">
LSST-SSSC Information Portal. Design: <a href="https://templated.co/theory">Using the Theory template by Templated.</a>
</div>
<!-- <ul class="icons">
<li><a href="#" class="icon fa-facebook"><span class="label">Facebook</span></a></li>
<li><a href="#" class="icon fa-twitter"><span class="label">Twitter</span></a></li>
<li><a href="#" class="icon fa-linkedin"><span class="label">linkedIn</span></a></li>
<li><a href="#" class="icon fa-pinterest-p"><span class="label">Pinterest</span></a></li>
<li><a href="#" class="icon fa-vimeo"><span class="label">Vimeo</span></a></li>
</ul>
-->
</div>
</div>
</footer>
<!-- Scripts -->
<script src="assets/js/jquery.min.js"></script>
<script src="assets/js/skel.min.js"></script>
<script src="assets/js/util.js"></script>
<script src="assets/js/main.js"></script>
</body>
</html>