Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add outline of doc pages to consdb/doc/ #42

Merged
merged 1 commit into from
Oct 7, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion doc/conf.py
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
"""Sphinx configuration file for an LSST stack package.

This configuration only affects single-package Sphinx documenation builds.
This configuration only affects single-package Sphinx documentation builds.
"""

from documenteer.conf.guide import * # noqa: F403,F401
6 changes: 6 additions & 0 deletions doc/contributor-guide/adding-columns.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
###############
Adding Columns
###############

* Values should be usefully summarized
* Try to make everything into some kind of scalar
8 changes: 8 additions & 0 deletions doc/contributor-guide/adding-tables.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
##############
Adding Tables
##############

* Each source of data should have its own table(s)
* Each dimension combination (exposure, visit, exposure+detector, visit+detector, etc.) should have its own table(s)
* Normalize when possible
* De-normalize via views to make querying easier
10 changes: 10 additions & 0 deletions doc/contributor-guide/index.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
##################
Contributor Guide
##################

.. toctree::
:maxdepth: 1

adding-tables
adding-columns
inserting-information
10 changes: 10 additions & 0 deletions doc/contributor-guide/inserting-information.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
#####################
Inserting Information
#####################

* Sasquatch
* REST API
* Direct Kafka messages

* ConsDB client library in summit_utils
* ConsDB REST API
6 changes: 6 additions & 0 deletions doc/developer-guide/building-artifacts.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
##################
Building Artifacts
##################

* Dockerfiles
* GitHub Actions workflows
5 changes: 5 additions & 0 deletions doc/developer-guide/consdbclient-summit-utils.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
############################
ConsDbClient in summit_utils
############################

How to write and test code in summit_utils for ConsDbClient
6 changes: 6 additions & 0 deletions doc/developer-guide/documentation.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
#############
Documentation
#############

* This Site
* Other Documentation
12 changes: 12 additions & 0 deletions doc/developer-guide/index.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
#################
Developer Guide
#################

.. toctree::
:maxdepth: 1

repository-structure
building-artifacts
consdbclient-summit-utils
standards-practices
documentation
5 changes: 5 additions & 0 deletions doc/developer-guide/repository-structure.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
####################
Repository Structure
####################

Each of the services in their own directory (coming soon)
5 changes: 5 additions & 0 deletions doc/developer-guide/standards-practices.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
#######################
Standards and Practices
#######################

Standards and practices
3 changes: 3 additions & 0 deletions doc/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -14,3 +14,6 @@ Documentation
:maxdepth: 1

user-guide/index
contributor-guide/index
developer-guide/index
operator-guide/index
6 changes: 6 additions & 0 deletions doc/operator-guide/deployment.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
###########
Deployment
###########

* Database
* REST API Server
11 changes: 11 additions & 0 deletions doc/operator-guide/index.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
##############
Operator Guide
##############

.. toctree::
:maxdepth: 1

runbook
schema-migration-process
deployment
monitoring
6 changes: 6 additions & 0 deletions doc/operator-guide/monitoring.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
###########
Monitoring
###########

* Database
* REST API Server
5 changes: 5 additions & 0 deletions doc/operator-guide/runbook.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
########
RunBook
########

Maybe from ConsDb Usage Confluence page?
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually, most of this should be from (or link to) https://rubinobs.atlassian.net/wiki/spaces/LSSTOps/pages/45665320/Consolidated+Database+ConsDB+Runbook+draft+incomplete (which doesn't have much in it right now either).

9 changes: 9 additions & 0 deletions doc/operator-guide/schema-migration-process.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
########################
Schema Migration Process
########################

* Add columns to sdm_schemas
* Create alembic migration
* Test migration and code to populate the new columns/tables at TTS/BTS if Summit schema is changing
* Deploy migration in synchrony at Summit (if necessary), USDF, and Prompt Release (if necessary)
* Deploy code to populate at Summit and/or USDF
5 changes: 5 additions & 0 deletions doc/user-guide/consdb-client-library-in-summit-utils.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
######################################
ConsDB Client Library in summit_utils
######################################

Querying using ConsDbClient
5 changes: 5 additions & 0 deletions doc/user-guide/consdb-rest-api.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
################
ConsDB REST API
################

Link to Swagger
5 changes: 5 additions & 0 deletions doc/user-guide/description-and-goals.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
######################
Description and Goals
######################

https://dmtn-227.lsst.io/
6 changes: 6 additions & 0 deletions doc/user-guide/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -6,3 +6,9 @@ User Guide
:maxdepth: 1

installation
description-and-goals
schemas
tap-clients
consdb-client-library-in-summit-utils
consdb-rest-api
sql-clients
13 changes: 13 additions & 0 deletions doc/user-guide/schemas.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
########
Schemas
########

* Types of schemas
* Summit for observers and Summit systems
* Smallest, contains primary key information from HeaderService and additional information from other Summit systems, including experimental and engineering data
* USDF for staff and analytical uses
* Largest, contains a full replica of the Summit plus additional information from USDF systems including Prompt Processing and Data Release Production, possibly Calibration Products Production, and human annotations from processing campaigns
* Release for science users
* Near-real-time "prompt" ConsDB replicates a subset of the USDF version
* Data Release ConsDB is a snapshot of a subset of the USDF version with data pertaining to the exposures/visits in the DR
* Schema browser
8 changes: 8 additions & 0 deletions doc/user-guide/sql-clients.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
##############################
SQL Clients (not recommended)
##############################

* Connection information
* Summit
* USDF
* Release
8 changes: 8 additions & 0 deletions doc/user-guide/tap-clients.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
############
TAP Clients
############

* Connection information
* Summit
* USDF
* Release
Loading