Skip to content

Commit

Permalink
chore: Update data pipeline blips (#14)
Browse files Browse the repository at this point in the history
Co-authored-by: Gareth Bowen <[email protected]>
  • Loading branch information
andrablaj and garethbowen authored Sep 4, 2024
1 parent 7e7d416 commit 8232ea0
Show file tree
Hide file tree
Showing 9 changed files with 42 additions and 13 deletions.
6 changes: 2 additions & 4 deletions radar/2023-09-12/cht-couch2pg.md
Original file line number Diff line number Diff line change
@@ -1,10 +1,8 @@
---
title: "CHT Couch2pg"
title: "CHT couch2pg"
ring: stop
quadrant: methods-and-patterns
tags: [data-use]
---

[CHT Couch2pg](https://github.com/medic/cht-couch2pg) is software for creating read-only replicas of data from CHT applications, using PostgreSQL v9.4.

Read more about setting up CHT Couch2pg locally in the [CHT documentation](https://docs.communityhealthtoolkit.org/apps/tutorials/couch2pg-setup/).
[CHT couch2pg](https://github.com/medic/cht-couch2pg) is software for creating read-only replicas of data from CHT applications, using PostgreSQL v9.4.
4 changes: 1 addition & 3 deletions radar/2023-09-12/cht-pipeline.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,4 @@ quadrant: methods-and-patterns
tags: [data-use]
---

[CHT Pipeline](https://github.com/medic/cht-pipeline) is a tool used to define data models for transforming the raw data we get from CouchDB into models that can then be queried to build dashboards.

Read more about CHT Pipeline in the [CHT documentation](https://docs.communityhealthtoolkit.org/core/overview/data-flows-for-analytics/cht-sync/).
CHT Pipeline is a tool used to define data models for transforming the raw data we get from CouchDB into models that can then be queried to build dashboards.
5 changes: 1 addition & 4 deletions radar/2023-09-12/cht-sync.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,4 @@ quadrant: methods-and-patterns
tags: [data-use]
---

[CHT Sync](https://github.com/medic/cht-sync) is a bundled solution consisting of Logstash, CouchDB, PostgREST, DBT, and Superset. Its purpose is to synchronize data from CouchDB to PostgreSQL, facilitating analytics on a Superset dashboard.
This synchronization occurs in real-time, ensuring that the data displayed on the dashboard is always up-to-date.

Read more about CHT Sync in the [CHT documentation](https://docs.communityhealthtoolkit.org/core/overview/data-flows-for-analytics/cht-sync/).
CHT Sync is a bundled solution consisting of Logstash, CouchDB, PostgREST, dbt, and Superset. Its purpose is to synchronize data from CouchDB to PostgreSQL, facilitating analytics on a Superset dashboard.
2 changes: 1 addition & 1 deletion radar/2023-09-12/superset.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,4 +9,4 @@ tags: [data-use]

In the context of the CHT, Superset is used for health care analytics.

Read more about Data Flows for Analytics with the CHT in the [CHT documentation](https://docs.communityhealthtoolkit.org/core/overview/data-flows-for-analytics/).
Read more about using Superset with the data pipeline in the [CHT documentation](https://docs.communityhealthtoolkit.org/apps/guides/data/analytics/setup/#setup-superset).
2 changes: 1 addition & 1 deletion radar/2024-07-01/dot.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,4 +8,4 @@ tags: [data-use]
[Data Observation Toolkit (DOT)](https://github.com/datakind/Data-Observation-Toolkit) can be used to monitor data in order to flag problems with data integrity and scenarios that might need attention.
Typical tests include checks for missing/duplicate and inconsistent data, outliers, and domain-specific signals such as a missed follow-up medical treatment after initial diagnosis.

DOT includes a simple user interface for configuring the powerful DBT and Great Expectations libraries, as well as a database for storing and classifying data monitoring results.
DOT includes a simple user interface for configuring the powerful dbt and Great Expectations libraries, as well as a database for storing and classifying data monitoring results.
8 changes: 8 additions & 0 deletions radar/2024-09-04/cht-couch2pg.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
---
title: "CHT couch2pg"
ring: stop
quadrant: methods-and-patterns
tags: [data-use]
---

CHT couch2pg is deprecated. For data synchronization, refer to [CHT Sync documentation](https://docs.communityhealthtoolkit.org/core/overview/cht-sync/).
10 changes: 10 additions & 0 deletions radar/2024-09-04/cht-pipeline.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
---
title: "CHT Pipeline"
ring: adopt
quadrant: methods-and-patterns
tags: [data-use]
---

[CHT Pipeline](https://github.com/medic/cht-pipeline) is a tool used to define data models for transforming raw CouchDB data into dbt models that can then be queried to build dashboards.

Read more about CHT Pipeline in the [CHT documentation](https://docs.communityhealthtoolkit.org/core/overview/cht-sync/).
10 changes: 10 additions & 0 deletions radar/2024-09-04/cht-sync.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
---
title: "CHT Sync"
ring: adopt
quadrant: methods-and-patterns
tags: [data-use]
---

[CHT Sync](https://github.com/medic/cht-sync) is a integrated solution designed to enable data synchronization between CouchDB and PostgreSQL for the purpose of analytics. The synchronization occurs near real-time, ensuring that the data displayed on dashboards is up-to-date. It combines several technologies to achieve this synchronization and provides an efficient workflow for data processing and visualization.

Read more about CHT Sync in the [CHT documentation](https://docs.communityhealthtoolkit.org/core/overview/cht-sync/). Follow [the instructions](https://docs.communityhealthtoolkit.org/apps/guides/data/analytics/) to setup CHT Sync in your environment of choice.
8 changes: 8 additions & 0 deletions radar/2024-09-04/couch2pg.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
---
title: "couch2pg"
ring: stop
quadrant: methods-and-patterns
tags: [data-use]
---

couch2pg is deprecated. For data synchronization, refer to [CHT Sync documentation](https://docs.communityhealthtoolkit.org/core/overview/cht-sync/).

0 comments on commit 8232ea0

Please sign in to comment.