Releases: AfricasVoices/Pipeline-Infrastructure
Releases · AfricasVoices/Pipeline-Infrastructure
0.1.7
Engagement database:
- Fixes
get_messages
returning duplicates in batch mode if it ran while messages were being updated (#90).
- Adds
delete_message_and_history()
(#86, #91).
- Adds an optional batch-fetch parameter to
get_history()
, which improves the reliability of large fetches and on slow internet connections (#89).
- (Experimental) Adds minimum viable version of AnalysisDashboard analysis snapshots (#93, #94).
Id infrastructure:
- Updates
uuid_to_data_batch
to automatically fetch the data <-> uuid table in batches, improving the reliability for large tables and on slow internet connections (#88).
0.1.6
- Add
EngagementDatabase.get_command_log_entries
(#83).
- Automatically serialize/deserialize timestamps in
CommandLogEntry
(#83)
0.1.5
- Allow
Message.origin_id
in engagement_database
to be a str or a list of str (#80).
- Add command logs to engagement database (#81).
- Add optional batch-fetching option to
EngagementDatabase.get_messages
(#82).
Full Changelog: v0.1.4...v0.1.5
0.1.4
- Add
drive_client_wrapper.delete_object
(#79)
- Add
drive_client_wrapper.list_all_objects_in_drive
(#78)
0.1.3
Library:
- Engagement database: Validates history origin details to ensure that they are serialisable (#77).
Tools:
- Updates the de-identification script to use the new uuid table api introduced in v1.0.0 (#75).
- Adds delete.py, for selectively deleting entries from a uuid table (#76).
0.1.2
- Adds origin_type to Message origins (#74).
0.1.1
- FirestoreUuidTable
- Use the mapping cache in
data_to_uuid()
and uuid_to_data()
, reducing runtime and Firestore costs (#44).
- Reduces logging noise (#47).
- Add
has_data
(#58).
- Engagement Database:
- Add initial support engagement databases, including support for adding, fetching, restoring, and deleting Messages and HistoryEntries (#43, #45, #46, #48, #49, #50, #51, #52, #54, #55, #57, #59, #63, #64, #65, #66, #67, #68, #69, #70, #71, #72, #73).
0.1.0
Breaking changes:
FirestoreUuidTable
now accepts a firestore client object in its constructor instead of a credentials file path. To continue initialising with a credentials file, use FirestoreUuidTable.init_from_credentials
instead (#41).
Other changes:
- Adds
FirestoreUuidInfrastructure
, for interacting with the whole mappings database, not just one table.
- Adds
FirestoreUuidTable.get_all_mappings
.
- Enables
FirestoreUuidTable
s to co-exist with other Firebase clients.
v0.0.13
Adds a tool to log pipeline events to firestore #40
0.0.12
- Fixes dependency CoreDataModules not installing in recent versions of pip/pipenv (#39)