Code

Implement iroh blobs#9

Code

Merged

tripledoublev merged 88 commits intoOpenArchive:mainOpenArchive/save-dweb-backend:mainfrom tripledoublev:implement-iroh-blobstripledoublev/save-dweb-backend:implement-iroh-blobsCopy head branch name to clipboardOct 8, 2024

+1,536-161

Commits

Commits on Sep 18, 2024

• Add veilid-iroh-blobs' initial branch as a dependency

  tripledoublev

  committed
  36835ea

  Copy full SHA for 36835ea

• Update iroh-blobs dependency to version 0.24.0

  tripledoublev

  committed
  a11dd30

  Copy full SHA for a11dd30

Commits on Sep 27, 2024

• Add constants for communication protocol flags

  tripledoublev

  committed
  dc2d685

  Copy full SHA for dc2d685

• Update dependencies in Cargo.toml

  tripledoublev

  committed
  8147789

  Copy full SHA for 8147789

• Refactor backend.rs to initialize VeilidIrohBlobs and handle shutdown

  tripledoublev

  committed
  0d69d9e

  Copy full SHA for 0d69d9e

• add make_route function for creating custom private routes

  tripledoublev

  committed
  31990ce

  Copy full SHA for 31990ce

• include VeilidIrohBlobs in Group struct and implement upload_blob function

  tripledoublev

  committed
  b14ff6a

  Copy full SHA for b14ff6a

• include VeilidIrohBlobs to Repo and implement download_blob function

  tripledoublev

  committed
  c3c144a

  Copy full SHA for c3c144a

• Update test to include VeilidIrohBlobs

  tripledoublev

  committed
  5479ad7

  Copy full SHA for 5479ad7

• simplify result handling in make_route function

  tripledoublev

  committed
  7324996

  Copy full SHA for 7324996

• Use is_empty instead of len

  tripledoublev

  committed
  8f81efc

  Copy full SHA for 8f81efc

Commits on Sep 30, 2024

• Refactor error handling and remove unnecessary returns

  tripledoublev

  committed
  fc17b3d

  Copy full SHA for fc17b3d

• Refactor make_route function for ordered sequencing

  tripledoublev

  committed
  be8631d

  Copy full SHA for be8631d

• Add logs

  tripledoublev

  committed
  02b63f3

  Copy full SHA for 02b63f3

• Remove unnecessary reference to veilid_api

  tripledoublev

  committed
  24bc195

  Copy full SHA for 24bc195

• Remove download_blob and use download_file_from instead

  tripledoublev

  committed
  12296ce

  Copy full SHA for 12296ce

• Add get_route_id_blob method to DHTEntity

  tripledoublev

  committed
  e90f177

  Copy full SHA for e90f177

• Add get_route_id_blob method to Repo

  tripledoublev

  committed
  f44bed9

  Copy full SHA for f44bed9

• Add get_route_id_blob method to Group

  tripledoublev

  committed
  3346309

  Copy full SHA for 3346309

• Serialize tests

  tripledoublev

  committed
  9a3a6e5

  Copy full SHA for 9a3a6e5

• Add new constants for data processing

  tripledoublev

  committed
  953b934

  Copy full SHA for 953b934

• Create blob_transfer_test

  tripledoublev

  committed
  827ff08

  Copy full SHA for 827ff08

Commits on Oct 1, 2024

• Import CryptoKey from veilid_core

  tripledoublev

  committed
  58d1a0b

  Copy full SHA for 58d1a0b

• Normalize test names

  tripledoublev

  committed
  c15bfea

  Copy full SHA for c15bfea

• Create group_creation test

  tripledoublev

  committed
  4542fa2

  Copy full SHA for 4542fa2

• Create keypair_storage_and_retrieval test

  tripledoublev

  committed
  351462e

  Copy full SHA for 351462e

• Create repo_creation test

  tripledoublev

  committed
  fb06110

  Copy full SHA for fb06110

• Create message_sending_via_private_route

  tripledoublev

  committed
  d291cc4

  Copy full SHA for d291cc4

• Create group_name_persistence

  tripledoublev

  committed
  36e5640

  Copy full SHA for 36e5640

• Run tests with single thread and verbose output

  tripledoublev

  committed
  0a8e326

  Copy full SHA for 0a8e326

• Reorder test flags for verbose output and single thread execution

  tripledoublev

  committed
  5f52265

  Copy full SHA for 5f52265

Commits on Oct 2, 2024

• Remove --verbose and --nocapture

  tripledoublev

  committed
  e8005fa

  Copy full SHA for e8005fa

• Refactor Repo struct to remove id field and add id() method

  tripledoublev

  committed
  06d9a37

  Copy full SHA for 06d9a37

• Refactor CommonKeypair struct to remove public_key field

  tripledoublev

  committed
  8e85987

  Copy full SHA for 8e85987

• Refactor CommonKeypair struct to remove public_key fieldin backend.rs

  tripledoublev

  committed
  ad8aaa1

  Copy full SHA for ad8aaa1

• Update repo creation logic in backend.rs

  tripledoublev

  committed
  5549512

  Copy full SHA for 5549512

• Refactor get_repo method in backend.rs to load keypair using repo ID and cache the loaded repo

  tripledoublev

  committed
  9baf6bd

  Copy full SHA for 9baf6bd

• Update tests, add repo_persistence test

  tripledoublev

  committed
  670c499

  Copy full SHA for 670c499

• Reintroduce public_key field to CommonKeypair after premature removal

  tripledoublev

  committed
  7ce3e23

  Copy full SHA for 7ce3e23

• Enable verbose output and prevent test output from being captured

  tripledoublev

  committed
  daac28b

  Copy full SHA for daac28b

• Add iroh dependency to Cargo.toml

  tripledoublev

  committed
  dbfd247

  Copy full SHA for dbfd247

• when creating a new group create a en empty iroh collection and set the root hash on the dht

  tripledoublev

  committed
  a334163

  Copy full SHA for a334163

• Add DHT writing logic to upload_blob in Group

  tripledoublev

  committed
  93ba843

  Copy full SHA for 93ba843

• Add test for upload_blob to verify file upload and DHT storage

  tripledoublev

  committed
  5c4389b

  Copy full SHA for 5c4389b

• test will stop if it exceeds 10 minutes to prevent it from hanging indefinitely

  tripledoublev

  committed
  018be9e

  Copy full SHA for 018be9e

• ensures that the async block returns Result

  tripledoublev

  committed
  631f2fa

  Copy full SHA for 631f2fa

• Create DHTRecordInfo struct for storage in protected store

  tripledoublev

  committed
  0953fc6

  Copy full SHA for 0953fc6

• Add DHTRecordInfo struct for storage in protected store in upload_blob

  tripledoublev

  committed
  e285bdd

  Copy full SHA for e285bdd

• Create upload_blob_and_verify_protected_store test

  tripledoublev

  committed
  2899f4c

  Copy full SHA for 2899f4c

Commits on Oct 3, 2024

• Increase timeout duration in sending_message_via_private_route test

  tripledoublev

  committed
  f63a4aa

  Copy full SHA for f63a4aa

• Merge branch 'OpenArchive:main' into implement-iroh-blobs

  tripledoublev

  authored
  8845bc9

  Copy full SHA for 8845bc9

• Merge branch 'main' into implement-iroh-blobs

  tripledoublev

  authored
  8051152

  Copy full SHA for 8051152

• adds the iroh_blobs field to the Group, await the result of self.join_group(retrieved_keypair) and returns a Box<Group>.

  tripledoublev

  committed
  d50fd96

  Copy full SHA for d50fd96

• Remove duplicated imports in group.rs

  tripledoublev

  committed
  b578810

  Copy full SHA for b578810

• Remove duplicated import in lib.rs

  tripledoublev

  committed
  842a67a

  Copy full SHA for 842a67a

Commits on Oct 4, 2024

• Restructure blob uploads, create_Repo takes group id, save route and cid to DHT

  

  Mauve Signweaver

  committed
  8f1dff7

  Copy full SHA for 8f1dff7

Commits on Oct 5, 2024

• Download hash from peers

  

  Mauve Signweaver

  committed
  ce2a50b

  Copy full SHA for ce2a50b

• get_stream_from_hash in group

  

  Mauve Signweaver

  committed
  14a3018

  Copy full SHA for 14a3018

Commits on Oct 7, 2024

• Use latest blobs code

  

  Mauve Signweaver

  committed
  587a941

  Copy full SHA for 587a941

• Fix clippy warnings; refactor iterator and pattern matching

  tripledoublev

  committed
  8fb296b

  Copy full SHA for 8fb296b

• Merge branch 'implement-iroh-blobs' of https://github.com/tripledoublev/save-dweb-backend into implement-iroh-blobs

  tripledoublev

  committed
  9bc8168

  Copy full SHA for 9bc8168

• Add test for listing repositories in a group (list_repos_test)

  tripledoublev

  committed
  8e735ae

  Copy full SHA for 8e735ae

• Add test for getting own repository in a group (get_own_repo_test)

  tripledoublev

  committed
  987e4d6

  Copy full SHA for 987e4d6

• Add test for creating a collection and uploading a file via the backend

  tripledoublev

  committed
  95be255

  Copy full SHA for 95be255

• Add test for deleting a file from a collection via the backend

  tripledoublev

  committed
  79ec187

  Copy full SHA for 79ec187

• Add tests for downloading hash from peers and checking if peers have the hash

  tripledoublev

  committed
  d866d78

  Copy full SHA for d866d78

• Merge pull request #3 from tripledoublev/add-more-tests

  Show description for c478862
  tripledoublev

  authored
  c478862

  Copy full SHA for c478862

• Merge pull request #2 from tripledoublev/add-new-tests

  Show description for 0c715a2
  tripledoublev

  authored
  0c715a2

  Copy full SHA for 0c715a2

• Add load_known_groups to backend

  

  Mauve Signweaver

  committed
  7bb79eb

  Copy full SHA for 7bb79eb

• Add collection management methods for repo

  tripledoublev

  committed
  9b4c85d

  Copy full SHA for 9b4c85d

• Add test for collection management methods for repo

  tripledoublev

  committed
  bfa8cec

  Copy full SHA for bfa8cec

• replace get_file_from_repo_collection with get_file_hash

  Show description for cc9cef5
  

  tripledoublev

  and

  RangerMauve

  authored
  cc9cef5

  Copy full SHA for cc9cef5

• Make list_files_in_repo_collection private

  Show description for 7651e9d
  

  tripledoublev

  and

  RangerMauve

  authored
  7651e9d

  Copy full SHA for 7651e9d

• Making it short

  Show description for c4a38ee
  

  tripledoublev

  and

  RangerMauve

  authored
  c4a38ee

  Copy full SHA for c4a38ee

• Making it shorter

  tripledoublev

  committed
  d97f376

  Copy full SHA for d97f376

• Create public method list_files that checks for permissions

  tripledoublev

  committed
  e52e9bc

  Copy full SHA for e52e9bc

• Create update_collection_on_dht method

  tripledoublev

  committed
  44b22e8

  Copy full SHA for 44b22e8

• Update DHT on file deletion

  tripledoublev

  committed
  e9f7ed3

  Copy full SHA for e9f7ed3

• Update DHT on Upload

  tripledoublev

  committed
  f2849aa

  Copy full SHA for f2849aa

• Making it private

  Show description for 0c43a37
  

  tripledoublev

  and

  RangerMauve

  authored
  0c43a37

  Copy full SHA for 0c43a37

• Update src/repo.rs

  Show description for e28ba0d
  

  tripledoublev

  and

  RangerMauve

  authored
  e28ba0d

  Copy full SHA for e28ba0d

• Use upload instead of upload_blob

  tripledoublev

  committed
  01c141d

  Copy full SHA for 01c141d

Commits on Oct 8, 2024

• Make get_or_create_collection private, skip set_file_in_repo_collection as internal impl detail

  tripledoublev

  committed
  56f6168

  Copy full SHA for 56f6168

• Use get_or_create_collection when you read or write

  tripledoublev

  committed
  84c684c

  Copy full SHA for 84c684c

• Update test to reflect latest implementation

  tripledoublev

  committed
  ccc013b

  Copy full SHA for ccc013b

• Merge pull request #4 from tripledoublev/add-collection-to-repo

  Show description for 002385b
  tripledoublev

  authored
  002385b

  Copy full SHA for 002385b

• Remove unnecessary use of to_string

  tripledoublev

  committed
  d01ab1f

  Copy full SHA for d01ab1f

• Change &file_name to file_name

  tripledoublev

  committed
  e79ecfc

  Copy full SHA for e79ecfc