Skip to content
This repository has been archived by the owner on Dec 23, 2021. It is now read-only.

Stuff RangerMauve is working on #7

Closed
18 of 41 tasks
RangerMauve opened this issue Apr 18, 2019 · 37 comments
Closed
18 of 41 tasks

Stuff RangerMauve is working on #7

RangerMauve opened this issue Apr 18, 2019 · 37 comments

Comments

@RangerMauve
Copy link
Contributor

RangerMauve commented Apr 18, 2019 •
edited
Loading

Just wanted to have a place to keep track of the stuff I'm working on and what I plan to work on

Priorities

  • Minimal Spanning Tree (wireline funding)
  • Web support in hyperdiscovery
  • Dat SDK
    • Draft up a repo for what goes into it (library/feed/archive/swarm/gateway)
    • Create demo app with documentation on how the different parts work
    • Create documentation for individual tools in the SDK
  • Integrate the SDK with dat-store
  • hypercore support for dat-store
  • UI for managing dat-stores (or hashbase if it adds CORS) published to Dat
  • Dat 2 - SDK integration / etc
    • hyperswarm-proxy
    • hyperswarm-web
    • Support base32 in dat-encoding and dat-dns
    • unit tests for hyperdrive replication
    • corestore API in SDK
  • SDK integration with Cabal
  • dat-gateway + dat-store + hyperswarm-proxy = this should be a thing you deploy for your community or application and should load content the same as beaker

Community

  • Newsletter (Spring)
  • Terms documentation: Describe terms involved in the Dat ecosystem
  • Add summary of DTN week to newsletter
  • Organize community to collaborate between the different groups using Dat
    • Send out initial email to orgs
    • Initial meeting - figure out how to collaborate
    • Find points of collaboration

Other fun goodies

  • multi-hyperdrive
  • Example using multifeed, corestore, and the SDK
  • Fix daemon creation in the dat-store CLI Set username on linux nospaceships/node-os-service#46
  • FUSE on Windows
  • Dat-js integrated with dweb-transports
  • System tray application for Dat
    • Find open source system tray library
    • Build off of dat-store for running a storage provider locally
    • Basic web UI for interacting with the store loaded from localhost
    • Incorporate dat-gateway for loading websites
    • incorporate hyperswarm-proxy for browser replication
@RangerMauve
Copy link
Contributor Author

Dat-store is released!

@RangerMauve
Copy link
Contributor Author

There's already documentation for troubleshooting loading data! https://docs.datproject.org/docs/troubleshooting

Gonna skip that step in the TODO list.

@RangerMauve RangerMauve mentioned this issue Apr 24, 2019
Closed
6 tasks
@RangerMauve
Copy link
Contributor Author

So, two things before I can improve the dat-js reliability:

  • dat-store is having issues with syncing from folders (thanks fleeky)
  • I quickly updated dat-archive-web so people can add the DatArchive API from Beaker using dat-js under the hood

@RangerMauve
Copy link
Contributor Author

Dat-store is updated in 2.0.9 and people are saying that it's working well. 🎉

Also made a lot of progress on discovery-swarm-stream not advertising Dats created in the browser on the network. Probably finish that up tomorrow. RangerMauve/discovery-swarm-stream#8

@RangerMauve
Copy link
Contributor Author

Progress on first newsletter: dat-ecosystem/newsletter#5

@RangerMauve
Copy link
Contributor Author

Released the discovery-swarm-stream stuff, it's given dat-js a huge performance boost!

@RangerMauve
Copy link
Contributor Author

Added some more terms to the docs: dat-ecosystem-archive/docs#154

@okdistribute
Copy link
Contributor

regarding the system-tray, that might overlap with some of the daemon work that @andrewosh has been working on, so let's punt on that for now I'd say and try to minimize any duplicate efforts going on by coordinating with the hyperdivision folks

@RangerMauve
Copy link
Contributor Author

So, I've got an initial sketch for cabal-web going: https://github.com/RangerMauve/cabal-web

This helped stress-test discovery-swarm-web and random-access-storage. Part of this involved creating a new discovery-swarm-web gateway which keeps the default discovery-swarm handshake in place for applications that need it (like cabal). This should make it useful for a wider variety of applications.

Next I'm gonna finish up some stuff with dat-store

@RangerMauve
Copy link
Contributor Author

Drafting up May's newsletter now. :)

@RangerMauve
Copy link
Contributor Author

Working on the SDK, gonna get an initial version out there with the DatArchive API, then I'll draft up the new Hyperdrive/Hypercore Beaker stuff.

The initial version will lay down the groundwork for using hyperdiscovery / archive management cross-platform.

@RangerMauve
Copy link
Contributor Author

Alternating between SDK and Mostly Minimal Spanning tree at the moment.

Also doing some organizational stuff for the working group.

@RangerMauve
Copy link
Contributor Author

Fixed a big bug in random-access-web on firefox. Thanks to @Gozala and @sammacbeth for helping debug!

First version of the SDK is almost ready to be released. Just waiting on this hyperdrive PR to be released.

@RangerMauve
Copy link
Contributor Author

First version of the SDK is out BTW

@DougAnderson444
Copy link

First version of the SDK is out BTW

Sweet progress, @RangerMauve! Is there an Link where we can check it out?

@DougAnderson444
Copy link

Found it, lol:
https://github.com/datproject/sdk

@RangerMauve
Copy link
Contributor Author

Oops! Thanks. :P

@RangerMauve
Copy link
Contributor Author

Gonna be updating dat-store to use the SDK to see how it feels to use the new API. 😁

@okdistribute
Copy link
Contributor

dogfood ftw!

@RangerMauve
Copy link
Contributor Author

Running into a lot of useful questions already.

  • What happens when you close
  • How can I delete storage for an archive / core?
  • How do I load things in-memory instead

@RangerMauve
Copy link
Contributor Author

Also finding useful changes to add to hyperdrive and getting them PR'd. :D

@RangerMauve
Copy link
Contributor Author

Gonna work on CoreStore stuff for next Wednesday. Based on the notes from this meeting.

@RangerMauve
Copy link
Contributor Author

Released the newsletter for July

Submitted a PR to hyperdrive v10 to expose extensions and peer events

Planning on getting corestore et all integrated

@RangerMauve
Copy link
Contributor Author

Put together hyperswarm-proxy.

This will be the first step towards getting hyperswarm to work on the web and the first step to getting dat 2.0 into the SDK 🤩

@RangerMauve
Copy link
Contributor Author

Also, released dat-store@4.0.0 which uses the SDK for it's dat-related code.

Fixed some bugs in universal-dat-storage while I was at it.

@RangerMauve
Copy link
Contributor Author

Gonna quickly whip up hypertrie-down to take a bit of a mental break from the SDK and hyperswarm before starting on the next part. :P

@RangerMauve
Copy link
Contributor Author

Actually, before finishing integrating dat@2 into the SDK I'll probably create universal-dat-archive which will be like dat-archive-web, but will use the SDK and will work in node / beaker / etc.

@DougAnderson444
Copy link

😍 You're a code machine!! Loving the monologue on all the awesome progress!!

@RangerMauve
Copy link
Contributor Author

Here's the progress on the "universal" dat Archive stuff. https://github.com/datproject/sdk/blob/datarchive/test-promise.js

Gonna turn it into a polyfill style where you just import and get DatArchive with some sane defaults which works across platforms.

@RangerMauve
Copy link
Contributor Author

Pausing dat2 integration in the SDK for a bit to focus on community organizing more, and making dat-store more usable for apps using the SDK (hypercore support)

@RangerMauve
Copy link
Contributor Author

Community organizing going well. We've got a consortium group meeting every two weeks.

Made a few fixes to the SDK to make it work better.

Starting on hyperswarm-web work to progress on Dat2 integration.

@RangerMauve
Copy link
Contributor Author

Regarding system tray applications, started talking to @zootella and @jwerle about the Ara file manager supporting stuff like a local gateway that the SDK could use.

@RangerMauve
Copy link
Contributor Author

Also part of my consortium work has been to transcribe the audio calls into text. Keeping this private to the group for now.

@RangerMauve
Copy link
Contributor Author

Working on dat website redesign with @todrobbins dat-ecosystem-archive/dat-foundation-website#123

@RangerMauve
Copy link
Contributor Author

Dat website redesign was released.

Got unit tests for hyperswarm-web passing and released the initial version.

Working on a demo for hyperswarm-web/hyperswarm.

Next item is going to be to get Dat-SDK released as 1.0.0 along with docs. RangerMauve/hyper-sdk#31

@RangerMauve
Copy link
Contributor Author

Released https://github.com/RangerMauve/hyperswarm-universal-chat to showcase using hyperswarm.

Working on getting the Dat SDK to 1.0. 😁

@RangerMauve
Copy link
Contributor Author

Just an update, I haven't been working for the dat project since February, but I've still been working on dat-sdk and some other projects in my spare time / for other contracts.

Feel free to follow my twitter for updates or reach out to me if you have questions or want to hire me to help you with p2p stuff. 😁

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@okdistribute @RangerMauve @DougAnderson444