Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Automate regular updates of the bootstrap bundle #127

Open
smacfarlane opened this issue Feb 14, 2019 · 8 comments
Open

Automate regular updates of the bootstrap bundle #127

smacfarlane opened this issue Feb 14, 2019 · 8 comments
Assignees
@smacfarlane
Labels
A-builder C-chore Chore item E-easy Good for newcomers V-bldr Builder vertical

Comments

@smacfarlane
Copy link
Contributor

Core plans are a constantly moving target, which means the bootstrap bundle is often out of date. We should automate regular updates of the bundle (monthly?) to minimize the delta between the bundle and the stable channel on the Public Builder service.
@smacfarlane smacfarlane added the C-chore Chore item label Feb 14, 2019
@smacfarlane smacfarlane self-assigned this Feb 14, 2019
@qubitrenegade
Copy link
Contributor

What is the current process? I have a few spare cycles week after next and would like to take a crack at this.

@bdangit
Copy link
Contributor

bdangit commented Feb 15, 2019

@qubitrenegade they actually have a command built in to on-prem-archive script that will generate an archive and upload it to AWS buckets.

@eeyun eeyun added E-easy Good for newcomers V-bldr Builder vertical A-builder labels Feb 19, 2019
@jsirex
Copy link

jsirex commented Feb 26, 2019

I'm still in "developing-refactoring", but decided to push a scratch commit with hab-depot-sync.
It, probably, buggy, but I was able to incremental sync only latest packages. Syncing doesn't require disk space.

Unfortunately you have to:

  1. have ruby
  2. clone https://github.com/habitat-plans/hab-sdk.git
  3. rake build && rake install

Try hab-depot-sync --help

@jsirex
Copy link

jsirex commented Feb 28, 2019 •
edited
Loading

Work still in progress. Now I have habitat:

sudo hab pkg install -b ya/hab-sdk -c unstable
hab-depot-sync --dest-depot https://bldr.on-prem.domain.local --dest-auth-token $auth_token --origin core --latest-release

@bdangit
Copy link
Contributor

bdangit commented Mar 7, 2019

@jsirex I tried to run your app but i get this:

SSL_CERT_FILE=/my/pem hab-depot-sync --dest-depot https://bldr.myonprem --dest-auth-token $HAB_AUTH_TOKEN --origin core --latest-release
   Warn: unexpected response for https://bldr.myonprem/v1/depot/origins/core/keys. Net::HTTPBadGateway - <html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.15.6</center>
</body>
</html>
Traceback (most recent call last):
        7: from /usr/bin/hab-depot-sync:13:in `<main>'
        6: from /usr/bin/hab-depot-sync:13:in `load'
        5: from /hab/pkgs/ya/hab-sdk/0.1.0/20190304151756/rubygems/gems/hab-sdk-0.1.0/exe/hab-depot-sync:5:in `<top (required)>'
        4: from /hab/pkgs/ya/hab-sdk/0.1.0/20190304151756/rubygems/gems/hab-sdk-0.1.0/lib/hab/depot/sync.rb:68:in `run'
        3: from /hab/pkgs/ya/hab-sdk/0.1.0/20190304151756/rubygems/gems/hab-sdk-0.1.0/lib/hab/depot/sync.rb:164:in `list_origin_keys'
        2: from /hab/pkgs/core/ruby/2.5.3/20190131191657/lib/ruby/2.5.0/json/common.rb:156:in `parse'
        1: from /hab/pkgs/core/ruby/2.5.3/20190131191657/lib/ruby/2.5.0/json/common.rb:156:in `new'
/hab/pkgs/core/ruby/2.5.3/20190131191657/lib/ruby/2.5.0/json/common.rb:156:in `initialize': no implicit conversion of nil into String

@bdangit
Copy link
Contributor

bdangit commented Mar 7, 2019

@jsirex sorry false alarm! our bldr had some production issues which got resolved. Script appears to be working. I'll share results after it finishes.

@jsirex
Copy link

jsirex commented Mar 14, 2019

@bdangit have you succeed?

@bdangit
Copy link
Contributor

bdangit commented Mar 14, 2019

@jsirex I have been successful. thanks for checking in

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@smacfarlane smacfarlane

Labels
A-builder C-chore Chore item E-easy Good for newcomers V-bldr Builder vertical
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@smacfarlane @bdangit @jsirex @eeyun @qubitrenegade