Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Writer conversion #80

Open
wants to merge 30 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
20f1fdf
Update license, package.json, and add basic notice to the Readme (#3)
wilwade Apr 27, 2021
5d03d1b
Bloom r us (#2)
enddynayn May 5, 2021
5547ad4
GitHub Actions NPM Release (#5)
wilwade May 6, 2021
c887f10
Setup package.json to support the dist directory instead of just incl…
wilwade May 10, 2021
7d3e6dc
Build before publishing (#7)
wilwade May 10, 2021
ce24b50
chore(README): update to include bloom filter (#9)
enddynayn May 11, 2021
4099f37
use xxhash-wasm (#8)
shannonwells May 12, 2021
2ccc4eb
Update package org from unfinishedlabs -> dsnp (#12)
wilwade May 18, 2021
a8ddc96
Chore/pre release 0.1.0 (#13)
wilwade Jun 7, 2021
a4f425a
Don't publish types for now (#14)
wilwade Jun 7, 2021
ba60652
feat(fetch): add browser/node http client (#15)
enddynayn Jun 18, 2021
b35942b
Parquetjs browser support (#17)
shannonwells Jun 30, 2021
f605856
fix bug caused by side-effect of change in xxhasher. regen package-lo…
shannonwells Jul 1, 2021
ac8ebb2
update BSON due to vulnerability, minor fixes (#20)
shannonwells Jul 1, 2021
81e38e4
add cjs and ejm builds (#21)
acruikshank Jul 13, 2021
98871a2
Clean up dependencies and remove lodash (#22)
wilwade Aug 17, 2021
44d9f3c
Added test cases for types and fixed bigint precision (#24)
waylandli Oct 21, 2021
a82975b
Chore/typescript conversion/27 (#33)
waylandli Nov 30, 2021
7c7bbb9
updated typescript and esbuild. Fixed typescript issue (#35)
waylandli Dec 2, 2021
6fb5fcd
Convert lib/schema.js to typescript 1/3 (#37)
waylandli Feb 22, 2022
f1bee25
Converting shred.js to typescript 2/3 (#40)
waylandli Feb 24, 2022
14bbb97
Convertinging util.js to typescript 3/3 (#39)
waylandli Feb 25, 2022
7716e84
Reader conversion (#44)
waylandli Mar 16, 2022
ae772e7
unneccessary import
mehtaishita Apr 20, 2022
13ec59f
inconsistenies
mehtaishita Apr 26, 2022
fb084bd
undo
mehtaishita Apr 26, 2022
edefef1
nullable envelope writer
mehtaishita Apr 26, 2022
71b684d
Reader conversion (#44)
waylandli Mar 16, 2022
2df8dc2
Wip
Mar 1, 2022
deb8ab6
wip dump
Mar 16, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 14 additions & 0 deletions .babelrc.js
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
module.exports = {
sourceType: "unambiguous",
plugins: ["babel-plugin-add-module-exports"],
presets: [
['@babel/preset-env', {
loose: true,
modules: "auto",
"useBuiltIns": "entry", // to ensure regeneratorRuntime is defined; see bootstrap.js
"corejs": 3, // use w/ "useBuiltIns", defaults=2, must match what is in package.json
// "targets": "> 0.25%, not dead"
}],
'@babel/preset-typescript'
]
};
23 changes: 23 additions & 0 deletions .github/ISSUE_TEMPLATE/BUG_Issue.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
---
name: Bug Report
about: Report an issue found in @dsnp/parquetjs
title: ""
labels: ""
assignees: ""
---
Thanks for reporting an issue!

### Steps to reproduce
Tell us how to reproduce this issue.

### Expected behaviour
Tell us what should happen

### Actual behaviour
Tell us what happens instead

### Any logs, error output, etc?
...

### Any other comments?
...
4 changes: 4 additions & 0 deletions .github/ISSUE_TEMPLATE/config.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
blank_issues_enabled: true
contact_links:
- name: Issue Template

22 changes: 22 additions & 0 deletions .github/PULL_REQUEST_TEMPLATE.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
Problem
=======
problem statement
Solution
========
What I/we did to solve this problem

with @pairperson1

Change summary:
---------------
* Tidy, well formulated commit message
* Another great commit message
* Something else I/we did

Steps to Verify:
----------------
1. A setup step / beginning state
1. What to do next
1. Any other instructions
1. Expected behavior
1. Suggestions for testing
36 changes: 36 additions & 0 deletions .github/workflows/main.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
name: Tests CI
on:
push:
branches: [ main ]
pull_request:
branches: [ '**' ]
jobs:
test:
runs-on: ubuntu-20.04
steps:
- name: Checkout
uses: actions/checkout@v2

- name: Use Node.js
uses: actions/setup-node@v2
with:
node-version: '14.16.0'

- uses: actions/cache@v2
with:
path: ~/.npm
key: ${{ runner.os }}-node-${{ hashFiles('**/package-lock.json') }}
restore-keys: |
${{ runner.os }}-node-

- name: Install 💾
run: npm ci

- name: Lint
run: npm run lint

- name: Test
run: npm run test

- name: Build & Publish Dry Run
run: npm publish --dry-run
36 changes: 36 additions & 0 deletions .github/workflows/publish-next.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
name: Publish NPM @next
on:
push:
branches: [ main ]
jobs:
test:
runs-on: ubuntu-20.04
steps:
- name: Checkout
uses: actions/checkout@v2

- name: Use Node.js
uses: actions/setup-node@v2
with:
node-version: '14.16.0'
registry-url: 'https://registry.npmjs.org'

- uses: actions/cache@v2
with:
path: ~/.npm
key: ${{ runner.os }}-node-${{ hashFiles('**/package-lock.json') }}
restore-keys: |
${{ runner.os }}-node-

- name: Install 💾
run: npm ci

- name: Version ⬆️
run: npm version --new-version "v0.0.0-${FULL_SHA:0:6}" --no-git-tag-version
env:
FULL_SHA: ${{ github.sha }}

- name: Publish @next 🚂
run: npm publish --tag next --access public
env:
NODE_AUTH_TOKEN: ${{secrets.NODE_AUTH_TOKEN}}
34 changes: 34 additions & 0 deletions .github/workflows/release.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
name: Release Package
on:
release:
types: [ released ]
jobs:
publish-to-npm:
runs-on: ubuntu-20.04
steps:
- name: Checkout
uses: actions/checkout@v2

- name: Use Node.js
uses: actions/setup-node@v2
with:
node-version: '14.16.0'
registry-url: 'https://registry.npmjs.org'

- uses: actions/cache@v2
with:
path: ~/.npm
key: ${{ runner.os }}-node-${{ hashFiles('**/package-lock.json') }}
restore-keys: |
${{ runner.os }}-node-

- name: Install 💾
run: npm ci

- name: Version ⬆️
run: npm version --new-version ${{ github.event.release.tag_name }} --no-git-tag-version

- name: Publish 🚂
run: npm publish --tag latest
env:
NODE_AUTH_TOKEN: ${{secrets.NODE_AUTH_TOKEN}}
6 changes: 3 additions & 3 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
node_modules
*.parquet
npm-debug.log
package-lock.json
.nyc_output

!test/test-files/*.parquet
dist
!test/test-files/*.parquet
examples/server/package-lock.json
1 change: 1 addition & 0 deletions .tool-versions
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
nodejs 16.14.0
11 changes: 0 additions & 11 deletions .travis.yml

This file was deleted.

4 changes: 3 additions & 1 deletion LICENSE → LICENSE.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,6 @@
Copyright (c) 2017 ironSource Ltd.
Copyright for portions of the project are (c) 2017 ironSource Ltd. https://github.com/ironSource/parquetjs
Copyright for portions of the project are https://github.com/ZJONSSON/parquetjs
Copyright for portions of the project are https://github.com/LibertyDSNP/parquetjs

Permission is hereby granted, free of charge, to any person obtaining a copy of
this software and associated documentation files (the "Software"), to deal in the
Expand Down
Loading