Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sum url content using Sentence Transformers before making prediction #114

Merged
merged 36 commits into from
Oct 13, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
36 commits
Select commit Hold shift + click to select a range
6915fad
feat: Duplicated prediction_request.py tool and added print statement
jhehemann Sep 20, 2023
6ce9679
feat: Added print statements to follow script steps.
jhehemann Sep 21, 2023
f2548d6
feat: Added an openai api request that extracts the most relevant inf…
jhehemann Sep 21, 2023
97ffbd1
feat: Added preprocessing website content with BERT language model to…
jhehemann Sep 22, 2023
3c6a285
chore: Reduce GPU usage, added batched processing, reduced size of so…
jhehemann Sep 22, 2023
06dde74
feat: Changed prompts to give more concise and clear instructions. GP…
jhehemann Sep 23, 2023
7c73baf
feat: Adjusted prompt instructions. GPT-4 now decreases probability o…
jhehemann Sep 23, 2023
5fa51f9
feat: Adjusted prompt instructions - Additional information is up-to-…
jhehemann Sep 23, 2023
63c67b8
chore: Removed duplicated sentences before processing; Adjusted promp…
jhehemann Sep 23, 2023
452fbc0
feat: Added funcionality for better extraction of isolated but releva…
jhehemann Sep 24, 2023
7880ffc
chore: Formatted code and added comments
jhehemann Sep 24, 2023
ccd7c7e
feat: Improved url requests, minor improvements in different code parts.
jhehemann Sep 25, 2023
db52be5
feat: Added token truncation before passing prompt to openai chat com…
jhehemann Sep 25, 2023
f0ec8e9
feat: Added conten type check before url request; removed retry logic…
jhehemann Sep 25, 2023
11292d6
chore: Allowed for redirects for header request; Removed print statem…
jhehemann Sep 25, 2023
fcf3116
chore: minor changes to print statements, variable names.
jhehemann Sep 25, 2023
bf68bbb
feat: Changed sentence transformers model and used dot score for calc…
jhehemann Sep 25, 2023
0f20bb2
feat: Changed to sentence transformer model multi-qa-distilbert-cos-v…
jhehemann Sep 26, 2023
3f001c9
chore: Added helper functions and did minor changes in variable and p…
jhehemann Sep 26, 2023
f2e45ac
feat: Changed prediction prompt formulation; Minor changes to variabl…
jhehemann Sep 26, 2023
c802085
chore: [unfinished] changed prediction prompt and date representations.
jhehemann Sep 27, 2023
01ef920
fead: added new instructions regarding deadline. Not effectively cons…
jhehemann Sep 27, 2023
f8d3e70
feat: Reasonable estimations by GPT-4 for event questions specifying …
jhehemann Sep 27, 2023
29a4afd
chore: Minor change to the prediction prompt
jhehemann Sep 27, 2023
6df7711
chore: Removed and updated packages
jhehemann Sep 29, 2023
3fb3f09
Revert "chore: Removed and updated packages"
jhehemann Sep 29, 2023
4f376bc
Merge remote-tracking branch 'upstream/main' into SUM_URL_CONTENT
jhehemann Sep 29, 2023
6617bfe
chore: Removed and reinstalled packages
jhehemann Sep 29, 2023
2029e6d
feat: Added marker for torch install in pyproject.toml
jhehemann Sep 30, 2023
3d6c1c7
chore: Added marker for torch version
jhehemann Sep 30, 2023
0305d61
feat: Added download link for torch and torchvision for cpu only version
jhehemann Sep 30, 2023
bf5df2e
chore: Update dependencies
jhehemann Sep 30, 2023
920c69b
chore: Update poetry
jhehemann Sep 30, 2023
c9c2779
chore: Update poetry
jhehemann Oct 6, 2023
355e320
Merge remote-tracking branch 'upstream/main' into update-for-pr
jhehemann Oct 6, 2023
ada65bb
chore: update poetry
jhehemann Oct 6, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,8 @@ packages/valory/protocols/ipfs
packages/valory/protocols/ledger_api
packages/valory/protocols/tendermint

*test_mech.py

.idea
**/__pycache__/
*.DS_Store
Expand Down
Loading
Loading