Skip to content

Commit

Permalink
Viewer links open in new tab
Browse files Browse the repository at this point in the history
  • Loading branch information
@iftenney
iftenney committed Dec 10, 2024
1 parent 091a79b commit ce5d2b1
Showing 1 changed file with 20 additions and 20 deletions.
40 changes: 20 additions & 20 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -126,36 +126,36 @@ additional tasks have the following optional fields:

Method | Download .jsonl file | Viewer link
--------- | --------------------------------------------------------------------------------------------------------------------------------- | -----------
BM25 | [trex_retrievals_bm25.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/trex_retrievals_bm25.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Ftrex_retrievals_bm25.jsonl)
Gecko | [trex_retrievals_gecko.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/trex_retrievals_gecko.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Ftrex_retrievals_gecko.jsonl)
TRAK | [trex_retrievals_trak.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/trex_retrievals_trak.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Ftrex_retrievals_trak.jsonl)
Exp 1 | [trex_retrievals_exp1.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/trex_retrievals_exp1.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Ftrex_retrievals_exp1.jsonl)
Exp 2 | [trex_retrievals_exp2.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/trex_retrievals_exp2.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Ftrex_retrievals_exp2.jsonl)
Exp 3 | [trex_retrievals_exp3.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/trex_retrievals_exp3.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Ftrex_retrievals_exp3.jsonl)
Exp 4 | [trex_retrievals_exp4.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/trex_retrievals_exp4.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Ftrex_retrievals_exp4.jsonl)
Exp 5 | [trex_retrievals_exp5.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/trex_retrievals_exp5.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Ftrex_retrievals_exp5.jsonl)
TrackStar | [trex_retrievals_trackstar.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/trex_retrievals_trackstar.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Ftrex_retrievals_trackstar.jsonl)
BM25 | [trex_retrievals_bm25.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/trex_retrievals_bm25.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Ftrex_retrievals_bm25.jsonl" target="_blank">view in app</a>
Gecko | [trex_retrievals_gecko.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/trex_retrievals_gecko.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Ftrex_retrievals_gecko.jsonl" target="_blank">view in app</a>
TRAK | [trex_retrievals_trak.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/trex_retrievals_trak.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Ftrex_retrievals_trak.jsonl" target="_blank">view in app</a>
Exp 1 | [trex_retrievals_exp1.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/trex_retrievals_exp1.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Ftrex_retrievals_exp1.jsonl" target="_blank">view in app</a>
Exp 2 | [trex_retrievals_exp2.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/trex_retrievals_exp2.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Ftrex_retrievals_exp2.jsonl" target="_blank">view in app</a>
Exp 3 | [trex_retrievals_exp3.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/trex_retrievals_exp3.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Ftrex_retrievals_exp3.jsonl" target="_blank">view in app</a>
Exp 4 | [trex_retrievals_exp4.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/trex_retrievals_exp4.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Ftrex_retrievals_exp4.jsonl" target="_blank">view in app</a>
Exp 5 | [trex_retrievals_exp5.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/trex_retrievals_exp5.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Ftrex_retrievals_exp5.jsonl" target="_blank">view in app</a>
TrackStar | [trex_retrievals_trackstar.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/trex_retrievals_trackstar.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Ftrex_retrievals_trackstar.jsonl" target="_blank">view in app</a>

**Table 2: T-REx facts, retrievals from C4**

Method | Download .jsonl file | Viewer link
-------------------- | ------------------------------------------------------------------------------------------------------------------------------------------- | -----------
BM25 | [c4_trex_retrievals_bm25.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_trex_retrievals_bm25.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_trex_retrievals_bm25.jsonl)
Gecko | [c4_trex_retrievals_gecko.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_trex_retrievals_gecko.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_trex_retrievals_gecko.jsonl)
Gradient dot product | [c4_trex_retrievals_grad_dot.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_trex_retrievals_grad_dot.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_trex_retrievals_grad_dot.jsonl)
Gradient cosine | [c4_trex_retrievals_grad_cosine.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_trex_retrievals_grad_cosine.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_trex_retrievals_grad_cosine.jsonl)
TrackStar | [c4_trex_retrievals_trackstar.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_trex_retrievals_trackstar.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_trex_retrievals_trackstar.jsonl)
BM25 | [c4_trex_retrievals_bm25.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_trex_retrievals_bm25.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_trex_retrievals_bm25.jsonl" target="_blank">view in app</a>
Gecko | [c4_trex_retrievals_gecko.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_trex_retrievals_gecko.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_trex_retrievals_gecko.jsonl" target="_blank">view in app</a>
Gradient dot product | [c4_trex_retrievals_grad_dot.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_trex_retrievals_grad_dot.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_trex_retrievals_grad_dot.jsonl" target="_blank">view in app</a>
Gradient cosine | [c4_trex_retrievals_grad_cosine.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_trex_retrievals_grad_cosine.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_trex_retrievals_grad_cosine.jsonl" target="_blank">view in app</a>
TrackStar | [c4_trex_retrievals_trackstar.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_trex_retrievals_trackstar.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_trex_retrievals_trackstar.jsonl" target="_blank">view in app</a>

**Appendix A.5: Additional tasks, retrievals from C4**

Task | Download .jsonl file | Viewer link
--------------------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | -----------
T-REx incorrect predictions | [c4_trex_incorrectpred_retrievals_trackstar.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_trex_incorrectpred_retrievals_trackstar.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_trex_incorrectpred_retrievals_trackstar.jsonl)
COPA | [c4_copa_retrievals_trackstar_nontaskspecific.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_copa_retrievals_trackstar_nontaskspecific.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_copa_retrievals_trackstar_nontaskspecific.jsonl)
PIQA | [c4_piqa_retrievals_trackstar_nontaskspecific.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_piqa_retrievals_trackstar_nontaskspecific.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_piqa_retrievals_trackstar_nontaskspecific.jsonl)
Arithmetic word problems | [c4_arithmeticwordproblem_retrievals_trackstar_nontaskspecific.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_arithmeticwordproblem_retrievals_trackstar_nontaskspecific.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_arithmeticwordproblem_retrievals_trackstar_nontaskspecific.jsonl)
Simple arithmetic | [c4_arithmetic_retrievals_trackstar_nontaskspecific.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_arithmetic_retrievals_trackstar_nontaskspecific.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_arithmetic_retrievals_trackstar_nontaskspecific.jsonl)
Story generation | [c4_storygeneration_retrievals_trackstar_nontaskspecific.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_storygeneration_retrievals_trackstar_nontaskspecific.jsonl) | [view in app](https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_storygeneration_retrievals_trackstar_nontaskspecific.jsonl)
T-REx incorrect predictions | [c4_trex_incorrectpred_retrievals_trackstar.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_trex_incorrectpred_retrievals_trackstar.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_trex_incorrectpred_retrievals_trackstar.jsonl" target="_blank">view in app</a>
COPA | [c4_copa_retrievals_trackstar_nontaskspecific.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_copa_retrievals_trackstar_nontaskspecific.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_copa_retrievals_trackstar_nontaskspecific.jsonl" target="_blank">view in app</a>
PIQA | [c4_piqa_retrievals_trackstar_nontaskspecific.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_piqa_retrievals_trackstar_nontaskspecific.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_piqa_retrievals_trackstar_nontaskspecific.jsonl" target="_blank">view in app</a>
Arithmetic word problems | [c4_arithmeticwordproblem_retrievals_trackstar_nontaskspecific.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_arithmeticwordproblem_retrievals_trackstar_nontaskspecific.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_arithmeticwordproblem_retrievals_trackstar_nontaskspecific.jsonl" target="_blank">view in app</a>
Simple arithmetic | [c4_arithmetic_retrievals_trackstar_nontaskspecific.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_arithmetic_retrievals_trackstar_nontaskspecific.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_arithmetic_retrievals_trackstar_nontaskspecific.jsonl" target="_blank">view in app</a>
Story generation | [c4_storygeneration_retrievals_trackstar_nontaskspecific.jsonl](https://storage.googleapis.com/tda-resources/2410.17413/public/c4_storygeneration_retrievals_trackstar_nontaskspecific.jsonl) | <a href="https://pair-code.github.io/pretraining-tda/demo/?jsonl_path=https%3A%2F%2Fstorage.googleapis.com%2Ftda-resources%2F2410.17413%2Fpublic%2Fc4_storygeneration_retrievals_trackstar_nontaskspecific.jsonl" target="_blank">view in app</a>

### T-REx sentences

Expand Down

0 comments on commit ce5d2b1

Please sign in to comment.