Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Chore] Add solr json loader as submodule into index-bioentities repo #13

Merged
merged 7 commits into from
Oct 18, 2023

Conversation

ke4
Copy link
Contributor

@ke4 ke4 commented Oct 12, 2023

Changes:

  • Added solr-jsonl-loader as a submodule
  • Replaced solr-jsonl-chunk-loader.sh with a symlink that point to the similarly named file in the previously added submodule. That file in the submodule is going to be shared across other repositories, too.

@anilthanki
Copy link

Does this symlink perform same as actual file with all relative paths and bash commands like dirname etc

@ke4
Copy link
Contributor Author

ke4 commented Oct 12, 2023

@anilthanki We extracted that single json chunk loader file into a separate repo. We are going to include that repo as a submodule in these repos:

  • index-bioentities
  • index-scxa
  • solr-bulk
  • maybe in index-gxa??? later

@anilthanki
Copy link

@anilthanki We extracted that single json chunk loader file into a separate repo. We are going to include that repo as a submodule in these repos:

  • index-bioentities
  • index-scxa
  • solr-bulk
  • maybe in index-gxa??? later

I totally agree we should not be maintaining multiple copies of same script, what I was asking is if its symlinked then certain relative functions (i.e. dirname) will behave same as actual file or do we need to change them?

@ke4 ke4 self-assigned this Oct 13, 2023
Copy link
Member

@alfonsomunozpomer alfonsomunozpomer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All good!

Copy link
Member

@alfonsomunozpomer alfonsomunozpomer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All good!

Copy link

@anilthanki anilthanki left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Member

@pmb59 pmb59 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

My only comment is regarding this commit ec053f4. There, you are redefining and exporting, and already defined $SOLR_HOST variable. Why is this necessary only for this test and not for the other tests in tests/bioentities.bats?

@ke4 ke4 changed the title Add solr json loader as submodule [Chore] Add solr json loader as submodule Oct 18, 2023
@ke4 ke4 changed the title [Chore] Add solr json loader as submodule [Chore] Add solr json loader as submodule into index-bioentities repo Oct 18, 2023
@ke4
Copy link
Contributor Author

ke4 commented Oct 18, 2023

LGTM!

My only comment is regarding this commit ec053f4. There, you are redefining and exporting, and already defined $SOLR_HOST variable. Why is this necessary only for this test and not for the other tests in tests/bioentities.bats?

@alfonsomunozpomer did that fix. As far as I remember without that fix the test wanted to connect to solr on localhost. That modification fixed that test. None of the other tests needed that change.

@ke4 ke4 merged commit 2563422 into develop Oct 18, 2023
1 check passed
@ke4 ke4 deleted the add_solr-json-loader_as_submodule branch October 18, 2023 16:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants