Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ingestor testing environment #17

Open
nitrosx opened this issue May 6, 2024 · 3 comments
Open

Ingestor testing environment #17

nitrosx opened this issue May 6, 2024 · 3 comments
Assignees
Milestone

Comments

@nitrosx
Copy link
Contributor

nitrosx commented May 6, 2024

Currently the ingestor is tested on the production environment. As it is a critical component of the ESS FAIR data system, we need to set up a CI/CD pipeline.
Automated testing is the first step towards it.
The next image should be a good representation at high level of what is needed for testing.
SciCat_ingestor_testing_environment

@nitrosx nitrosx added this to the Refactoring milestone May 6, 2024
@YooSunYoung
Copy link
Contributor

@nitrosx I'm not sure if you want a monitor or a test from this.

@YooSunYoung
Copy link
Contributor

We can probably do sth similar to ECDC integration tests

https://gitlab.esss.lu.se/ecdc/ess-dmsc/kafka-to-nexus/-/blob/main/.gitlab-ci.yml?ref_type=heads#L151-179

@YooSunYoung
Copy link
Contributor

We can probably do sth similar to ECDC integration tests

https://gitlab.esss.lu.se/ecdc/ess-dmsc/kafka-to-nexus/-/blob/main/.gitlab-ci.yml?ref_type=heads#L151-179

I tried to download the same docker-compose file but I had this error in the CI so I'll just copy+paste the relevant parts...

Run docker-compose up -d
  
yaml.scanner.ScannerError: mapping values are not allowed here
  in "./docker-compose.yml", line 10, column 17
Error: Process completed with exit code 1.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants