Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run EI systemtests in Travis build #191

Open
e-pettersson-ericsson opened this issue Mar 7, 2019 · 5 comments
Open

Run EI systemtests in Travis build #191

e-pettersson-ericsson opened this issue Mar 7, 2019 · 5 comments
Labels
help wanted We need extra hands on this. test Issues or pull requests related to testing.

Comments

@e-pettersson-ericsson
Copy link
Member

e-pettersson-ericsson commented Mar 7, 2019

Description

We need to include the system tests in the Travis build. A separate stage should be defined for running the system test to run in parallel with other test stages. The system tests should run on the latest code changes of EI (not using released docker images from Docker hub but instead build the image based on latest code changes).

Benefits

Improved test coverage in Travis.

Possible Drawbacks

None that I can think of.

@e-pettersson-ericsson e-pettersson-ericsson changed the title We need to run systemtests in Travis build Run EI systemtests in Travis build Mar 7, 2019
@e-pettersson-ericsson e-pettersson-ericsson self-assigned this Mar 7, 2019
@e-pettersson-ericsson
Copy link
Member Author

Started looking into this

@e-pettersson-ericsson
Copy link
Member Author

e-pettersson-ericsson commented Mar 14, 2019

I've set up an environment which can be reused in the integration tests and the system tests, and the environment works good locally but pushing up changes in build to Travis I've got some issues with the availabe resources in the Travis VM. When downloading the maven dependencies to run the system tests the build usually hangs and gives no output for some time (causing the build to abort after a time limit) or gives the error shown below:

An excerpt of the logs:

Downloading from central: http://repo.maven.apache.org/maven2/net/bytebuddy/byte-buddy/1.7.11/byte-buddy-1.7.11.pom
Downloaded from central: http://repo.maven.apache.org/maven2/net/bytebuddy/byte-buddy/1.7.11/byte-buddy-1.7.11.pom (12 kB at 425 kB/s)
Downloading from central: http://repo.maven.apache.org/maven2/net/bytebuddy/byte-buddy-parent/1.7.11/byte-buddy-parent-1.7.11.pom
Downloaded from central: http://repo.maven.apache.org/maven2/net/bytebuddy/byte-buddy-parent/1.7.11/byte-buddy-parent-1.7.11.pom (26 kB at 726 kB/s)
Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00000000e1200000, 93323264, 0) failed; error='Cannot allocate memory' (errno=12)
#
# There is insufficient memory for the Java Runtime Environment to continue.
# Native memory allocation (mmap) failed to map 93323264 bytes for committing reserved memory.
The command "mvn -P systemTest -DsystemtestProperties=src/systemtest/resources/system-test.properties verify " exited with 1.

This happens despite having the system tests in a separate stage in the Travis build.
Not sure how to proceed with this... I've also tried running the 3 system test flows separately, but it doesn't seem to help with this issue...
I'm unassigning myself from this, so if someone else has time to look into this, feel free to do so.

@e-pettersson-ericsson e-pettersson-ericsson removed their assignment May 13, 2019
@e-pettersson-ericsson e-pettersson-ericsson added the test Issues or pull requests related to testing. label Aug 7, 2019
@e-pettersson-ericsson
Copy link
Member Author

I don't see us prioritizing this issue in the near future unfortunately, mostly because we don't have a way around the limitations of the Travis build... Should we close this issue? @eiffel-community/eiffel-intelligence-maintainers ?

@SantoshNC68
Copy link
Member

We can add a new label instead of closing the issue, that way someone can also see the issue and try to help us. How about adding "help required" and "blocked" labels ?

@e-pettersson-ericsson
Copy link
Member Author

Ok, I'll add the "help wanted" label for now.

@e-pettersson-ericsson e-pettersson-ericsson added the help wanted We need extra hands on this. label Feb 4, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted We need extra hands on this. test Issues or pull requests related to testing.
Projects
None yet
Development

No branches or pull requests

2 participants