Rebased from upstream and reduced some customized commits for xenapi. #6
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
CINDER_SECURE_DELETE was deprecated in devstack in liberty with dfcc3871c022516330b6afb6c74751ac42a87480. Start using CINDER_VOLUME_CLEAR (default to 'none' to avoid the same bug that CINDER_SECURE_DELETE is used for). Add a TODO about removing DEVSTACK_CINDER_SECURE_DELETE once kilo-eol happens in devstack. Change-Id: I131c1aee665d6bd4e38dcfd0aec1b4796adc64c5
Fix some misspellings Change-Id: Id9ac593a585f8d348667e6f208b8327d72502d17
devstack can configure a TLS proxy for a number of services if the tls-proxy service is enabled. Make this service available to the gate. Change-Id: I654f06c34a60e56ff98b9b6720d0f9a3fe5d240b
The left bracket '[' was incorrectly placed. And '-f' was trying to be executed instead of the test executable '[' Change-Id: Ib947fa6aab651e427e44c8edc3552a02f3b505a4
Change #openstack-dev to #openstack-qa in README.rst Use #openstack-qa as that is the channel that patch submission notices get broadcast on. Change-Id: I8ea331bbb325182e465f68f91930886822ba3c9c
Add:
export PS4='+ ${BASH_SOURCE:-}:${FUNCNAME[0]:-}:L${LINENO:-}: '
To devstack-vm-gate-wrap.sh to provide additional debug info. This will
show the filename, line number, function name, and the content of the
line.
Same as how it is done in openstack/devstack
An example output line:
+ ./safe-devstack-vm-gate-wrap.sh:main:L547: RETVAL=1
Change-Id: I2c745fd139be63d56ff89ab8e3f60eb795ab82ce
The commit 7ffa1d58ce9fd9e32cdab142a1f12feae38c3097 added support to configure nodes with ipmitool drivers in DevStack ironic to run with virtual machines. The main goal of that patch was to allow us to test the production ipmitool drivers in the gate replacing the *_ssh testing drivers in the future. Later a patch to project-config 2e577710e975983b594f6df59b504b4cae85e594 added two new jobs to the ironic gate: pxe_ipmitool and agent_ipmitool. This patch contains the final pieces to enable ipmitool drivers to run on gate. Change-Id: I2adff0d7195d3f53e19b600b2d91163a8271bf2c Related-Bug: #1544642
We switched from GRE to VXLAN in the implementation as of I951e7e1bd98eeaf347e85296c12e027e225c2c97 so the diagrams should match accordingly. Change-Id: I0b0cef3a7217530573e694de54bf6dc68e295856
Don't always assume our MTU will always be 1500 when calculating the MTUs of overlays running inside our test nodes. Instead determine our smallest interface MTU, subtract 50 from that for vxlan overhead (and GRE too since GRE has less overhead than vxlan), and use this new number on the overlay networks. Change-Id: If5facee99f03c0ec4773241f872477b922a6674e
Previously we had wrongly assumed that python yaml package will be available in the images and the run-tests.sh script ran a set of things which included a script that used the pyyaml package. With the recent bindep changes, this assumption broke and the gate-devstack-gate-unittests failed. So we need to install the pyyaml package and then run the tests in this venv for run-tests.sh to work. Change-Id: I541c8add8041348a259b3b789d24cf24ba122ce0
If the ironic VM node console logs exist in the /opt/stack/old/ directory then archive those logs as part of cleanup_host(). Change-Id: I5349f33c94654534825a7b0a88eb2e5bc8092394
Makes it easier for folks to go look in one spot for deprecation warnings spit out in various process(es). This will also help us warn folks to go fix deprecated stuff before they become a problem. Change-Id: I757821bd6f19a168888df92d416d7af16f41637b
Change-Id: Ie4f86c812d4de5cd5987833f377efde4921875b3 Signed-off-by: Doug Hellmann <[email protected]>
Oops! missed the location for the Apache based logs (horizon and keystone). Change-Id: I7d20e95b3ed9f37bfe04865e8809795964a49455
It is not possible to use a swapfile generated by fallocate on a xfs filesystem which is shipped by default on CentOS >7. So since [1], we effectively ran jobs on CentOS VMs without any swap. Use dd as a way of creating the swapfile that works on both Ubuntu and CentOS with a slight performance hit and ensure it's mounted properly so we don't have a silent failure. Also manage a new specific case, Vexxhost VMs ship with 2GB of swap which is not in line with the expectation that all VMs should have 8GB. If there is less than 8GB of swap (or zero), we will make up for the difference. [1]: https://review.openstack.org/#/c/278557/ Change-Id: Iaf4de66475d747f62bd49dfe7318131cbeb03be8
The script to populate reproduce.sh is failing when populating multi-line env vars. That is the case of the enable_plugin lines, when more than one plugin is enabled. Add this workaround to properly populate all needed settings. Also add a test to ensure that reproduce method is working as expected. Change-Id: I5287098a47162321efadbde7d069fa2a4e7eabf7
Fix so that ~/workspace-cache is no longer deleted. Makes instructions in README work again. Change-Id: I71668132820137f50b32494bc78d58a80867be92
This documents the prerequsites and requirements for reproducing devstack-gate in Ubuntu Trusty. Known issue: Doesn't document this for CentOS/Fedora. Change-Id: I6c483d6af7afda4d4ebb914dc7bd6ee862ad874f
As of now, there is no way to address 2 different set of configuration for the primary node and the subnodes when using the multinode tests. Hence, this patchset adds a new environment variable called DEVSTACK_SUBNODE_CONFIG that appends its content into the local.conf file of the subnodes (only). Besides, the existing DEVSTACK_LOCAL_CONFIG variable is still used to set up the primary node. Change-Id: I1603b747b2cf4767cd3ed71fe4d56ae54920d19e
This makes grenade work with stable mitaka, both upgrading to it, and upgrading from it in master. Depends-On: Ic9fc5cde67691ce03b3d612d86da7207608e20b1 grenade fixes for OS_PROJECT_NAME Change-Id: I73d2f7f83f700e430d231235e6d2277100036cd5
When DEVSTACK_GATE_VIRT_DRIVER has been set to ironic, in function setup_localrc, VIRT_DRIVER=ironic will be set to local.conf twice. This fix remove the second write. Change-Id: I6c0e7649366e3567b9342e4f83489dbae0229c2b Closes-Bug: 1561279
Bad copy and paste, this should have been liberty. Change-Id: I42e0971bbbb2e14bf75f5399811122c64594661e
A recent bug was due to the locale configuration of our nodes. While it is unlikely we'll have that issue again it's still worth logging the locale for future analysis. Change-Id: I25c945b2a1e13fb1012c653f56ecd5c14e320677 Related-Bug: 1560808
'ironic-multitenant-network' job build/delete 2 instances and can't be completed in current TEMPEST_OS_TEST_TIMEOUT 900 sec. This patch allow to pass TEMPEST_OS_TEST_TIMEOUT from the gate job via DEVSTACK_GATE_OS_TEST_TIMEOUT variable to Ironic jobs. If DEVSTACK_GATE_OS_TEST_TIMEOUT is not set, timeout will be configured to current value 900 sec. Change-Id: I3f0833a4d3371846cb67eeb1cfe0946abc3d3772
If the Jenkins Job definition adds items to the PROJECTS variable that are not included as we build up PROJECTS reproduce.sh will ultimately fail. The fix saves the PROJECTS as it is passed into devstack-gate-wrap and includes that in reproduce.sh. Change-Id: Iea45f53b8c26985cb0da9720a631fcf8725522cf Closes-Bug: bug/1544827
Replace the copy of mirror config bash logic for copy_mirror_config role Change-Id: I2fa4a19dd2db1c531c75b3ed14b5f1e4380c70a5
Change-Id: Iaf14c226a3be72a076cc58690bdae8b6b51d6120
Depends-On: Ib17b61641cfeb5f10bf7d01f9b02019fb1e9dbf8 Change-Id: Iec68201755bdb2985c1d1b2fbddc9fdaf82a8864 Signed-off-by: Doug Hellmann <[email protected]>
The newest version of ARA, 0.11, deprecated "ara generate" in favor of "ara generate html". "ara generate" will be removed sometime in the future so let's adjust it right away. Change-Id: I21eab6508b642714770c5a8530bdc98df11ed64c
This provides a more comprehensive merge solution. Change-Id: I9932e3d0a68035b7aee205e037e605a50e5fbae7
setup_localrc was not setting LIBVIRT_TYPE into the subnode localrc file, which means we run multinode (live migration) tests with nested virt using kvm rather than qemu on the subnode and nested virt with kvm has lots of problems, like just crazy random failures. Change-Id: Ifa11d305cb0dfea932ae16108a894d747d78167c Closes-Bug: #1665487
Copy-pasta error, s/ntp/openvswitch Change-Id: I7c2873057c70c808e97efd4fc6174e5445bebb03
Replace the network sanity check bash logic for the network_sanity_check role. This is the last step of replacing the setup_host bash function, thus removing also the function altogether. Change-Id: I8814cf284e572dda66455eea7a10f61037979a9b
There is no such service (as a separate entity) in devstack since at least kilo (probably even earlier). Instead, neutron services are controlled separately by q-* (legacy) or neutron-* (new devstack library module). Change-Id: I69a8866315acce1d192738873939d82bf397b918
There are no such branches for devstack anymore, so keeping the code that supports them in gate doesn't make sense. Change-Id: I2d7b7845b31e860ee9e8b64c581768711fa73a78
We experience unexplained behaviour lately in some gate jobs where oom-killer is triggered while swap is not used. We suspect that it may be because some process mlocked some pages in RAM. This service should hopefully help us to understand if that's the case. Change-Id: Ia5bbc3d5dc405af0417624b92816269775809e1a
This moves the bulk of devstack-gate to local.conf instead of localrc, which makes it so that we can do more interesting and complicated things with the devstack setup. grenade local.conf support Depends-On: I9bf5ac24dc87404e054068d7ed643e0bf0fac311 Change-Id: I111a6df3adc07ed426ac714cb9e64667a63e0e5a
Instead of using devstack bash functions, which are error prone, us dsconf, which is much more tested for setting values in ini and local.conf. Change-Id: I565f5420743fbd95e9d744010c488953c54dd8a4
This adds the support for merging in local_conf from project config into local.conf files deployed in jobs. Change-Id: I81616a5b381fe203aef47628b52371609db5e5eb
This was actually a suggestion on the way to do this originally, and it helps with the fact that we don't have to deal with bash handling of line endings. Change-Id: Ie64b9a20adccdb19352a6cc8fa402acc4c3f5e5b
This commit fixes dstat log file path for stackviz. stackviz has a feature to illustrate a dstat graphs. However it doesn't work because the dstat log path is wrong. Change-Id: I510921cf926fe49065d03c161b0a9735bb772908
During the rebasing we apparently missed ironic for the sublocalrc. This fixes this with the localrc_set calls instead of heredocs. Change-Id: I85d63fadea49096f48406297ec07d2111e5dfe93
This includes a fix that ensures that setlc works correctly if the local.conf file doesn't have a [[local|localrc]] section at all. That was tripping up some existing 3rd party CI systems. Change-Id: I8f855ec627c2a28db755c52ab590fccb8ef55b5d
This information was once collected for gate jobs, but was removed by I916e075d8ed3ee6079e4c4621f6eb10f1d30bf95 rework. Turned out that the info collected by ansible itself does not provide some crucial data, like cpu flags supported by the machine that may become handy when debugging some performance related gate issues. This patch restores collecting the info, using ansible. Change-Id: Icd2bc68eb723ba2f3fc0d8a113fb247bc478121a
The current mechanisms for changing local.conf make it so that they all happen before jobs get running. However projects like neutron do some rather complicated per job configuration that has to happen on top of devstack-gate configs. So expose a way for this to merge late. This does remain a bit error prone because you are unaware of what is being configured in devstack-gate first. It might be better to make local.conf configuration either d-g or project oriented. Change-Id: I53119876b82eeaec19382dbe115cb1740bed0cec
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Rebased from upstream which has moving configurations from localrc to local.conf
reduced the customized commits for XenApi. Now we only have one customized commit.