[QA][CI] Have tests running with various deployment setup in CI

[saw-jan]

Currently, we run tests against the ocis server started from a single binary. We want to have a CI setup where we can start multiple instances of a service (as a load balancing) so that we can test against various deployment strategies.

Tasks

• one ocis & 2 storage user services. try to spin it up in drone-ci (without Kubernetes)
• try to run e2e tests on that setup
• check the logs if both services receive requests
  • [tests-only][full-ci] web e2e with multiple storage-users services #10482
• [ ] unskip smoke e2e test suite (see comment) fixed with cors config ([QA][CI] Have tests running with various deployment setup in CI #7614 (comment))

Taken from:

• Concurrent shares test #7363
• https://confluence.owncloud.com/pages/viewpage.action?pageId=58296733

[SagarGi]

@saw-jan This issue needs to be discussed whether to invest time for doing and running such things in drone as it seems to be whole lot of task.

[saw-jan]

Setup with e2e PR: #10482

[saw-jan]

• unskip smoke e2e test suite (see comment)

#10482 (comment)

It's only the problem with drone setup. I can run the upload test and it passes on local docker compose setup (multi-service)

[saw-jan]

I can reproduce the large upload failure with a docker-compose setup.
When running the upload e2e test from the host machine, the test works fine. But if I run the same test from a docker container (this is what drone does) then the large upload test fails.

[saw-jan]

Now I can reproduce it even when running from host machine.

If I use this compose, the large upload test passes. Note OCIS_URL

ocis:
    image: owncloud/ocis-rolling:master
    ports:
      - 9200:9200
    environment:
      OCIS_URL: https://localhost:9200
      ...

Run test with:

BASE_URL_OCIS=localhost:9200 \
HEADLESS=true \
pnpm test:e2e:cucumber tests/e2e/cucumber/features/smoke/uploadResumable.feature

But if I do the following then I cannot upload file larger than 9MB

ocis:
    image: owncloud/ocis-rolling:master
    ports:
      - 9200:9200
    environment:
      OCIS_URL: https://host.docker.internal:9200
      ...
    extra_hosts:
      - host.docker.internal:host-gateway

Run test with:

BASE_URL_OCIS=host.docker.internal:9200 \
HEADLESS=true \
pnpm test:e2e:cucumber tests/e2e/cucumber/features/smoke/uploadResumable.feature

[saw-jan]

I see these logs:

storageusers-2-1  | {"level":"info","service":"storage-users","pkg":"rhttp","traceid":"47503678543d4903986757df053c350c","time":"2024-11-19T10:25:42Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/tus/2da25800-d76b-4257-82e4-18b92c086bb9"}
storageusers-2-1  | {"level":"warn","service":"storage-users","pkg":"rhttp","traceid":"47503678543d4903986757df053c350c","time":"2024-11-19T10:25:42Z","line":"github.com/cs3org/reva/[email protected]/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}

[saw-jan]

And using this cors config made the test pass ( 😵‍💫 ):

OCIS_CORS_ALLOW_ORIGINS: https://host.docker.internal:9200,https://host.docker.internal:9201