Adds tests according to the CI wiki [0] specifically the standard test interface in the spec [1].
The playbook includes Tier1 level test cases that have been tested in the following contexts and is passing reliably on Fedora Rawhide: Atomic Host, Docker, and Classic.
Test logs are stored in the Artifacts directory.
The following steps are used to execute the tests using the standard test interface:
TASK [standard-test-beakerlib : Make the master test summary log artifact] *
changed: [4db247a841a29d03d4fec3aeaf54b9648439064609996b7852a0c1e597b2f774] => (item=gettext-tests)
TASK [standard-test-beakerlib : Pull out the logs] *****
changed: [4db247a841a29d03d4fec3aeaf54b9648439064609996b7852a0c1e597b2f774]
TASK [standard-test-beakerlib : Check the results] *****
changed: [4db247a841a29d03d4fec3aeaf54b9648439064609996b7852a0c1e597b2f774]
PLAY RECAP ***********
4db247a841a29d03d4fec3aeaf54b9648439064609996b7852a0c1e597b2f774 : ok=16 changed=11 unreachable=0 failed=0
Adds tests according to the CI wiki [0] specifically the standard test interface in the spec [1].
The playbook includes Tier1 level test cases that have been tested in the following contexts and is passing reliably on Fedora Rawhide: Atomic Host, Docker, and Classic.
Test logs are stored in the Artifacts directory.
The following steps are used to execute the tests using the standard test interface:
Atomic
sudo ANSIBLE_INVENTORY=$(test -e inventory && echo inventory || echo /usr/share/ansible/inventory) TEST_SUBJECTS=../atomic.qcow2 TEST_ARTIFACTS=$PWD/artifacts ansible-playbook --tags atomic tests.yml
Docker
sudo ANSIBLE_INVENTORY=$(test -e inventory && echo inventory || echo /usr/share/ansible/inventory) TEST_SUBJECTS=docker:docker.io/library/fedora:rawhide TEST_ARTIFACTS=$PWD/artifacts ansible-playbook --tags container tests.yml
Classic
sudo ANSIBLE_INVENTORY=$(test -e inventory && echo inventory || echo /usr/share/ansible/inventory) TEST_SUBJECTS="" TEST_ARTIFACTS=$PWD/artifacts ansible-playbook --tags classic tests.yml
[0] https://fedoraproject.org/wiki/CI
[1] https://fedoraproject.org/wiki/Changes/InvokingTests
Test Logs: (If you you would like a pointer to the complete log, I can include that as well)
Atomic
<snip>
TASK [standard-test-beakerlib : Execute beakerlib tests] *****
changed: [../atomic.qcow2] => (item=gettext-tests)
TASK [standard-test-beakerlib : Make the master test summary log artifact] *
changed: [../atomic.qcow2] => (item=gettext-tests)
TASK [standard-test-beakerlib : Pull out the logs] *****
changed: [../atomic.qcow2]
TASK [standard-test-beakerlib : Check the results] *****
changed: [../atomic.qcow2]
PLAY [localhost] *********
TASK [Gathering Facts] *********
ok: [../atomic.qcow2]
PLAY RECAP ***********
../atomic.qcow2 : ok=14 changed=9 unreachable=0 failed=0
Test results:
PASS gettext-tests
Docker
<snip>
TASK [standard-test-beakerlib : Execute beakerlib tests] *****
changed: [4db247a841a29d03d4fec3aeaf54b9648439064609996b7852a0c1e597b2f774] => (item=gettext-tests)
TASK [standard-test-beakerlib : Make the master test summary log artifact] *
changed: [4db247a841a29d03d4fec3aeaf54b9648439064609996b7852a0c1e597b2f774] => (item=gettext-tests)
TASK [standard-test-beakerlib : Pull out the logs] *****
changed: [4db247a841a29d03d4fec3aeaf54b9648439064609996b7852a0c1e597b2f774]
TASK [standard-test-beakerlib : Check the results] *****
changed: [4db247a841a29d03d4fec3aeaf54b9648439064609996b7852a0c1e597b2f774]
PLAY RECAP ***********
4db247a841a29d03d4fec3aeaf54b9648439064609996b7852a0c1e597b2f774 : ok=16 changed=11 unreachable=0 failed=0
Test results:
PASS gettext-tests
Classic
<snip>
==> default: TASK [standard-test-beakerlib : Execute beakerlib tests] ***
==> default: changed: [localhost] => (item=gettext-tests)
==> default:
==> default: TASK [standard-test-beakerlib : Make the master test summary log artifact] *
==> default: changed: [localhost] => (item=gettext-tests)
==> default:
==> default: TASK [standard-test-beakerlib : Pull out the logs] *****
==> default: changed: [localhost]
==> default:
==> default: TASK [standard-test-beakerlib : Check the results] *****
==> default: changed: [localhost]
==> default:
==> default: PLAY RECAP ***********
==> default: localhost : ok=16 changed=11 unreachable=0 failed=0
==> default: ++ '[' 0 -ne 0 ']'
==> default: ++ cat /root/gettext/artifacts/test.log
==> default: PASS gettext-tests