Skip to content

Commit 1f7afd1

Browse files
valentin-seitzValentin SeitzpreCICE Tests VMMakisH
authored
Add Workflows for generating reference results (#410)
* add machine info to reference results * rename script to unify naming * add workflows * make autopep happy and trigger wf once :) * made wf callable * remove push trigger * added some switch case to check for the different names until changes propagate * Fix non terminating timeouts (#421) Co-authored-by: Valentin Seitz <valentin.seitz@tum.de> * Systests/move to commits (#422) * remove non working gha cache stuff * Move to only commits in the dockerfile --------- Co-authored-by: Valentin Seitz <valentin.seitz@tum.de> * adopt new naming schema * filter lscpu to hide vulnerabilities * move to consistent naming schema * Adding reference results from precice-tests vm * Make autopep8 * make paths a bit nicer and easier to understand * Update tools/tests/README.md Co-authored-by: Gerasimos Chourdakis <chourdak@in.tum.de> * Update tools/tests/README.md Co-authored-by: Gerasimos Chourdakis <chourdak@in.tum.de> * introduce variable instead of magic number 10 * added comment on very long rm instructions --------- Co-authored-by: Valentin Seitz <valentin.seitz@tum.de> Co-authored-by: preCICE Tests VM <tests@precice.org> Co-authored-by: Gerasimos Chourdakis <chourdak@in.tum.de>
1 parent 622caf7 commit 1f7afd1

23 files changed

Lines changed: 277 additions & 75 deletions

‎.github/workflows/generate_reference_results_manual.yml‎

Lines changed: 31 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,31 @@
1+
name: Generate reference results (manual)
2+
on:
3+
workflow_dispatch:
4+
inputs:
5+
from_ref:
6+
description: 'Use the systemtests + tutorial metadata + reference_version from this ref'
7+
required: true
8+
type: string
9+
commit_msg:
10+
description: 'Commit msg for commit that adds the reference results'
11+
default: "Adding reference results"
12+
type: string
13+
loglevel:
14+
description: 'loglevel used for the systemtests'
15+
default: 'INFO'
16+
required: true
17+
type: choice
18+
options:
19+
- 'DEBUG'
20+
- 'INFO'
21+
- 'WARNING'
22+
- 'ERROR'
23+
- 'CRITICAL'
24+
25+
jobs:
26+
generate_reference_results_manual:
27+
uses: ./.github/workflows/generate_reference_results_workflow.yml
28+
with:
29+
from_ref: ${{ inputs.from_ref }}
30+
commit_msg: ${{ inputs.commit_msg }}
31+
loglevel: ${{ inputs.loglevel }}

‎.github/workflows/generate_reference_results_workflow.yml‎

Lines changed: 71 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,71 @@
1+
name: Generate reference results workflow
2+
on:
3+
workflow_call:
4+
inputs:
5+
from_ref:
6+
description: 'Use the systemtests + tutorial metadata + reference_version from this ref'
7+
required: true
8+
type: string
9+
commit_msg:
10+
description: 'Commit msg for commit that adds the reference results'
11+
default: "Adding reference results"
12+
type: string
13+
loglevel:
14+
description: 'loglevel used for the systemtests'
15+
default: 'INFO'
16+
required: true
17+
type: string
18+
jobs:
19+
generate_reference_results:
20+
runs-on: [self-hosted, linux, x64, precice-tests-vm]
21+
steps:
22+
- name: Display a quick job summary
23+
run: |
24+
echo "Initiated by: ${{ github.actor }}"
25+
echo "Running generate_reference_results.py --log-level ${{inputs.loglevel}}"
26+
echo "Using Ref: ${{ inputs.from_ref }}"
27+
echo "Commit message on success: ${{ inputs.commit_msg }}"
28+
- name: Move LFS URL to local LFS server
29+
run: |
30+
/home/precice/runners_root/scripts/make_lfs_local.sh
31+
- name: 'Cleanup the folder'
32+
# The first rf -rf ./* removes all non hidden files
33+
# The second rf -rf ./.??* removes all hidden files (but not . and ..)
34+
run: |
35+
ls -la ./
36+
rm -rf ./*
37+
rm -rf ./.??*
38+
ls -la ./
39+
- name: Check out Tutorials for systest
40+
uses: actions/checkout@v4
41+
with:
42+
ref: ${{ inputs.from_ref }}
43+
lfs: true
44+
fetch-depth: 0
45+
- name: Install Python dependencies
46+
run: |
47+
pip install --user -r tools/tests/requirements.txt
48+
- name: Run tests
49+
run: |
50+
cd tools/tests
51+
test -f generate_reference_results.py && export GENERATE_REF_RESULTS=generate_reference_results.py
52+
test -f generate_reference_data.py && export GENERATE_REF_RESULTS=generate_reference_data.py
53+
echo "Selected $GENERATE_REF_RESULTS to run"
54+
python $GENERATE_REF_RESULTS --log-level=${{inputs.loglevel}}
55+
cd ../../
56+
- name: Create commit
57+
if: success()
58+
run: |
59+
git checkout ${{ inputs.from_ref }}
60+
git add ./*/*/*.tar.gz
61+
git add ./*/*.tar.gz
62+
git add ./*/*.metadata
63+
git commit -m "${{inputs.commit_msg}}"
64+
git push
65+
- name: Upload artifacts for debugging
66+
if: failure()
67+
uses: actions/upload-artifact@v3
68+
with:
69+
name: runs
70+
path: |
71+
runs/*

‎flow-over-heated-plate/reference-data/fluid-openfoam_solid-fenics.tar.gz‎

Lines changed: 0 additions & 3 deletions
This file was deleted.

‎flow-over-heated-plate/reference-data/fluid-openfoam_solid-nutils.tar.gz‎

Lines changed: 0 additions & 3 deletions
This file was deleted.

‎flow-over-heated-plate/reference-data/fluid-openfoam_solid-openfoam.tar.gz‎

Lines changed: 0 additions & 3 deletions
This file was deleted.

‎flow-over-heated-plate/reference-results/fluid-openfoam_solid-fenics.tar.gz‎

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
version https://git-lfs.github.com/spec/v1
2+
oid sha256:65d4c461e3f6167846730de14b0778b004a02f2db740f2c263aee4e2bd8b86a6
3+
size 778312

‎flow-over-heated-plate/reference-results/fluid-openfoam_solid-nutils.tar.gz‎

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
version https://git-lfs.github.com/spec/v1
2+
oid sha256:7d790bf8a032b1f155699b5a63287124be202d45bcb59cab9b320c3fef86ba56
3+
size 533210

‎flow-over-heated-plate/reference-results/fluid-openfoam_solid-openfoam.tar.gz‎

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
version https://git-lfs.github.com/spec/v1
2+
oid sha256:2ab9f3f762beec987e0a90ce99e5e3b85f406e4738599fd4b1ad68942ed7f516
3+
size 498933

‎flow-over-heated-plate/reference_results.metadata‎

Lines changed: 37 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -5,14 +5,15 @@ This File has been generated by the generate_reference_results.py and should not
55
# Reference Results
66

77
This file contains an overview of the results over the reference results as well as the arguments used to generate them.
8+
We also include some information on the machine used to generate them
89

910
## List of files
1011

1112
| name | time | sha256 |
1213
|------|------|-------|
13-
| fluid-openfoam_solid-nutils.tar.gz | 2023-09-04 23:41:09 | 8b3157902d3ad78593c5471a3a94dd5559fe6970e4cb54658b22ffd270c00297 |
14-
| fluid-openfoam_solid-fenics.tar.gz | 2023-09-04 23:41:09 | 2565ffc51c8d80fab06ccdda33f62efceb6cdc03318998f5adc9ed0ac84acac2 |
15-
| fluid-openfoam_solid-openfoam.tar.gz | 2023-09-04 23:41:09 | c29989e0118ade759e7313330aa8d3d900c660c404eaacd529e979aae6b899c7 |
14+
| fluid-openfoam_solid-nutils.tar.gz | 2023-12-13 22:22:18 | 7d790bf8a032b1f155699b5a63287124be202d45bcb59cab9b320c3fef86ba56 |
15+
| fluid-openfoam_solid-fenics.tar.gz | 2023-12-13 22:22:18 | 65d4c461e3f6167846730de14b0778b004a02f2db740f2c263aee4e2bd8b86a6 |
16+
| fluid-openfoam_solid-openfoam.tar.gz | 2023-12-13 22:22:18 | 2ab9f3f762beec987e0a90ce99e5e3b85f406e4738599fd4b1ad68942ed7f516 |
1617

1718
## List of arguments used to generate the files
1819

@@ -27,3 +28,36 @@ This file contains an overview of the results over the reference results as well
2728
| PLATFORM | ubuntu_2204 |
2829
| CALULIX_VERSION | 2.20 |
2930
| CALULIX_ADAPTER_REF | v2.20.0 |
31+
## Information about the machine
32+
33+
### uname -a
34+
35+
Linux precice-tests 5.15.0-89-generic #99-Ubuntu SMP Mon Oct 30 20:42:41 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
36+
37+
38+
### lscpu
39+
40+
Architecture: x86_64
41+
CPU op-mode(s): 32-bit, 64-bit
42+
Address sizes: 45 bits physical, 48 bits virtual
43+
Byte Order: Little Endian
44+
CPU(s): 4
45+
On-line CPU(s) list: 0-3
46+
Vendor ID: GenuineIntel
47+
Model name: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz
48+
CPU family: 6
49+
Model: 85
50+
Thread(s) per core: 1
51+
Core(s) per socket: 1
52+
Socket(s): 4
53+
Stepping: 4
54+
BogoMIPS: 4199.99
55+
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon nopl xtopology tsc_reliable nonstop_tsc cpuid tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti ssbd ibrs ibpb stibp fsgsbase tsc_adjust bmi1 avx2 smep bmi2 invpcid avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves arat pku ospke md_clear flush_l1d arch_capabilities
56+
Hypervisor vendor: VMware
57+
Virtualization type: full
58+
L1d cache: 128 KiB (4 instances)
59+
L1i cache: 128 KiB (4 instances)
60+
L2 cache: 4 MiB (4 instances)
61+
L3 cache: 88 MiB (4 instances)
62+
NUMA node(s): 1
63+
NUMA node0 CPU(s): 0-3

‎perpendicular-flap/reference-data/fluid-openfoam_solid-calculix.tar.gz‎

Lines changed: 0 additions & 3 deletions
This file was deleted.

0 commit comments

Comments
 (0)