Skip to content

Add Workflows for generating reference results #410

Merged
valentin-seitz merged 20 commits into
developfrom
add-wf-reference-results
Dec 14, 2023
Merged

Add Workflows for generating reference results #410
valentin-seitz merged 20 commits into
developfrom
add-wf-reference-results

Conversation

@valentin-seitz

@valentin-seitz valentin-seitz commented Nov 28, 2023

Copy link
Copy Markdown
Contributor

This PR adds a reusable workflow to automagically add reference results to a certain branch.
It can be either be triggered manual or another trigger can be used to trigger the reusable workflow (e.g on creation of PR of a certain form)

It also adds more information on the machine (Still open to discussion if we acually need it). But especially the CPU ISA Extensions like AVX-512 etc are of importance.

The Pipeline now runs and is able to add commits: https://github.com/precice/tutorials/actions/runs/7181615150

@valentin-seitz valentin-seitz self-assigned this Nov 28, 2023
@valentin-seitz valentin-seitz linked an issue Nov 28, 2023 that may be closed by this pull request
@valentin-seitz valentin-seitz force-pushed the add-wf-reference-results branch from fab8197 to 32db06e Compare December 12, 2023 12:43
@valentin-seitz valentin-seitz marked this pull request as ready for review December 12, 2023 15:44
@valentin-seitz valentin-seitz force-pushed the add-wf-reference-results branch from cfcfa7e to 32db06e Compare December 12, 2023 15:47
@valentin-seitz

Copy link
Copy Markdown
Contributor Author

This PR is now ready.
The CI/CD Pipeline works as expected (see: https://github.com/precice/tutorials/actions/runs/7181615150)
After #420 is merged, i will rebase and then the tests should go through so we can merge.

@valentin-seitz valentin-seitz force-pushed the add-wf-reference-results branch from 32db06e to 1011c9d Compare December 12, 2023 17:00
valentin-seitz and others added 2 commits December 12, 2023 22:59
Co-authored-by: Valentin Seitz <valentin.seitz@tum.de>
* remove non working gha cache stuff

* Move to only commits in the dockerfile

---------

Co-authored-by: Valentin Seitz <valentin.seitz@tum.de>
@valentin-seitz valentin-seitz changed the title Add Workflows for generating reference results Add Workflows for generating reference results || Allow commits-ish things to be specified as arguments Dec 13, 2023
@valentin-seitz valentin-seitz changed the title Add Workflows for generating reference results || Allow commits-ish things to be specified as arguments Add Workflows for generating reference results Dec 13, 2023
@valentin-seitz

Copy link
Copy Markdown
Contributor Author

I also added small changes to the Dockerfile to allow for commit-ish things to be requested.

@MakisH MakisH left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The implementation looks very nice!
Some comments to consider, feel free to merge afterwards.

Comment thread flow-over-heated-plate/reference_results.metadata
Comment thread tools/tests/README.md Outdated
Comment thread tools/tests/README.md
Comment thread tools/tests/README.md
Comment thread tools/tests/README.md Outdated
Comment thread tools/tests/systemtests/Systemtest.py Outdated
Comment thread tools/tests/systemtests/Systemtest.py Outdated
Comment thread tools/tests/component-templates/openfoam-adapter.yaml
Comment thread .github/workflows/generate_reference_results_workflow.yml
Comment thread .github/workflows/generate_reference_results_workflow.yml
@MakisH

MakisH commented Dec 14, 2023

Copy link
Copy Markdown
Member

Closes #405.

This is related to #401 (git hash reporting) by requiring (only via documentation) specific Git commit or tag (not branches, which can change over time) when generating reference results. I would still feel safer if I had a dump of all hashes in one log file, but I remember from our last meeting that this is complicated due to the current architecture. I assume it still creates the same report for the current/tested results. So, yes, it closes #401 as well.

Regarding #400 (contents of the archive):

  • reference_data is renamed to reference-results
  • TUTORIALS_REF is included in the report
  • I have not checked what the actual contents are, because I don't have an archive readily available, but I still believe it closes Contents of the system tests archive #400.

valentin-seitz and others added 2 commits December 14, 2023 14:44
Co-authored-by: Gerasimos Chourdakis <chourdak@in.tum.de>
Co-authored-by: Gerasimos Chourdakis <chourdak@in.tum.de>
@valentin-seitz valentin-seitz merged commit 1f7afd1 into develop Dec 14, 2023
@MakisH MakisH deleted the add-wf-reference-results branch December 14, 2023 20:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

No open projects
Status: Done

Development

Successfully merging this pull request may close these issues.

Trigger generation of systemtests reference _results

2 participants