Script for running integtests in whichever repos the user specifies#290
Script for running integtests in whichever repos the user specifies#290bieryAtFnal merged 23 commits intodevelopfrom
Conversation
…revented the printout of the pytest duration summary when running integtests from the base release
…n a couple of long options; added some echo statements to give feedback to the user on what is happening.
Expanded the documentation for integtest scripts, including detailed usage information for each script's help command.
Expanded the documentation for integtest scripts to include detailed usage instructions and examples for each script.
Added examples of using the list_repos_with_integtests.sh script to find repositories with integration tests.
Added usage example for list_repos_with_integtests.sh script and removed redundant section.
…users when directories from failed tests get cleaned up.
…ges in list_repos_with_integtests.sh to only almalinux9 ones
|
I've played around with this and I think it looks great. The only thing I'd suggest is to provide a link to the script-specific page from the main page ( |
|
@jcfreeman2 , as you suggested, I have updated the top-level README.md file and the README.md file in the |
|
@bieryAtFnal I think it's great that not only did you provide the link but you overhauled the antiquated documentation. Approved, with one quibble, which is that the link to the OKS XML file should be changed to: ...since otherwise the link will be broken in https://dune-daq-sw.readthedocs.io/en/latest/packages/daqsystemtest |
jcfreeman2
left a comment
There was a problem hiding this comment.
Approved; see my earlier comments in this PR for details.
|
Thanks, @jcfreeman2 - great catch on that bad link. |
Description
In recent discussions about the running of integtests (regression tests and integration tests), people (including me) mentioned several requests for enhancements. Those included the following:
This changes covered by this PR attempt to meet that need. A global bundle script named
dunedaq_integtest_bundle.shhas been created and a couple of utility scripts for finding repos with integtests and listing the integtests in a given repo are included.A markdown document has been created in the
docssubdirectory of this repo with an introduction to these new scripts. Please refer to that document for instructions on how to use the scripts.Testing of these changes would include running various combinations of integtests using the
dunedaq_integtest_bundle.shscript and specifying different command-line options to customize the behavior of the script.To get access to these scripts before they are merged to the
developbranch ofdaqsystemtest, users should include thekbiery/global_bundle_scriptbranch ofdaqsystemtestin their local software area(s) and rebuild the software area to get the scripts copied into the appropriatebinareas.Please note that some of the command-line options that were available in the older
daqsystemtest_integtest_bundle.shscript have not been carried forward to the new global bundle script. For example, ones that specify the Nth thru Mth tests to be run. That functionality became less useful in the global bundle script since the list of tests to be run is much more dynamic with that script.Type of change
Testing checklist
pytest -s minimal_system_quick_test.py)dunedaq_integtest_bundle.sh)