Failing tests on offline nodes

[laraPPr]

The following test are failing on MareNostrum because it is trying to download some files but than fail. Is their a way we can already work around this or should we change the tests.

QuantumEspresso:

Error in routine readpp (1):
file ./Si.pbe-n-kjpaw_psl.1.0.0.UPF not found

Gromacs:

Invalid command-line options
  In command-line option -s
    File 'benchmark.tpr' does not exist or is not accessible.
    The file could not be opened.
      Reason: No such file or directory
      (call to fopen() returned error code 2)

Metalwalls:

curl: (7) Failed to connect to gitlab.com port 443 after 18 ms: Couldn't connect to server

TensoFlow:

Downloading data from https://storage.googleapis.com/tensorflow/tf-keras-datasets/mnist.npz

[laraPPr]

Possible solution to avoid having to ship all these files in the test-suite:

create a new keyword that we can then put some logic on in EESSI_Mixin to decide if we actually download the files, or read them from e.g. resourcesdir?

[smoors]

create a new keyword that we can then put some logic on in EESSI_Mixin to decide if we actually download the files, or read them from e.g. resourcesdir?

maybe we can download the files into the resourcesdir before submitting the jobs, e.g. in a @run_after('init') hook. this would also avoid that each test job has to download its own copy of the files.

in any case we'll have to make changes to the hpctestlib for QE, metalwalls and gromacs, and push those upstream or fork them into our test-suite.

[laraPPr]

• Make sure TensorFlow also works on offline machines #275

[laraPPr]

@Crivella Just had a look at QuantumESPRESSO and there the wget command is being set in hpctestlib. Should we change it upstream I know you added it there. For GROMACS will have to the same I guess. Or so you have an to make it use the file in the specific dir like the changes I now proposed in the TensorFlow pr.

[laraPPr]

Ok so MetalWalls is also an hpctestlib test. We could skip them on ofline nodes? @casparvl

[laraPPr]

reframe-hpc/reframe#3524 let's see what the ReFrame developers say

[laraPPr]

Pr for skipping all the tests that require a download

• skip tests which require internet access on offline machines #279