Testbed » History » Version 2
Anonymous, 01/25/2016 11:48 AM
1 | 1 | Anonymous | h1. Testbed |
---|---|---|---|
2 | |||
3 | h2. The S/PHI/nX testbed |
||
4 | |||
5 | The S/PHI/nX testbed allows to check for basic functionality of the compiled programs after building. It can be found in the sphinx/testbed folder. Running the testbed requires GNU make, which is the default make on most Unix systems. |
||
6 | |||
7 | Setup |
||
8 | |||
9 | <pre> |
||
10 | cd sphinx/testbed |
||
11 | ./setup |
||
12 | ./configure --with-sxdir=BUILD/PATH/TO/BE/CHECKED |
||
13 | </pre> |
||
14 | |||
15 | The configure line can be omitted if the build to be checked is ../src (standard S/PHI/nX user build). When debug and release mode have been compiled, typical choices for BUILD/PATH/TO/BE/CHECKED will be ../debug or ../release . |
||
16 | 2 | Anonymous | |
17 | h2. Running the testbed |
||
18 | |||
19 | The testbed can be run with |
||
20 | |||
21 | <pre> |
||
22 | make level1 level2 |
||
23 | </pre> |
||
24 | |||
25 | On multi-processor machines, parallel make ( make -j N ) is possible; where N is the number of processors. Level 1 checks are typically quick to run. Level 2 checks may be slow, in particular by the debug mode. The two levels can be run independently. |
||
26 | |||
27 | It is also possible to run individual tests via |
||
28 | <pre> |
||
29 | make -C TO_BE_TESTED run |
||
30 | </pre> |
||
31 | |||
32 | Reports |
||
33 | |||
34 | Reports are generated as a set of html pages in the report/ folder via |
||
35 | |||
36 | <pre> |
||
37 | make reports |
||
38 | </pre> |
||
39 | |||
40 | Parallel make is not possible. |
||
41 | |||
42 | The report can then be viewed with your favorite web browser, e.g. |
||
43 | |||
44 | <pre> |
||
45 | firefox report/index.html |
||
46 | </pre> |
||
47 | |||
48 | Individual test reports are generated via |
||
49 | |||
50 | <pre> |
||
51 | make -C TO_BE_TESTED report |
||
52 | </pre> |
||
53 | |||
54 | The test report will be attached to the end of the report/index.html file. Note that for technical reasons, graphs from previous test failures will be included in the new report if the report/ folder has not been cleaned. |