Project

General

Profile

Testbed » History » Version 2

Anonymous, 01/25/2016 11:48 AM

1 1 Anonymous
h1. Testbed
2
3
h2. The S/PHI/nX testbed
4
5
The S/PHI/nX testbed allows to check for basic functionality of the compiled programs after building. It can be found in the sphinx/testbed folder. Running the testbed requires  GNU make, which is the default make on most Unix systems.
6
7
Setup
8
9
<pre>
10
cd sphinx/testbed
11
./setup
12
./configure --with-sxdir=BUILD/PATH/TO/BE/CHECKED
13
</pre>
14
15
The configure line can be omitted if the build to be checked is ../src (standard S/PHI/nX user build). When debug and release mode have been compiled, typical choices for BUILD/PATH/TO/BE/CHECKED will be ../debug or ../release . 
16 2 Anonymous
17
h2. Running the testbed
18
19
The testbed can be run with
20
21
<pre>
22
make level1 level2
23
</pre>
24
25
On multi-processor machines, parallel make ( make -j N ) is possible; where N is the number of processors. Level 1 checks are typically quick to run. Level 2 checks may be slow, in particular by the debug mode. The two levels can be run independently.
26
27
It is also possible to run individual tests via
28
<pre>
29
make -C TO_BE_TESTED run
30
</pre>
31
32
Reports
33
34
Reports are generated as a set of html pages in the report/ folder via
35
36
<pre>
37
make reports
38
</pre>
39
40
Parallel make is not possible.
41
42
The report can then be viewed with your favorite web browser, e.g.
43
44
<pre>
45
firefox report/index.html
46
</pre>
47
48
Individual test reports are generated via
49
50
<pre>
51
make -C TO_BE_TESTED report
52
</pre>
53
54
The test report will be attached to the end of the report/index.html file. Note that for technical reasons, graphs from previous test failures will be included in the new report if the report/ folder has not been cleaned.