Conformance Test Results

Note:
Due to time constraints and pending large changes that would signficantly impact these results, this table has not been updated for the current release of OpenVRML.

About

The NIST VRML Test Suite is not a complete assessment of conformance to the VRML97 specification; it does, however, provide some indication of feature coverage and it can suggest whether a feature is basically in working order.

Assessment protocol

A test is said to pass if and only if it renders completely as intended. This is probably the least subjective means of assessment; however, it means that in some cases a test may fail due to factors unrelated to the feature that was intended to be tested.

Test problems

Several of the tests in the test suite have some kind of problem. In many cases the test is still usable in spite of the problem; in other cases it is not. Instances of the latter case are marked as "invalid" in the result table. An attempt has been made to note problems with the tests in the endnotes following the primary result table.

Summary

Overall

Total Number of Tests796
Total Passed558
Total Failed221
Total Invalid17

By Group

Node GroupTotalPassFailInvalid
Appearance18614442
Bindable Nodes93532713
Geometric Properties533914
Geometry1139815
Grouping Nodes5238113
Interpolators302010
Lights927022
Misc501931
Sensors816120
Sounds28028
Special Groups181611

Summary By Node

NodePassedFailedInvalid
Anchor723
Appearance93
AudioClip019
Background1328
Billboard42
Box60
Color156
ColorInterpolator41
Collision17
Cone80
Coordinate50
CoordinateInterpolator41
Cylinder90
CylinderSensor92
DirectionalLight1810
ElevationGrid95
EXTERNPROTO018
Extrusion134
Fog210
FontStyle331
Group20
ImageTexture304
IndexedFaceSet201
IndexedLineSet91
Inline411
LOD60
Material236
MovieTexture039
NavigationInfo14102
Normal72
NormalInterpolator41
OrientationInterpolator41
PixelTexture98
PlaneSensor113
PointLight245
PointSet41
PositionInterpolator41
PROTO1713
ProximitySensor91
ScalarInterpolator05
Script ECMAScript00
Script Java00
Shape41
Sound09
Sphere60
SphereSensor54
SpotLight287
Switch60
Text102
TextureCoordinate126
TextureTransform34122
TimeSensor127
TouchSensor63
Transform240
Viewpoint10103
VisibilitySensor90
WorldInfo20


Results

Node GroupNodeTest
Number
ResultRelated TasksRelated Bugs
AppearanceAppearance1+
2+
3+
4+
5+
6+
7+
8+
9+
10-464211
11-
12-
FontStyle 1 + 24095 211349
2+ 24095 211349
3 - 24095 211349, 933104
4 - 24095 211349, 933106
5 + 24095 211349
6 - 24095 211349, 933108
7x1
ImageTexture1+
2+
3+
4+
5+
6+
7+
8+
9+
10+
11+
12 - 933532
13 - 933535
14+
15+
16+
17+
18+
19 - 933532
20 - 933535
21+
22+
23+
24+
25+
26+
27+
28+
29+
30+
31+
32+
33+
34+
Material1+
2+
3+
4+
5+
6+
7+
8+
9+
10+
11 - 464265
12 - 464265
13+
14+
15+
16+
17 + 211349
18+
19+
20 - 18753 213951
21 - 18753 213951
22+
23+
24+
25+
26+
27+
28 - 18753 213951
29 - 18753 213951
MovieTexture 1 - 964744, 964745
2 - 964744, 964745
3 - 964744, 964745
4 - 964744, 964745
5 - 964744, 964745
6 - 964744, 964745
7 - 964744, 964745
8 - 964744, 964745
9 - 964744, 964745
10 - 964744, 964745
11 - 964744, 964745
12 - 964744, 964745
13 - 964744, 964745
14 - 964744, 964745
15 - 964744, 964745
16 - 964744, 964745
17 - 964744, 964745
18 -2 964744, 964745
19 - 964744, 964745
20 - 964744, 964745
21 - 964744, 964745
22 - 964744, 964745
23 - 964744, 964745
24 - 964744, 964745
25 - 964744, 964745
26 -2 964744, 964745
27 -2 964744, 964745
28-2 964744, 964745
29-2 964744, 964745
30-2 964744, 964745
31-2 964744, 964745
32- 964744, 964745
33- 964744, 964745
34- 964744, 964745
35- 964744, 964745
36- 964744, 964745
37- 964744, 964745
38- 964744, 964745
39- 964744, 964745
PixelTexture1+
2+
3+
4 - 466479
5+
6 - 466484
7-
8 - 466484
9 - 466484
10+
11 - 933532
12-
13+
14-
15+
16+
17+
TextureTransform1+
2+
3+
4+
5+
6+
7+
8+
9+
10+
11+
12+
13 - 965478
14 - 965478
15+
16+
17+
18+
19+3
20+
21+
22+
23+
24+
25+
26+
27+
28+
29 - 965478
30 - 965478
31+
32-
33+
34+
35+
36 - 466484
37 - 466484
38+
39 - 466484
40+
41x4
42+
43x5
44+6
45 - 965478
46 - 965478
47 - 466484
48 - 466484
Bindable Nodes Background 1+
2+
3x7
4+
5-
6+
7+
8 + 210070
9 + 210070
10 + 210070
11 + 210070
12 + 210070
13 + 210070
14 - 210070
15x8
16x8
17x8
18x8
19x8
20x8
21x8
22+
23+
Fog1+
2+
3+
4+
5+
6+
7+
8+
9+
10+
11+
12+
13+
14+
15+
16+
17+
18+
19+
20+
21+
NavigationInfo 1 - 18156 211327
2+
3+
4+
5+
6-
7+2
8+
9x9
10-
11-
12 - 18156 211327
13 - 18156 211327
14 - 18156 211327
15+
16+10
17 - 18156 211327
18x11
19 - 626197
20-
21+
22+
23+
24+
25+
26+
Viewpoint1+
2-12
3-
4-
5+
6+
7x1
8x13
9x13
10-
11-
12-
13-
14-14
15-
16-
17+
18+
19+
20+
21+
22+
23+
Geometric PropertiesColor1+
2+
3+
4-
5+
6+
7-
8+
9+
10+
11-
12+
13+
14-
15+
16+
17+
18-
19+
20+
21-
Coordinate1+
2+
3+
4+
5+
Normal1+
2-
3+
4+
5+
6-
7+
8+
9+
TextureCoordinate1+
2+
3+
4+2
5+2
6+2
7+
8-
9-
10+
11+
12+
13+
14+
15+
16-
17-
18-
GeometryBox1+
2+
3+
4+
5+
6+
Cone1+
2+
3+
4+
5+
6+
7+
8+
Cylinder1+
2+
3+
4+
5+
6+
7+
8+
9+
ElevationGrid1+
2+
3+
4+
5-
6-
7-
8-
9+
10+
11+
12+
13+
14+
Extrusion1+
2+
3+
4+
5+
6+
7-
8+
9+
10+
11+
12+
13-
14-
15-
16+
17+
IndexedFaceSet1+
2+
3+
4+
5+
6+15
7+
8+
9+
10+
11+
12+
13+
14-
15+
16+
17+16
18+16
19+
20+
21+
IndexedLineSet1+
2-
3+
4+
5+
6+
7+
8+
9+
10+
PointSet1+
2+
3+
4+
5-
Shape1+
2+
3+
4+
5-
Sphere1+
2+
3+
4+
5+
6+
Text1+
2+2
3+
4+
5+
6+
7+
8-2
9+
10+17
11+
12-
Grouping NodesAnchor1+
2+
3-
4+
5+
6x18
7x19
8+
9-
10x20
11+
12+
Billboard1+
2+
3+
4-
5+
6-
Collision1-
2+
3-
4-
5-
6-
7-
8-
Group1+
2+
Transform1+
2+
3+
4+
5+
6+
7+
8+
9+
10+
11+
12+
13+
14+
15+
16+
17+
18+
19+
20+
21+
22+
23+
24+
InterpolatorsColorInterpolator1+
2+
3+
4-
5+
CoordinateInterpolator1+
2+
3+
4-
5+
NormalInterpolator1+
2+
3+
4-
5+
OrientationInterpolator1+
2+
3+
4-
5+
PositionInterpolator1+
2+
3+
4-
5+
ScalarInterpolator1-
2-
3-
4-
5-
LightsDirectionalLight1+
2+
3+
4+
5+
6+
7-
8+
9+
10+
11-
12-
13-
14-
15-
16-
17-
18-
19-
20+
21+
22+
23+
24+
25+
26+
27+
28+
PointLight1+
2+
3-
4+
5+
6+
7+
8+
9+
10+
11+
12+
13+
14-
15-
16+
17+
18+
19+
20+
21+
22+
23+
24+
25+
26+
27+
28-
29-
SpotLight1+
2+
3-
4+
5+
6+
7+
8+
9+
10+
11+
12+
13+
14+
15+
16-
17-
18+
19+
20+
21+
22+
23+
24+
25+
26+
27+
28+
29+
30-
31-
32+
33+
34-
35-
MiscEXTERNPROTO1-
2-
3-
4-
5-
6-
7-
8-
9-
10-
11-
12-
13-
14-
15-
16-
17-
18-
PROTO1+
2+
3+
4+
5+
6+
7A-21
7B-21
7C-21
7D-21
7E+21
7F-21
7G+21
7H+21
7I-21
7J-21
7K-21
8+
9-
10+
11+
12-
13+
14+
15-
16+
17+
18+
19-
20-
Script ECMAScript
Script Java
WorldInfo1+
2+
SensorsCylinderSensor1+
2+
3-
4+
5+
6+
7+
8+
9+
10-
11+
PlaneSensor1+
2+
3+
4+
5+
6+
7+
8+
9+
10-
11-
12+
13+
14-
ProximitySensor1+
2+
3+
4+
5-
6+
7+
8+
9+
10+
SphereSensor1+
2-
3-
4-
5-
6+
7+
8+
9+
TimeSensor1-
2+
3-
4+
5-
6-
7+
8-
9-
10+
11+
12-
13+
14+
15+
16+
17+
18+
19+
TouchSensor1+
2+
3+
4+
5-
6-
7-
8+
9+
VisibilitySensor1+
2+
3+
4+
5+
6+
7+
8+
9+
SoundsAudioClip1-
2-
3-
4-
5-
6-
7-
8-
9-
10-
11-
12-
13-
14-
15-
16-
17-
18-
19-
Sound1-
2-
3-
4-
5-
6-
7-
8-
9-
Special GroupsInline1+
2+
3-
4x22
5+
6+
LOD1+
2+
3+
4+
5+2
6+
Switch1+
2+
3+
4+
5+
6+

1 There are syntax errors (quoting problems) with the vrmlstring used in the script code.

2 No expected results.

3 Rear view picture missing in expected results.

4 Test file has a syntax error: multiple definitions for "textureTransform" field. Also, expected results for the bottom view are incorrect.

5 Test file has a syntax error: multiple definitions for "textureTransform" field. Expected results for top and bottom view are incorrect.

6 Expected results incorrect for top, bottom, left and right views.

7 Comments for world state, "THE SECOND BACKGROUND IS NOT FORCED TO BE THE ACTIVE BACKGROUND BY SENDING A TRUE EVENT TO IT, BUT BY SENDING A FALSE EVENT TO THE BACKGROUND AT THE TOP OF THE STACK." The problem is that the second background should never be bound unless a true event is sent to it as only the first background is bound by default. See comments on Bug 210036 in SourceForge for more information.

8 PNG missing on server.

9 Test is for NavigationInfo node but there is no NavigationInfo node in the world! Comments for test indicate there should be one that sets the speed to 1 (comments also indicate there should be a Viewpoint node in the world too but that's also missing!)

10 Test description indicates that there should be text displayed in the upper corner of the world but the expected results do not show this text.

11 url field of anchor should be "#Top_View" not "Top_View".

12 Test description erroneously states the expected position to be 0 0 -1. It should be 0 0 -10.

13 url field of anchor should be "#Top_View" not "Top_View". (Comment at top of test even says this is what the url should be!)

14 The test description indicates that the text at the top of the world should indicate right viewpoint is bound when mouse is over the box. However, sample output shows front viewpoint still bound.

15 Expected results are incorrect for rear view. Should be green on left and red on right.

16 Expected results are incorrect. Rear view should match front view.

17 Text is placed behind avatar for some reason so it cannot be seen unless you back up first. Transform should be changed to use a negative Z-val.

18 url field of anchor should be "#view2" not "view2".

19 url field of anchor should be "#view3" not "view3".

20 url field is hardcoded to point at an older location of the NIST VTS (autumn.ncsl.nist.gov) which refuses requests.

21 "Next test" text in each world points at a non-existent CGI script at http://xsun.sdct.itl.nist.gov/~mkass/vts/html/write_list.cgi.

22 URL points to old server http://autumn.ncsl.nist.gov which no longer allows access. World should be updated to point at the current location of the NIST tests.