Derby 10.3.3.0 RC - summary testreport

Release candidate 10.3.3.0 was created 2008-05-03 (svn revision 652961) and testing was started 2008-05-05.

Testing was done on the following JVMs.

Jvm1.4

Suites.All

derbyall


Jvm1.5

Suites.All

derbyall


Jvm1.6

Suites.All

derbyall


Jvm1.6-64

Suites.All

derbyall

compatibility



Results pr jvm-version can be found under jvm1.4, jvm1.5, jvm1.6, jvm1.6-64.
Summary of additional tests are found here.

Here is a table with a summary of failures found including comments on these:

Counting the number of distinct errors, total number of error occurences and platforms used in 10.3.3.0 testing we find:

 

10.2.2.0

10.3.1.0

10.3.1.1

10.3.1.2

10.3.1.3

10.3.1.4

10.3.2.1

10.3.3.0

Distinct
errors

2

6

10

7

4

5

6

1

1.4

0 / 0 / 18

4 / 4 / 21

6 / 23 / 21

3 / 3 / 21

2 / 2 / 21

5 / 7 / 21

2 / 3 / 20

1 / 3 / 26

1.5

2 / 3 / 19

3 / 5 / 22

6 / 30 / 22

6 / 8 / 22

3 / 5 / 22

2 / 6 / 22

4 / 4 / 20

0 / 0 / 26

1.6

0 / 0 / 18

1 / 3 / 21

3 / 29 / 21

2 / 7 / 21

4 / 7 / 21

2 / 4 / 21

0 / 0 / 20

0 / 0 / 27

1.6-64

- / - / -

- / - / -

- / - / -

- / - / -

- / - / -

- / - / -

- / - / -

0 / 0 / 13

Legend: Distinct errors / Sum errors / Number of platforms.

The Large DataVolume test was not run on 10.3.3.0.

JDBC 3.0 Compatibility Test Suite (CTS) (part of the J2EE TCK) was run on a number of different platforms. See SunCTS for details.

The LongTermTest was not run on 10.3.3.0. It was run on version 10.3.2.0. See LongTermTest for details. No derby-failures seen.

Report generated: 2008-05-07 10:19:32 MEST

JIRA/Id

JVM/OS

Comment

Previously
seen in





2290 lang/logStream.java

jvm1.4: [vista, vista-64, w2008-32]
jvm1.5: []
jvm1.6: []
jvm1.6-64: []


10.3.1.*
10.2.2.1

The following are test or infrastructure problems. Do not count above.

3665 derbynet/testProperties.java

jvm1.4: [All]
jvm1.5: [All]
jvm1.6: [All]
jvm1.6-64: [All]

Test master file was not updated.
Fixed on 10.3 branch.

"-1" lang/wisconsin.java

jvm1.4: [lin32]
jvm1.5: []
jvm1.6: []
jvm1.6-64: []

'Error opening socket to server xxxFILTERED_HOSTNAMExxx on
port 1527 with message : Connection refused' -
Infrastructure problem?

Several occurences
in daily regression tests.





See also Apache Derby community platform testing reports.

Conclusion

We do not regard any of the found problems as showstoppers for a release.