Derby 10.5.1.1 RC2 - summary testreport

Release 10.5.1.1 was created 2009-04-15 (svn revision 764942) and testing was started 2008-04-15.
Testing was done under jvm1.6 and jvm1.6-64 with suitesAll and derbyall plus jdbcapi tests and the compatibility test. Under jvm1.5 and jvm1.4 derbyall and suitesAll was run.

The following table is a summary of failures seen:

Counting the number of distinct failures, total number of failure occurences (product related) and platforms used in 10.5.1.1 testing we find :

 

10.2.2.1

10.3.1.4

10.3.2.1

10.4.1.3

10.4.2.0

10.5.1.1

Total

9 / 12 / 64

5 / 17 / 64

6 / 7 / 60

1 / 2 / 92

4 / 10 / 88

2 / 12 / 79

1.4

3 / 5 / 21

5 / 7 / 21

2 / 3 / 20

0 / 0 / 26

0 / 0 / 24

0 / 0 / 22

1.5

2 / 2 / 22

2 / 6 / 22

4 / 4 / 20

0 / 0 / 26

0 / 0 / 24

1 / 1 / 22

1.6

5 / 5 / 21

2 / 4 / 21

0 / 0 / 20

0 / 0 / 28

3 / 6 / 27

0 / 0 / 23

1.6-64

- / - / -

- / - / -

- / - / -

1 / 2 / 12

2 / 4 / 13

1 / 11 / 12

Legend: Distinct errors / Sum errors / Number of platforms.

Summary: 2 distinct failures (1+12 occurences). Both are intermittent failures.


Report generated: 2009-04-22

JIRA/Id

JVM/OS

Comment

Seen in XX

2447

jvm1.4: []
jvm1.5: [solN+1]
jvm1.6: []
jvm1.6-64: []

Intermittent

...

3819

jvm1.4: []
jvm1.5: []
jvm1.6: []
jvm1.6-64: [sol,solN+1,sol-zfs,sol-zone1,sol-zones,sparc,sparcN+1,vista-64,w2003-64,w2008-64,winxp-64]

 
Intermittent, unexpected query plan: 'Expected Table Scan ResultSet for T3'.
Possibly classify as a test problem, should accept different query plans?

...

The following are test or infrastructure problems. Do not count above.

4133

jvm1.4: [All]
jvm1.5: []
jvm1.6: []
jvm1.6-64: []

Test – resolved on trunk and branch.

New

4118

jvm1.4: [lin]
jvm1.5: [lin]
jvm1.6: [lin]
jvm1.6-64: [lin] 

Test infra. / test policy – resolved on trunk and branch.

New

4097

jvm1.4: []
jvm1.5: [sol-zones,w2008-32]
jvm1.6: [ w2008-64]
jvm1.6-64: [vista-64]

Test - resolved on trunk and branch

10.5

3719

jvm1.4: []
jvm1.5: [vista,w2008-32]
jvm1.6: [lin,sol-zfs,sol-zone1]
jvm1.6-64: [w2008-64]

Test instability - intermittent


-3632

jvm1.4: []
jvm1.5: [vista,w2008-32]
jvm1.6: []
jvm1.6-64: [w2008-64]

Test instability - intermittent



jvm1.4: [sles,sparcN+1,ubuntu,vista-64,w2003-64]
jvm1.5: [sles,ubuntu,vista-64,w2003-64,w2008-64]
jvm1.6: [sles,sparc, sparcN+1,sparcN-2]
jvm1.6-64: [sles]

Infrastructure problems – should be rerun



Detailed test results for derbyall, suitesAll etc.
Additional tests.
Test coverage.

See also Apache Derby community platform testing reports for 10.5.1.1 RC 2.



Ole Solberg - 2009-04-23