Derby 10.4.2.0 RC1 - summary testreport

Release 10.4.2.0 was created 2008-08-27 (svn revision 689064) and testing was started 2008-08-27.
Testing was done under jvm1.6 with suitesAll and derbyall plus jdbcapi tests and the compatibility test. Under jvm1.5 and jvm1.4 derbyall and suitesAll was run.

The following table is a summary of failures seen:

Counting the number of distinct errors, total number of error occurences and platforms used in 10.4.2.0 testing we find:

 

10.2.2.1

10.3.1.4

10.3.2.1

10.4.1.3

10.4.2.0

Total

9 / 12 / 64

5 / 17 / 64

6 / 7 / 60

1 / 2 / 92

4 / 10 / 88

1.4

3 / 5 / 21

5 / 7 / 21

2 / 3 / 20

0 / 0 / 26

0 / 0 / 24

1.5

2 / 2 / 22

2 / 6 / 22

4 / 4 / 20

0 / 0 / 26

0 / 0 / 24

1.6

5 / 5 / 21

2 / 4 / 21

0 / 0 / 20

0 / 0 / 28

3 / 6 / 27

1.6-64

- / - / -

- / - / -

- / - / -

1 / 2 / 12

2 / 4 / 13

Legend: Distinct errors / Sum errors / Number of platforms.

JDBC 3.0 Compatibility Test Suite (CTS) (part of the J2EE TCK) was run on a number of different platforms. See SunCTS for details.

Report generated: 2008-09-02

JIRA/Id

JVM/OS

Comment

Seen in XX

1801 - lang/wisconsin.java

jvm1.4: []
jvm1.5: []
jvm1.6: [solN+1, sparc]
jvm1.6-64: []

Intermittent failure

...

1902 lang/predicatePushdown.sql

jvm1.4: []
jvm1.5: []
jvm1.6: [lin, solN+1-32, solN-1]
jvm1.6-64: [lin, vista-64 , w2008-64]

Hash Join ResultSet
Intermittent failure

10.3.2.1
10.4.1.3

2947 - store/readlocks.sql

jvm1.4: []
jvm1.5: []
jvm1.6: []
jvm1.6-64: [solN+1]

Intermittent failure

...

3389 - store/OnlineCompressTest.java

jvm1.4: []
jvm1.5: []
jvm1.6: [sol-zfs]
jvm1.6-64: []

 
> Expected at least 33 pages reclaimed.
> ERROR: for 2000 row  test. Expected 1, but got 17
Intermittent failure

...

The following are test or infrastructure problems. Do not count above.

3632 replicationSuite: replicationTests.ReplicationRun_Local_StateTest_part2

jvm1.4: []
jvm1.5: []
jvm1.6: [sol]
jvm1.6-64: []

  Intermittent failure

...

3719

jvm1.4: [sparc-zones, w2008-32, solN+1]
jvm1.5: [sol-zones, solN+1, sparc-zones]
jvm1.6: [solN+1, winxp]
jvm1.6-64: [w2003-64] 

Intermittent failure

...

3861 - jdbcapi.AutoloadTest

jvm1.4: []
jvm1.5: []
jvm1.6: []
jvm1.6-64: [sparc] 

Network Server state incorrect expected:<false> but was:<true>
Intermittent failure


-999

jvm1.4: [w2000]
jvm1.5: []
jvm1.6: [w2000]
jvm1.6-64: [] 

Intermittent failure

...

-3632

jvm1.4: [w2008-32]
jvm1.5: [w2000]
jvm1.6: [winxp-64]
jvm1.6-64: [] 

Intermittent failure

...


Detailed test results for derbyall, suitesAll etc.
Additional tests.
Test coverage.

See also Apache Derby community platform testing reports for 10.4.2.0.



Conclusion

Positive vote recommended.

-- Ole Solberg - 2008-09-02