lkml.org 
[lkml]   [2003]   [Jan]   [6]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
/
Subject[STABILITY] Compile / STP metrics
From
Date
Compile statistics have been for kernel releases from 2.5.46 to 2.5.54
at: www.osdl.org/archive/cherry/stability

This page also has the beginnings of STP (Scalable Test Platform)
results for a number of tests (aim9, LTP, unixbench, contest, bonnie++,
debench (quick), hackbench, iozone, dbt1 (1-tier), lmbench (short)) for
recent kernel releases.

These metrics are simply one way to measure how 2.5 is converging. Many
of the compilation errors are being addressed by various kernel
developers, so in some ways, these statics are restating the obvious.

Reasonable convergence of compile time warnings/errors was happening
until 2.5.54 was released. However, 2.5.54 took a step backwards. The
latest results show...

2.5.53 2.5.54
------------------------ ------------------------
bzImage (defconfig) 16 warnings/0 errors 68 warnings/0 errors
bzImage (allmodconfig) 31 warnings/9 errors 40 warnings/11 errors
modules (allmodconfig) 1843 warnings/118 errors 3223 warnings/208 errors

The script that generated this data is also at
www.osdl.org/archive/cherry/stability. Detailed information on warnings
and errors can be found by following the links in the table, but a
summary of the 2.5.54 run is shown here....

Kernel version: 2.5.54
Kernel build:
Making bzImage (defconfig): 68 warnings, 0 errors
Making bzImage (allmodconfig): 40 warnings, 11 errors
Making modules (allmodconfig): 3223 warnings, 208 errors

Building directories:
Building fs/autofs: clean
Building fs/autofs4: clean
Building fs/befs: 0 warnings, 2 errors
Building fs/bfs: clean
Building fs/devfs: clean
Building fs/devpts: clean
Building fs/efs: clean
Building fs/exportfs: clean
Building fs/ext2: clean
Building fs/ext3: clean
Building fs/fat: clean
Building fs/hfs: clean
Building fs/hpfs: clean
Building fs/hugetlbfs: clean
Building fs/intermezzo: 2 warnings, 0 errors
Building fs/isofs: clean
Building fs/jbd: clean
Building fs/jffs: clean
Building fs/jffs2: clean
Building fs/jfs: clean
Building fs/lockd: 4 warnings, 0 errors
Building fs/ncpfs: clean
Building fs/nfs: clean
Building fs/nfsd: 2 warnings, 0 errors
Building fs/nls: clean
Building fs/ntfs: 3 warnings, 0 errors
Building fs/openpromfs: clean
Building fs/partitions: clean
Building fs/proc: clean
Building fs/qnx4: clean
Building fs/reiserfs: 1 warnings, 0 errors
Building fs/romfs: 0 warnings, 2 errors
Building fs/smbfs: 2 warnings, 0 errors
Building fs/sysfs: clean
Building fs/sysv: clean
Building fs/udf: clean
Building fs/ufs: clean
Building fs/umsdos: clean
Building fs/vfat: clean
Building fs/xfs: 2 warnings, 0 errors
Building drivers/acorn: clean
Building drivers/cdrom: 34 warnings, 0 errors
Building drivers/ide: 45 warnings, 2 errors
Building drivers/mca: clean
Building drivers/net: 626 warnings, 20 errors
Building drivers/pcmcia: 13 warnings, 0 errors
Building drivers/sgi: clean
Building drivers/acpi: clean
Building drivers/char: 374 warnings, 8 errors
Building drivers/ieee1394: 17 warnings, 2 errors
Building drivers/md: 18 warnings, 0 errors
Building drivers/nubus: clean
Building drivers/pnp: clean
Building drivers/tc: clean
Building river/atm: clean
Building drivers/dio: clean
Building drivers/input: 5 warnings, 0 errors
Building drivers/media: 176 warnings, 31 errors
Building drivers/oprofile: clean
Building drivers/s390: clean
Building drivers/telephony: 15 warnings, 2 errors
Building drivers/base: clean
Building drivers/fc4: clean
Building drivers/isdn: 477 warnings, 18 errors
Building drivers/message: 18 warnings, 2 errors
Building drivers/parisc: clean
Building drivers/sbus: clean
Building drivers/usb: 34 warnings, 0 errors
Building drivers/block: 10 warnings, 2 errors
Building drivers/hotplug: 10 warnings, 0 errors
Building drivers/misc: clean
Building drivers/parport: 10 warnings, 0 errors
Building drivers/scsi/aacraid: 3 warnings, 0 errors
Building drivers/scsi/aic7xxx: 1 warnings, 0 errors
Building drivers/scsi/dpt: clean
Building drivers/scsi/pcmcia: 24 warnings, 3 errors
Building drivers/scsi/sym53c8xx_2: 1 warnings, 0 errors
Building drivers/video/aty: 0 warnings, 2 errors
Building drivers/video/console: 2 warnings, 0 errors
Building drivers/video/matrox: 106 warnings, 20 errors
Building drivers/video/riva: clean
Building drivers/video/sis: 37 warnings, 3 errors
Building drivers/bluetooth: 15 warnings, 0 errors
Building drivers/i2c: 3 warnings, 0 errors
Building drivers/mtd: 30 warnings, 4 errors
Building drivers/pci: clean
Building drivers/serial: 1 warnings, 0 errors
Building drivers/zorro: clean
Building sound/core: 2 warnings, 0 errors
Building sound/drivers: 1 warnings, 0 errors
Building sound/i2c: clean
Building sound/isa: 105 warnings, 34 errors
Building sound/oss: 159 warnings, 13 errors
Building sound/pci: 8 warnings, 0 errors
Building sound/synth: clean
Building sound/usb: clean
Building arch/i386: clean
Building crypto: clean
Building ipc: clean
Building lib: clean
Building mm: clean
Building net: 311 warnings, 0 errors
Building security: 2 warnings, 0 errors
Building sound: 123 warnings, 47 errors
Building drivers/video: 297 warnings, 35 errors
Building usr: clean


Failure Summary:

drivers/block: 10 warnings, 2 errors
drivers/char: 374 warnings, 8 errors
drivers/ide: 45 warnings, 2 errors
drivers/ieee1394: 17 warnings, 2 errors
drivers/isdn: 477 warnings, 18 errors
drivers/media: 176 warnings, 31 errors
drivers/message: 18 warnings, 2 errors
drivers/mtd: 30 warnings, 4 errors
drivers/net: 626 warnings, 20 errors
drivers/scsi/pcmcia: 24 warnings, 3 errors
drivers/telephony: 15 warnings, 2 errors
drivers/video: 297 warnings, 35 errors
drivers/video/aty: 0 warnings, 2 errors
drivers/video/matrox: 106 warnings, 20 errors
drivers/video/sis: 37 warnings, 3 errors
fs/befs: 0 warnings, 2 errors
fs/romfs: 0 warnings, 2 errors
sound: 123 warnings, 47 errors
sound/isa: 105 warnings, 34 errors
sound/oss: 159 warnings, 13 errors


Warning Summary:

drivers/bluetooth: 15 warnings, 0 errors
drivers/cdrom: 34 warnings, 0 errors
drivers/hotplug: 10 warnings, 0 errors
drivers/i2c: 3 warnings, 0 errors
drivers/input: 5 warnings, 0 errors
drivers/md: 18 warnings, 0 errors
drivers/parport: 10 warnings, 0 errors
drivers/pcmcia: 13 warnings, 0 errors
drivers/scsi/aacraid: 3 warnings, 0 errors
drivers/scsi/aic7xxx: 1 warnings, 0 errors
drivers/scsi/sym53c8xx_2: 1 warnings, 0 errors
drivers/serial: 1 warnings, 0 errors
drivers/usb: 34 warnings, 0 errors
drivers/video/console: 2 warnings, 0 errors
fs/intermezzo: 2 warnings, 0 errors
fs/lockd: 4 warnings, 0 errors
fs/nfsd: 2 warnings, 0 errors
fs/ntfs: 3 warnings, 0 errors
fs/reiserfs: 1 warnings, 0 errors
fs/smbfs: 2 warnings, 0 errors
fs/xfs: 2 warnings, 0 errors
net: 311 warnings, 0 errors
security: 2 warnings, 0 errors
sound/core: 2 warnings, 0 errors
sound/drivers: 1 warnings, 0 errors
sound/pci: 8 warnings, 0 errors

John Cherry
OSDL



-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/

\
 
 \ /
  Last update: 2005-03-22 13:32    [W:0.060 / U:0.028 seconds]
©2003-2020 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site