2.6.27-rc8-git7: Reported regressions from 2.6.26
Rafael J. Wysocki
are no fixes in the mainline I know of. If any of them have been fixed already,
please let me know.
If you know of any other unresolved regressions from 2.6.26, please let me know
either and I'll add them to the list. Also, please let me know if any of the
entries below are invalid.
Each entry from the list will be sent additionally in an automatic reply to
this message with CCs to the people involved in reporting and handling the
issue.
Listed regressions statistics:
Date Total Pending Unresolved
----------------------------------------
2008-10-04 181 41 33
2008-09-27 173 35 28
2008-09-21 169 45 36
2008-09-15 163 46 32
2008-09-12 163 51 38
2008-09-07 150 43 33
2008-08-30 135 48 36
2008-08-23 122 48 40
2008-08-16 103 47 37
2008-08-10 80 52 31
2008-08-02 47 31 20
Unresolved regressions
----------------------
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11700
Subject : ACPI instabilities and IRQs being disabled
Submitter : Shawn Starr <shawn...@rogers.com>
Date : 2008-09-27 22:40 (8 days old)
References : http://marc.info/?l=linux-kernel&m=122255527412178&w=4
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11699
Subject : 2.6.27-rc-7: BUG: scheduling while atomic, c1e_idle+0x98/0xe0
Submitter : Prakash Punnoor <pra...@punnoor.de>
Date : 2008-09-28 17:45 (7 days old)
References : http://marc.info/?l=linux-kernel&m=122262403415629&w=4
Handled-By : Thomas Gleixner <tg...@linutronix.de>
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11698
Subject : 2.6.27-rc7, freezes with > 1 s2ram cycle
Submitter : Soeren Sonnenburg <ker...@nn7.de>
Date : 2008-09-29 11:29 (6 days old)
References : http://marc.info/?l=linux-kernel&m=122268780926859&w=4
Handled-By : Rafael J. Wysocki <r...@sisk.pl>
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11697
Subject : CD tray closes spontaneously after opening it
Submitter : Frans Pop <ele...@planet.nl>
Date : 2008-09-30 10:47 (5 days old)
References : http://marc.info/?l=linux-kernel&m=122277167125264&w=4
Handled-By : Kay Sievers <kay.s...@vrfy.org>
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11695
Subject : USB disconnects every 30 seconds
Submitter : Dave Hansen <da...@sr71.net>
Date : 2008-10-03 17:45 (2 days old)
References : http://marc.info/?l=linux-kernel&m=122305738430115&w=4
Handled-By : Alan Stern <st...@rowland.harvard.edu>
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11676
Subject : 2.6.27-rc2 to rc8, apgart fails, iommu=soft works, regression
Submitter : Duncan <1i5t5....@cox.net>
Date : 2008-09-30 10:24 (5 days old)
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11664
Subject : acpi errors and random freeze on sony vaio sr
Submitter : Giovanni Pellerano <giovanni....@gmail.com>
Date : 2008-09-28 03:48 (7 days old)
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11643
Subject : ALSA sound/core/pcm_native.c:1947: BUG? (err >= 0)
Submitter : sangu <sangu...@gmail.com>
Date : 2008-09-24 16:51 (11 days old)
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11634
Subject : Sometime my laptop is dead on resume from ram
Submitter : Romano Giannetti <romano.g...@gmail.com>
Date : 2008-09-24 01:12 (11 days old)
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11608
Subject : 2.6.27-rc6 BUG: unable to handle kernel paging request
Submitter : John Daiker <daike...@gmail.com>
Date : 2008-09-16 23:00 (19 days old)
References : http://marc.info/?l=linux-kernel&m=122160611517267&w=4
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11607
Subject : 2.6.27-rc6 Bug in tty_chars_in_buffer
Submitter : John Daiker <daike...@gmail.com>
Date : 2008-09-15 2:26 (20 days old)
References : http://marc.info/?l=linux-kernel&m=122144565514490&w=4
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11569
Subject : Don't complain about disabled irqs when the system has paniced
Submitter : Andi Kleen <an...@firstfloor.org>
Date : 2008-09-02 13:49 (33 days old)
References : http://marc.info/?l=linux-kernel&m=122036356127282&w=4
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11568
Subject : spontaneous reboot on resume with 2.6.27
Submitter : Andy Wettstein <ajw...@gmail.com>
Date : 2008-09-14 20:00 (21 days old)
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11543
Subject : kernel panic: softlockup in tick_periodic() ???
Submitter : Joshua Hoblitt <j_ke...@hoblitt.com>
Date : 2008-09-11 16:46 (24 days old)
References : http://marc.info/?l=linux-kernel&m=122117786124326&w=4
Handled-By : Thomas Gleixner <tg...@linutronix.de>
Cyrill Gorcunov <gorc...@gmail.com>
Ingo Molnar <mi...@elte.hu>
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11516
Subject : severe performance degradation on x86_64 going from 2.6.26-rc9 -> 2.6.27-rc5
Submitter : Jason Vas Dias <jason.v...@gmail.com>
Date : 2008-09-07 13:59 (28 days old)
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11512
Subject : sort-of regression due to "kconfig: speed up all*config + randconfig"
Submitter : Alexey Dobriyan <adob...@gmail.com>
Date : 2008-09-05 22:50 (30 days old)
References : http://marc.info/?l=linux-kernel&m=122065498013858&w=4
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11504
Subject : reiserfs BUG in 2.6.27-rc5
Submitter : Randy Dunlap <randy....@oracle.com>
Date : 2008-09-03 16:35 (32 days old)
References : http://marc.info/?l=linux-kernel&m=122045982120138&w=4
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11476
Subject : failure to associate after resume from suspend to ram
Submitter : Michael S. Tsirkin <m.s.t...@gmail.com>
Date : 2008-09-01 13:33 (34 days old)
References : http://marc.info/?l=linux-kernel&m=122028529415108&w=4
Handled-By : Zhu Yi <yi....@intel.com>
Dan Williams <dc...@redhat.com>
Jouni Malinen <j...@w1.fi>
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11407
Subject : suspend: unable to handle kernel paging request
Submitter : Vegard Nossum <vegard...@gmail.com>
Date : 2008-08-21 17:28 (45 days old)
References : http://marc.info/?l=linux-kernel&m=121933974928881&w=4
Handled-By : Rafael J. Wysocki <r...@sisk.pl>
Pekka Enberg <pen...@cs.helsinki.fi>
Pavel Machek <pa...@suse.cz>
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11404
Subject : BUG: in 2.6.23-rc3-git7 in do_cciss_intr
Submitter : rdunlap <randy....@oracle.com>
Date : 2008-08-21 5:52 (45 days old)
References : http://marc.info/?l=linux-kernel&m=121929819616273&w=4
http://marc.info/?l=linux-kernel&m=121932889105368&w=4
Handled-By : Miller, Mike (OS Dev) <Mike....@hp.com>
James Bottomley <James.B...@hansenpartnership.com>
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11380
Subject : lockdep warning: cpu_add_remove_lock at:cpu_maps_update_begin+0x14/0x16
Submitter : Ingo Molnar <mi...@elte.hu>
Date : 2008-08-20 6:44 (46 days old)
References : http://marc.info/?l=linux-kernel&m=121921480931970&w=4
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11340
Subject : LTP overnight run resulted in unusable box
Submitter : Alexey Dobriyan <adob...@gmail.com>
Date : 2008-08-13 9:24 (53 days old)
References : http://marc.info/?l=linux-kernel&m=121861951902949&w=4
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11308
Subject : tbench regression on each kernel release from 2.6.22 -> 2.6.28
Submitter : Christoph Lameter <c...@linux-foundation.org>
Date : 2008-08-11 18:36 (55 days old)
References : http://marc.info/?l=linux-kernel&m=121847986119495&w=4
http://marc.info/?l=linux-kernel&m=122125737421332&w=4
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11272
Subject : BUG: parport_serial in 2.6.27-rc1 for NetMos Technology PCI 9835
Submitter : Jaswinder Singh <jaswind...@gmail.com>
Date : 2008-08-05 15:12 (61 days old)
References : http://marc.info/?l=linux-kernel&m=121794900319776&w=4
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11271
Subject : BUG: fealnx in 2.6.27-rc1
Submitter : Jaswinder Singh <jaswind...@gmail.com>
Date : 2008-08-05 14:58 (61 days old)
References : http://marc.info/?l=linux-netdev&m=121794762016830&w=4
http://lkml.org/lkml/2008/8/10/98
Handled-By : Francois Romieu <rom...@fr.zoreil.com>
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11264
Subject : Invalid op opcode in kernel/workqueue
Submitter : Jean-Luc Coulon <jean.lu...@gmail.com>
Date : 2008-08-07 04:18 (59 days old)
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11230
Subject : Kconfig no longer outputs a .config with freshly updated defconfigs
Submitter : Josh Boyer <jwb...@linux.vnet.ibm.com>
Date : 2008-08-02 16:03 (64 days old)
References : http://marc.info/?l=linux-kernel&m=121769306319391&w=4
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11224
Subject : Only three cores found on quad-core machine.
Submitter : Dave Jones <da...@redhat.com>
Date : 2008-08-01 18:15 (65 days old)
References : http://marc.info/?l=linux-kernel&m=121761475224719&w=4
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11220
Subject : Screen stays black after resume
Submitter : Nico Schottelius <ni...@schottelius.org>
Date : 2008-07-31 21:05 (66 days old)
References : http://marc.info/?l=linux-kernel&m=121753882422899&w=4
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11215
Subject : INFO: possible recursive locking detected ps2_command
Submitter : Zdenek Kabelac <zdenek....@gmail.com>
Date : 2008-07-31 9:41 (66 days old)
References : http://marc.info/?l=linux-kernel&m=121749737011637&w=4
Handled-By : Peter Zijlstra <a.p.zi...@chello.nl>
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11210
Subject : libata badness
Submitter : Kumar Gala <ga...@kernel.crashing.org>
Date : 2008-07-31 18:53 (66 days old)
References : http://marc.info/?l=linux-ide&m=121753059307310&w=4
Handled-By : Kumar Gala <ga...@kernel.crashing.org>
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11209
Subject : 2.6.27-rc1 process time accounting
Submitter : Lukas Hejtmanek <xhej...@ics.muni.cz>
Date : 2008-07-31 10:43 (66 days old)
References : http://marc.info/?l=linux-kernel&m=121750102917490&w=4
http://lkml.org/lkml/2008/9/30/199
Handled-By : Peter Zijlstra <a.p.zi...@chello.nl>
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11207
Subject : VolanoMark regression with 2.6.27-rc1
Submitter : Zhang, Yanmin <yanmin...@linux.intel.com>
Date : 2008-07-31 3:20 (66 days old)
References : http://marc.info/?l=linux-kernel&m=121747464114335&w=4
Handled-By : Zhang, Yanmin <yanmin...@linux.intel.com>
Peter Zijlstra <a.p.zi...@chello.nl>
Dhaval Giani <dha...@linux.vnet.ibm.com>
Miao Xie <mi...@cn.fujitsu.com>
Regressions with patches
------------------------
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11701
Subject : sky2 wol regression
Submitter : Tino Keitel <tino....@gmx.de>
Date : 2008-09-24 8:05 (11 days old)
References : http://marc.info/?l=linux-kernel&m=122224359222164&w=4
Handled-By : Rafael J. Wysocki <r...@sisk.pl>
Patch : http://marc.info/?l=linux-kernel&m=122298334522551&w=4
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11696
Subject : 2.6.27-rc8 doubled times
Submitter : Hugh Dickins <hu...@veritas.com>
Date : 2008-10-03 10:21 (2 days old)
References : http://marc.info/?l=linux-kernel&m=122302939313636&w=4
Handled-By : Thomas Gleixner <tg...@linutronix.de>
Patch : http://marc.info/?l=linux-kernel&m=122307260621434&w=4
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11629
Subject : quad G5 fails to shut down
Submitter : Johannes Berg <joha...@sipsolutions.net>
Date : 2008-09-23 14:20 (12 days old)
Handled-By : Johannes Berg <joha...@sipsolutions.net>
Patch : http://bugzilla.kernel.org/show_bug.cgi?id=11629#c8
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11615
Subject : sata_nv EH problems
Submitter : Pär Andersson <pa...@lysator.liu.se>
Date : 2008-09-21 18:09 (14 days old)
Handled-By : Tejun Heo <t...@kernel.org>
Patch : http://bugzilla.kernel.org/attachment.cgi?id=18078&action=view
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11550
Subject : pnp: Huge number of "io resource overlap" messages
Submitter : Frans Pop <ele...@planet.nl>
Date : 2008-09-09 10:50 (26 days old)
References : http://marc.info/?l=linux-kernel&m=122095745403793&w=4
Handled-By : Rene Herman <rene....@keyaccess.nl>
Bjorn Helgaas <bjorn....@hp.com>
Patch : http://marc.info/?l=linux-kernel&m=122246533505643&w=4
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11549
Subject : 2.6.27-rc5 acpi: EC Storm error message on bootup
Submitter : <jme...@wolfmountaingroup.com>
Date : 2008-09-02 21:27 (33 days old)
References : http://marc.info/?l=linux-kernel&m=122039255517586&w=4
Handled-By : Alexey Starikovskiy <astari...@suse.de>
Patch : http://bugzilla.kernel.org/attachment.cgi?id=18047&action=view
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11505
Subject : oltp ~10% regression with 2.6.27-rc5 on stoakley machine
Submitter : Lin Ming <ming....@intel.com>
Date : 2008-09-04 7:06 (31 days old)
References : http://marc.info/?l=linux-kernel&m=122051202202373&w=4
http://marc.info/?t=122089704700005&r=1&w=4
Handled-By : Peter Zijlstra <a.p.zi...@chello.nl>
Gregory Haskins <ghas...@novell.com>
Ingo Molnar <mi...@elte.hu>
Patch : http://marc.info/?l=linux-kernel&m=122194673932703&w=4
Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11442
Subject : btusb hibernation/suspend breakage in current -git
Submitter : Rafael J. Wysocki <r...@sisk.pl>
Date : 2008-08-25 11:37 (41 days old)
References : http://marc.info/?l=linux-bluetooth&m=121966402012074&w=4
Handled-By : Oliver Neukum <oli...@neukum.org>
Patch : http://marc.info/?l=linux-bluetooth&m=121967226027323&w=4
http://bugzilla.kernel.org/show_bug.cgi?id=11442#c1
For details, please visit the bug entries and follow the links given in
references.
As you can see, there is a Bugzilla entry for each of the listed regressions.
There also is a Bugzilla entry used for tracking the regressions from 2.6.26,
unresolved as well as resolved, at:
http://bugzilla.kernel.org/show_bug.cgi?id=11167
Please let me know if there are any Bugzilla entries that should be added to
the list in there.
Thanks,
Rafael
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majo...@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
Randy Dunlap
> This message has been generated automatically as a part of a report
> of recent regressions.
>
> The following bug entry is on the current list of known regressions
> from 2.6.26. Please verify if it still should be listed and let me know
> (either way).
>
>
> Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=11504
> Subject : reiserfs BUG in 2.6.27-rc5
> Submitter : Randy Dunlap <randy....@oracle.com>
> Date : 2008-09-03 16:35 (32 days old)
> References : http://marc.info/?l=linux-kernel&m=122045982120138&w=4
Yes, it should remain since it happened recently on 2.6.27-rc8-git6.
Again with blocksize = 1KB.
I don't see any action from the reiserfs developers about trying
to fix this. Maybe I shouldn't bother testing this.
Here's the BUG dump from 2.6.27-rc8-git6:
calling init_reiserfs_fs+0x0/0x83 [reiserfs]
initcall init_reiserfs_fs+0x0/0x83 [reiserfs] returned 0 after 0 msecs
ReiserFS: cciss/c0d0p4: found reiserfs format "3.6" with standard journal
ReiserFS: cciss/c0d0p4: using journaled data mode
ReiserFS: cciss/c0d0p4: journal params: device cciss/c0d0p4, size 8125, journal first block 66, max trans len 256, max batch 225, max commit age 30, max trans age 30
ReiserFS: cciss/c0d0p4: checking transaction log (cciss/c0d0p4)
ReiserFS: cciss/c0d0p4: Using r5 hash to sort names
------------[ cut here ]------------
kernel BUG at fs/reiserfs/journal.c:530!
invalid opcode: 0000 [1] SMP
CPU 3
Modules linked in: reiserfs parport_pc lp parport tg3 lpfc cciss ehci_hcd ohci_hcd uhci_hcd [last unloaded: reiserfs]
Pid: 24918, comm: fsx-linux Not tainted 2.6.27-rc8-git6 #1
RIP: 0010:[<ffffffffa00b3e35>] [<ffffffffa00b3e35>] reiserfs_in_journal+0xed/0x155 [reiserfs]
RSP: 0018:ffff88017e9bb748 EFLAGS: 00010246
RAX: 0000000000002493 RBX: ffff88017e9bb79c RCX: 0000000000002493
RDX: ffffc20011c97760 RSI: ffffc20011bf21f0 RDI: ffff8801f85a9000
RBP: ffff88017e9bb758 R08: 0000000000000005 R09: ffff880178851800
R10: ffffc20011bf2000 R11: 0000000000000008 R12: ffff88017e9bb86c
R13: ffff88027f07f3f0 R14: ffff880178851800 R15: 0000000000000001
FS: 00007facfc8af6f0(0000) GS:ffff88027f618c80(0000) knlGS:00000000f7f4d6c0
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007facfcabf000 CR3: 000000017899f000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process fsx-linux (pid: 24918, threadinfo ffff88017e9ba000, task ffff8801796ce810)
Stack: ffff880178851800 0000000000000493 ffff88017e9bb7c8 ffffffffa0096418
000000116f000080 0000200000000001 ffff8801d78a7640 ffffc20000c74004
000004837e9bb898 ffffffffa009dd29 0000000005cce34f ffff88017e9bb998
Call Trace:
[<ffffffffa0096418>] scan_bitmap_block+0x128/0x227 [reiserfs]
[<ffffffffa009dd29>] ? reiserfs_update_sd_size+0x297/0x2a9 [reiserfs]
[<ffffffffa0097160>] reiserfs_allocate_blocknrs+0x87e/0xa94 [reiserfs]
[<ffffffffa00acedd>] ? search_for_position_by_key+0x165/0x2c7 [reiserfs]
[<ffffffffa009e341>] reiserfs_get_block+0x3b8/0xf67 [reiserfs]
[<ffffffff802ba86c>] __block_prepare_write+0x1b9/0x39c
[<ffffffffa009df89>] ? reiserfs_get_block+0x0/0xf67 [reiserfs]
[<ffffffff8027991e>] ? __inc_zone_page_state+0x29/0x2b
[<ffffffff802baafb>] block_write_begin+0x7d/0xcd
[<ffffffffa00a0071>] reiserfs_write_begin+0x13d/0x1c6 [reiserfs]
[<ffffffffa009df89>] ? reiserfs_get_block+0x0/0xf67 [reiserfs]
[<ffffffff8026e1c4>] generic_file_buffered_write+0x14b/0x636
[<ffffffff802396ea>] ? current_fs_time+0x22/0x29
[<ffffffff8026ebb0>] __generic_file_aio_write_nolock+0x352/0x3bc
[<ffffffff8024f04a>] ? debug_mutex_free_waiter+0x46/0x4a
[<ffffffff8026ec7e>] generic_file_aio_write+0x64/0xc0
[<ffffffff80299850>] do_sync_write+0xe2/0x126
[<ffffffff80278b52>] ? vma_prio_tree_remove+0x42/0xe4
[<ffffffff8029caa2>] ? cp_new_stat+0xf6/0x10f
[<ffffffff802475e0>] ? autoremove_wake_function+0x0/0x38
[<ffffffffa00a0b7c>] reiserfs_file_write+0x38/0x4d [reiserfs]
[<ffffffff8029a029>] vfs_write+0xae/0x157
[<ffffffff8029a537>] sys_write+0x47/0x6f
[<ffffffff8020bf0b>] system_call_fastpath+0x16/0x1b
Code: d0 25 ff 1f 00 00 49 8b 94 c2 f8 01 00 00 eb 12 8b 42 10 48 39 c8 75 06 4c 39 4a 08 74 0d 48 8b 52 40 48 85 d2 75 e9 31 c0 eb 63 <0f> 0b eb fe 49 8b 41 18 48 c1 e0 03 48 0f af c8 48 63 c2 48 01
RIP [<ffffffffa00b3e35>] reiserfs_in_journal+0xed/0x155 [reiserfs]
RSP <ffff88017e9bb748>
Kernel panic - not syncing: Fatal exception
Now why didn't the system reboot? :(
Grant Coady
Did you unload the live filesystem's module above? May it's a case of
don't do that?
Grant.
Jeff Mahoney
Hash: SHA1
Grant Coady wrote:
> Did you unload the live filesystem's module above? May it's a case of
> don't do that?
When the file system is mounted, the module count is incremented. You
can't remove the module underneath a live file system.
- -Jeff
- --
Jeff Mahoney
SUSE Labs
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.9 (GNU/Linux)
Comment: Using GnuPG with SUSE - http://enigmail.mozdev.org
iEYEARECAAYFAkjqc2cACgkQLPWxlyuTD7ICtwCfabHYk34DH5pFDQyChfxpokdx
/EsAn1bpcobk7oLu1K0OwrzWIXj3r08e
=2yov
-----END PGP SIGNATURE-----