Wikis down

[kotra]

I think there is a problem with http://portlandwiki.org and http://pdx.wiki.org
(go to them and they should be down). I'm looking into it but I'm
probably over my head here, so if anyone else can help please do!

kotra

[kotra]

I've sort of run out of time to work on this at the moment, so here
are my notes so far. Sorry for spamming you folks! Perhaps someone
receiving this will be able to lend some advice or assistance though,
I hope.

portlandwiki.org error message:
-----------------------------------------------------
MediaWiki internal error.

Original exception: exception 'DBQueryError' with message 'A database
error has occurred
Query: SELECT value,exptime FROM `mediawikiobjectcache` WHERE
keyname='portlandwiki_org-mediawiki:messages:en'
Function: MediaWikiBagOStuff::_doquery
Error: 1146 Table 'portlandwiki_org.mediawikiobjectcache' doesn't
exist (mysql.portlandwiki.org)
' in /home/.novak/portlandwiki/portlandwiki.org/includes/db/
Database.php:661
Stack trace:
#0 /home/.novak/portlandwiki/portlandwiki.org/includes/db/Database.php
(616): Database->reportQueryError('Table 'portland...', 1146, 'SELECT
value,ex...', 'MediaWikiBagOSt...', false)
#1 /home/.novak/portlandwiki/portlandwiki.org/includes/BagOStuff.php
(454): Database->query('SELECT value,ex...', 'MediaWikiBagOSt...')
#2 /home/.novak/portlandwiki/portlandwiki.org/includes/BagOStuff.php
(324): MediaWikiBagOStuff->_doquery('SELECT value,ex...')
#3 /home/.novak/portlandwiki/portlandwiki.org/includes/BagOStuff.php
(240): SqlBagOStuff->_query('SELECT value,ex...',
'portlandwiki_or...')
#4 /home/.novak/portlandwiki/portlandwiki.org/includes/MessageCache.php
(245): SqlBagOStuff->get('portlandwiki_or...')
#5 /home/.novak/portlandwiki/portlandwiki.org/includes/MessageCache.php
(589): MessageCache->load('en')
#6 /home/.novak/portlandwiki/portlandwiki.org/includes/MessageCache.php
(526): MessageCache->getMsgFromNamespace('Mainpage', 'en')
#7 /home/.novak/portlandwiki/portlandwiki.org/includes/StubObject.php
(58): MessageCache->get('mainpage', true, true)
#8 /home/.novak/portlandwiki/portlandwiki.org/includes/StubObject.php
(76): StubObject->_call(Array, Array)
#9 [internal function]: StubObject->__call('get', Array)
#10 /home/.novak/portlandwiki/portlandwiki.org/includes/
GlobalFunctions.php(598): StubObject->get('get', Array)
#11 /home/.novak/portlandwiki/portlandwiki.org/includes/
GlobalFunctions.php(563): wfMsgGetKey('mainpage', true, true)
#12 /home/.novak/portlandwiki/portlandwiki.org/includes/
GlobalFunctions.php(511): wfMsgReal('mainpage', true, true, true)
#13 /home/.novak/portlandwiki/portlandwiki.org/includes/Title.php
(287): wfMsgForContent()
#14 /home/.novak/portlandwiki/portlandwiki.org/includes/Wiki.php(110):
Title::newMainPage('mainpage', Array, true, true)
#15 /home/.novak/portlandwiki/portlandwiki.org/index.php(60):
MediaWiki->checkInitialQueries('mainpage')
#16 {main}

Exception caught inside exception handler: exception 'DBQueryError'
with message 'A database error has occurred
Query: SELECT * FROM `mediawikiuser` WHERE user_id = '7' LIMIT 1
Function: User::loadFromDatabase
Error: 1146 Table 'portlandwiki_org.mediawikiuser' doesn't exist
(mysql.portlandwiki.org)
' in /home/.novak/portlandwiki/portlandwiki.org/includes/db/
Database.php:661
Stack trace:
#0 /home/.novak/portlandwiki/portlandwiki.org/includes/db/Database.php
(616): Database->reportQueryError('Table 'portland...', 1146, 'SELECT
* FROM...', 'User::loadFromD...', false)
#1 /home/.novak/portlandwiki/portlandwiki.org/includes/db/Database.php
(1026): Database->query('SELECT * FROM...', 'User::loadFromD...')
#2 /home/.novak/portlandwiki/portlandwiki.org/includes/db/Database.php
(1106): Database->select('user', '*', Array, 'User::loadFromD...',
Array, Array)
#3 /home/.novak/portlandwiki/portlandwiki.org/includes/User.php(895):
Database->selectRow('user', '*', Array, 'User::loadFromD...')
#4 /home/.novak/portlandwiki/portlandwiki.org/includes/User.php(292):
User->loadFromDatabase()
#5 /home/.novak/portlandwiki/portlandwiki.org/includes/User.php(848):
User->loadFromId()
#6 /home/.novak/portlandwiki/portlandwiki.org/includes/User.php(260):
User->loadFromSession()
#7 /home/.novak/portlandwiki/portlandwiki.org/includes/User.php(1870):
User->load()
#8 /home/.novak/portlandwiki/portlandwiki.org/includes/StubObject.php
(58): User->getOption('language')
#9 /home/.novak/portlandwiki/portlandwiki.org/includes/StubObject.php
(184): StubObject->_call(Array, Array)
#10 [internal function]: StubUser->__call('getOption', Array)
#11 /home/.novak/portlandwiki/portlandwiki.org/includes/StubObject.php
(146): StubUser->getOption('getOption', Array)
#12 /home/.novak/portlandwiki/portlandwiki.org/includes/StubObject.php
(99): StubUserLang->_newObject('language')
#13 /home/.novak/portlandwiki/portlandwiki.org/includes/StubObject.php
(57): StubObject->_unstub()
#14 /home/.novak/portlandwiki/portlandwiki.org/includes/StubObject.php
(141): StubObject->_call('getCode', 5)
#15 [internal function]: StubUserLang->__call('getCode', Array)
#16 /home/.novak/portlandwiki/portlandwiki.org/includes/
GlobalFunctions.php(438): StubUserLang->getCode('getCode', Array)
#17 /home/.novak/portlandwiki/portlandwiki.org/includes/
MessageCache.php(506): wfGetLangObj()
#18 /home/.novak/portlandwiki/portlandwiki.org/includes/
GlobalFunctions.php(598): MessageCache->get()
#19 /home/.novak/portlandwiki/portlandwiki.org/includes/
GlobalFunctions.php(563): wfMsgGetKey(false)
#20 /home/.novak/portlandwiki/portlandwiki.org/includes/Exception.php
(70): wfMsgReal('databaseerror', true, false)
#21 /home/.novak/portlandwiki/portlandwiki.org/includes/db/Database.php
(2721): MWException->msg('databaseerror', true, false, true)
#22 /home/.novak/portlandwiki/portlandwiki.org/includes/Exception.php
(204): DBQueryError->getPageTitle('databaseerror', Array)
#23 /home/.novak/portlandwiki/portlandwiki.org/includes/Exception.php
(167): MWException->htmlHeader('databaseerror', 'Database error')
#24 /home/.novak/portlandwiki/portlandwiki.org/includes/Exception.php
(186): MWException->reportHTML()
#25 /home/.novak/portlandwiki/portlandwiki.org/includes/Exception.php
(284): MWException->report()
#26 /home/.novak/portlandwiki/portlandwiki.org/includes/Exception.php
(344): wfReportException()
#27 [internal function]: wfExceptionHandler()
#28 {main}


pdx.wiki.org error message:
---------------------------------------------------------------------
MediaWiki internal error.

Original exception: exception 'DBQueryError' with message 'A database
error has occurred
Query: SELECT value,exptime FROM `mediawikiobjectcache` WHERE
keyname='pdx_wiki_org-mediawiki:messages'
Function: MediaWikiBagOStuff::_doquery
Error: 1146 Table 'pdx_wiki_org.mediawikiobjectcache' doesn't exist
(mysql.pdx.wiki.org)
' in /home/.novak/wikiwednesday/pdx.wiki.org/includes/Database.php:844
Stack trace:
#0 /home/.novak/wikiwednesday/pdx.wiki.org/includes/Database.php(799):
Database->reportQueryError('Table 'pdx_wiki...', 1146, 'SELECT
value,ex...', 'MediaWikiBagOSt...', false)
#1 /home/.novak/wikiwednesday/pdx.wiki.org/includes/BagOStuff.php
(427): Database->query('SELECT value,ex...', 'MediaWikiBagOSt...')
#2 /home/.novak/wikiwednesday/pdx.wiki.org/includes/BagOStuff.php
(322): MediaWikiBagOStuff->_doquery('SELECT value,ex...')
#3 /home/.novak/wikiwednesday/pdx.wiki.org/includes/BagOStuff.php
(243): SqlBagOStuff->_query('SELECT value,ex...', 'pdx_wiki_org-
me...')
#4 /home/.novak/wikiwednesday/pdx.wiki.org/includes/MessageCache.php
(214): SqlBagOStuff->get('pdx_wiki_org-me...')
#5 /home/.novak/wikiwednesday/pdx.wiki.org/includes/MessageCache.php
(434): MessageCache->load()
#6 /home/.novak/wikiwednesday/pdx.wiki.org/includes/StubObject.php
(32): MessageCache->get('mainpage', true, true)
#7 /home/.novak/wikiwednesday/pdx.wiki.org/includes/StubObject.php
(40): StubObject->_call(Array, Array)
#8 [internal function]: StubObject->__call('get', Array)
#9 /home/.novak/wikiwednesday/pdx.wiki.org/includes/GlobalFunctions.php
(427): StubObject->get('get', Array)
#10 /home/.novak/wikiwednesday/pdx.wiki.org/includes/
GlobalFunctions.php(396): wfMsgGetKey('mainpage', true, true)
#11 /home/.novak/wikiwednesday/pdx.wiki.org/includes/
GlobalFunctions.php(344): wfMsgReal('mainpage', true, true, true)
#12 /home/.novak/wikiwednesday/pdx.wiki.org/includes/Title.php(271):
wfMsgForContent()
#13 /home/.novak/wikiwednesday/pdx.wiki.org/includes/Wiki.php(84):
Title::newMainPage('mainpage', Array, true, true)
#14 /home/.novak/wikiwednesday/pdx.wiki.org/index.php(59): MediaWiki-
>checkInitialQueries('mainpage')
#15 {main}

Exception caught inside exception handler: exception
'DBUnexpectedError' with message 'Error in fetchObject(): Table
'pdx_wiki_org.mediawikipage' doesn't exist (mysql.pdx.wiki.org)' in /
home/.novak/wikiwednesday/pdx.wiki.org/includes/Database.php:973
Stack trace:
#0 /home/.novak/wikiwednesday/pdx.wiki.org/includes/MessageCache.php
(307): Database->fetchObject(false)
#1 /home/.novak/wikiwednesday/pdx.wiki.org/includes/MessageCache.php
(244): MessageCache->loadFromDB()
#2 /home/.novak/wikiwednesday/pdx.wiki.org/includes/MessageCache.php
(434): MessageCache->load()
#3 /home/.novak/wikiwednesday/pdx.wiki.org/includes/GlobalFunctions.php
(427): MessageCache->get('databaseerror', true, false)
#4 /home/.novak/wikiwednesday/pdx.wiki.org/includes/GlobalFunctions.php
(396): wfMsgGetKey('databaseerror', true, false, true)
#5 /home/.novak/wikiwednesday/pdx.wiki.org/includes/Exception.php(43):
wfMsgReal('databaseerror', Array)
#6 /home/.novak/wikiwednesday/pdx.wiki.org/includes/Database.php(292):
MWException->msg('databaseerror', 'Database error')
#7 /home/.novak/wikiwednesday/pdx.wiki.org/includes/Exception.php
(148): DBQueryError->getPageTitle()
#8 /home/.novak/wikiwednesday/pdx.wiki.org/includes/Exception.php
(116): MWException->htmlHeader()
#9 /home/.novak/wikiwednesday/pdx.wiki.org/includes/Exception.php
(134): MWException->reportHTML()
#10 /home/.novak/wikiwednesday/pdx.wiki.org/includes/Exception.php
(213): MWException->report()
#11 /home/.novak/wikiwednesday/pdx.wiki.org/includes/Exception.php
(247): wfReportException()
#12 [internal function]: wfExceptionHandler(Object(DBQueryError))
#13 {main}


After a quick glance, these error messages look basically the same,
and the problem occurred at the same time, so I'm assuming it's the
same problem for both.

Looking through the server files of both wikis, I don't see any of
them being modified after my last update to PortlandWiki's
LocalSettings.php on the 8th, so I don't think the problem is caused
by anyone altering or adding any of the server files. Someone could
have deleted files, though (I don't have access to the actual server
logs as far as I know though so I can't verify).

Some links that may be useful:
http://www.mediawiki.org/wiki/How_to_debug_MediaWiki

Reinstalling mediawiki might help, but I'm not sure how many, if any,
of the customizations we've made (to LocalSettings.php, the
extensions, and the skin/logo mostly) would then be lost. We already
have the latest version (1.15) on PortlandWiki though, so I don't
think reinstalling it would solve anything (PDXWW wiki is version 1.12
by the way).

Some other ideas: both wikis have the ConfirmEdit extension installed
(this is the CAPTCHA). I don't know if this could have been used to
compromise the system. It's the only thing I can think of, though,
that both wikis share (they have different versions of MediaWiki and
are on different servers). Oh, there is one other thing they share:
both appear to have a configuration where the wiki folder is basically
the root folder (most MediaWiki installations are in a dedicated
"wiki" folder, as often visible by the "/wiki/" in urls like
http://en.wikipedia.org/wiki/Main_Page. When I was researching how to
shorten the URLs in PortlandWiki to strip out the technical info like
"index.php?title=", they said it can be dangerous to put the wiki in
the root folder. Odd though that it would break both wikis
simultaneously though, unless it involves some exploit that a cracker
could utilize in a spree attack across many wikis (which would also be
odd, since I haven't seen anyone else complain about this in my recent
searches). Anyway, this page talks about it: http://www.mediawiki.org/wiki/Manual:Short_URL

The people in the #MediaWiki IRC room on irc.freenode.net might be
able to help. This also perhaps:
http://www.mediawiki.org/wiki/Manual:FAQ#I.27m_getting_a_strange_error._What_now.3F

I'll try to take another look later tonight or tomorrow.

kotra

[Mark Dilley]

it went down thursday night - i think it is a dreamhost problem - but
maybe dreamhost crash corrupted the db...