Running YodaQA with just wiki source

22 views
Skip to first unread message

Chris

unread,
Sep 15, 2016, 5:39:27 PM9/15/16
to qa-oss
Hi all,

I am trying to run YodaQA on just the plaintext wiki data

I have downloaded the wikipedia data (around 12 gigs), processed it using the provided script and loaded it into my own solr instance and updated conf/backendURLs to make it use my own solr instance.

Now I want to stop yodaQA from using all other sources (dbpedia etc) mentioned on the backendURLs and use only wiki text data (with the hopes that I can replace this with any custom data and use yodaQA on it).. Any pointers on how I can accomplish that?

Thanks in advance!

Petr Baudis

unread,
Sep 21, 2016, 12:27:50 PM9/21/16
to Chris, qa-oss
Hi!
Note that DBpedia is used not only for generating answers, but also
for type inference and named entity recognition / linking.

If you would like to disable these data sources for generating
answers, though, that can be done by editing

src/main/java/cz/brmlab/yodaqa/pipeline/YodaQA.java

the last method createAnswerProducerDescription() - comment out the
DBpedia / Freebase references, and replace 7 by 4 as
AnswerCASMerger.PARAM_ISLAST_BARRIER around line 142 in the same file,
per the comment nearby in createAnswerProducerDescription().

Kind regards,

--
Petr Baudis
Never! Run before you walk! Fly before you crawl!
Keep moving forward! Because if we fail, I'd rather fail
really hugely. All or nothing! -- Moist Von Lipwig
Reply all
Reply to author
Forward
0 new messages