dkpro cause exception for stop word removing programme

9 views
Skip to first unread message

Pooja Patel

unread,
Jan 8, 2018, 6:31:14 AM1/8/18
to DKPro Statistics Users
Hello Sir,
             My self Pooja ( M.Tech Student, SCET, Surat ). I am using Dkpro core with maven in netbeans for my project related to natural language processing. I run the core module for tokenization, lemmatization and PoS tagging. They work as per requirement. But Stopwordremoval is not work in my programme. I attached my code as below. My programme not run Jcas object. It's not take the value of Jcas Object. i passed all the parameter pass to Jcas as syntex but still it not give me require output. for tracing exectution of each line i put each sentence in try catch loop. Please give me solution for my problem. 

Thank you so much...

CODE:  


import de.tudarmstadt.ukp.dkpro.core.api.segmentation.type.Token;
import static org.apache.uima.fit.factory.AnalysisEngineFactory.createEngineDescription;
import static org.apache.uima.fit.factory.CollectionReaderFactory.createReaderDescription;
import static org.apache.uima.fit.pipeline.SimplePipeline.runPipeline;
import de.tudarmstadt.ukp.dkpro.core.io.conll.Conll2006Writer;
import de.tudarmstadt.ukp.dkpro.core.io.text.TextReader;
import de.tudarmstadt.ukp.dkpro.core.languagetool.LanguageToolLemmatizer;
import de.tudarmstadt.ukp.dkpro.core.maltparser.MaltParser;
import de.tudarmstadt.ukp.dkpro.core.opennlp.OpenNlpPosTagger;
import de.tudarmstadt.ukp.dkpro.core.opennlp.OpenNlpSegmenter;
import de.tudarmstadt.ukp.dkpro.core.stopwordremover.StopWordRemover;
import static de.tudarmstadt.ukp.dkpro.core.testing.AssertAnnotations.assertToken;
import de.tudarmstadt.ukp.dkpro.core.testing.DkproTestContext;
import de.tudarmstadt.ukp.dkpro.core.testing.TestRunner;
import java.io.IOException;
import java.net.URL;
import org.apache.uima.UIMAException;
import org.apache.uima.analysis_engine.AnalysisEngineDescription;
import static org.apache.uima.fit.factory.AnalysisEngineFactory.createEngineDescription;
import static org.apache.uima.fit.util.JCasUtil.select;
import org.apache.uima.jcas.JCas;

public class gurudev {
    
      public DkproTestContext testContext = new DkproTestContext();
     public static String LANGUAGE = "en"; 
     public static String TEXT = "This is a text containing stopwords ."; 
      public static String STOPWORDSFILE_LOCATION1 = "C:/Users/KEVIN/Documents/NetBeansProjects/mavenproject2/src/main/java/txt3.txt"; 
      public  static  String[] expectedTokens = new String[] { "text", "containing", "stopwords", "." }; 
      public static AnalysisEngineDescription stopwordremover ;
      public static JCas jcas; 
 
    public static void main(String args[])  throws IOException, UIMAException
    {
        try
        {    
        stopwordremover = createEngineDescription(StopWordRemover.class, 
        StopWordRemover.PARAM_MODEL_LOCATION,STOPWORDSFILE_LOCATION1); 
        System.out.println("Hello");
        }
        catch(Exception ex)
        {
            System.out.print(ex);
        }
        try
        {
        jcas = TestRunner.runTest(stopwordremover, LANGUAGE, TEXT);
        System.out.println("Hello1");
        }
        catch(Exception ex)
        {
            System.out.print(ex);
        }
         try
        {
        System.out.println("test" + jcas);
        }
        catch(Exception ex)
        {
            System.out.print(ex);
        }
         try
         {
        assertToken(expectedTokens, select(jcas, Token.class)); 
        }
        catch(Exception ex)
        {
            System.out.print(ex);
        }
         
    }
    
}

Output:



chmey...@gmail.com

unread,
Jan 8, 2018, 7:44:34 AM1/8/18
to DKPro Statistics Users
This mailing list is targeted at DKPro Statistics (https://dkpro.github.io/dkpro-statistics/). Please have a look at DKPro Core documentation and community: https://dkpro.github.io/dkpro-core/documentation/ and https://dkpro.github.io/dkpro-core/pages/mailinglists/
-Christian
Reply all
Reply to author
Forward
0 new messages