TagAnt issue

[Alexander Kautzsch]

Dear Laurence,

I'm just trying to use TagAnt on the written component of ICE-US (converted to UTF-8) and it seems that some files are not processed, i.e. TagAnt will not really crash but continue tagging a certain file on end and won't create at a tagged file. The files are about 2000 words in size. So that shouldn't be a problem, right? Any idea?

Best,
Alex

[Laurence Anthony]

Hi Alex,

Have you checked to make sure the file encoding is correct (UTF-8)? Perhaps use my EncodeAnt tool to check it.

Regards,

Laurence.

###############################################################
Laurence ANTHONY, Ph.D.
Professor
Center for English Language Education in Science and Engineering (CELESE)
Faculty of Science and Engineering
Waseda University
3-4-1 Okubo, Shinjuku-ku, Tokyo 169-8555, Japan
E-mail: antho...@gmail.com
WWW: http://www.laurenceanthony.net/
###############################################################

--
You received this message because you are subscribed to the Google Groups "AntConc-discussion" group.
To unsubscribe from this group and stop receiving emails from it, send an email to antconc+u...@googlegroups.com.
To post to this group, send email to ant...@googlegroups.com.
Visit this group at https://groups.google.com/group/antconc.
For more options, visit https://groups.google.com/d/optout.

[Alexander Kautzsch]

Hi Laurence,

thanks for your swift reply. This is actually what I did before tagging. What I have not done is check the outcome of the conversion to UTF-8. When I run "detect encoding" on the files in the utf8 folder, It seems that most files retain their original encoding (mostly ASCII, some TIS-620, some ISO-8859-2, some others). Do I need to change the settings somewhere?

Thanks again and best regards,
Alex

[Laurence Anthony]

Hi, 

ASCII should be fine as it's a subset of UTF-8. TIS-620 and ISO-8859-2 are almost certainly EncodeAnt guesses that are incorrect, but they do indicate that the files are not saved in UTF-8 from the outset. I suggest opening the problem files in Notepad++ and recoding them as UTF-8.

Laurence.

###############################################################
Laurence ANTHONY, Ph.D.
Professor
Center for English Language Education in Science and Engineering (CELESE)
Faculty of Science and Engineering
Waseda University
3-4-1 Okubo, Shinjuku-ku, Tokyo 169-8555, Japan
E-mail: antho...@gmail.com
WWW: http://www.laurenceanthony.net/
###############################################################

[Alexander Kautzsch]

Hi,
thanks for the suggestions. None of this worked, but I found the solution.
TagAnt had problems only with two files that were originally encoded in ASCII; after converting them to UTF-8 the problem was still there.
I browsed through the files in notepad++,  found one "sub" (substitution character, right?) in each file, deleted the "sub" and then TagAnt worked.
Sorry to have bothered you and thanks for your help and time, and four your amazing tools, of course! Could have said that earlier ;)
Best,
Alex

[Laurence Anthony]

Hi  again,

Thanks for the nice comments.

What do you mean by "sub"? 

[Alexander Kautzsch]

Hi Laurence,
what I mean by "sub" is shown in the screenshot below (taken from Notepad++ ). As soon as I delete the "sub", TagAnt works perfectly.
Best,
Alex

[Laurence Anthony]

Hi,

Ah, the SUB is a weird character that has been introduced through some weird file saving. 

https://en.wikipedia.org/wiki/Substitute_character

Yes, you need to delete it. With a program like Notepad++, you can simply search and delete all the SUBs in all the files in an instant.

Laurence.

###############################################################
Laurence ANTHONY, Ph.D.
Professor
Center for English Language Education in Science and Engineering (CELESE)
Faculty of Science and Engineering
Waseda University
3-4-1 Okubo, Shinjuku-ku, Tokyo 169-8555, Japan
E-mail: antho...@gmail.com
WWW: http://www.laurenceanthony.net/
###############################################################

--