Importing .txt files

[Adrian Stenton]

Hello, I’ve just started using AntConc 4.3.1 for MacOS. When I import .txt files from a folder containing 556 files, only 424 were imported. Does this mean that the rest were corrupt?

[Laurence Anthony]

Hi Adrian,

My guess is that the rest were not properly encoded in UTF-8. If you go to the Global file settings, you can have AntConc ignore errors in your files. I wouldn't recommend this, but you might try it to establish that it is an encoding problem.

Regards,

Laurence.

###############################################################
Laurence ANTHONY, Ph.D.
Professor of Applied Linguistics
Faculty of Science and Engineering
Waseda University
3-4-1 Okubo, Shinjuku-ku, Tokyo 169-8555, Japan
E-mail: antho...@gmail.com
WWW: http://www.laurenceanthony.net/
###############################################################

On Thu, 3 Oct 2024 at 11:27, Adrian Stenton <adrian...@gmail.com> wrote:

Hello, I’ve just started using AntConc 4.3.1 for MacOS. When I import .txt files from a folder containing 556 files, only 424 were imported. Does this mean that the rest were corrupt?

--
You received this message because you are subscribed to the Google Groups "AntConc-Discussion" group.
To unsubscribe from this group and stop receiving emails from it, send an email to antconc+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/antconc/5edd4303-96fd-4e04-81a0-2328c7a2d1b8n%40googlegroups.com.

[Adrian Stenton]

Thanks, Laurence. That seems to be exactly right. I’ll try reformatting the files, which were originally converted from .docx to .txt about seven years ago.

With best wishes, Adrian

[Laurence Anthony]

Hi Adrian,

If you have the original doc files, I'd recommend you just load those directly into AntConc. Converting docx files to txt can lead to all sorts of trouble, so it's better to just let AntConc process the files as necessary.

I hope that helps!

Laurence.

###############################################################
Laurence ANTHONY, Ph.D.
Professor of Applied Linguistics
Faculty of Science and Engineering
Waseda University
3-4-1 Okubo, Shinjuku-ku, Tokyo 169-8555, Japan
E-mail: antho...@gmail.com
WWW: http://www.laurenceanthony.net/
###############################################################

--

You received this message because you are subscribed to the Google Groups "AntConc-Discussion" group.
To unsubscribe from this group and stop receiving emails from it, send an email to antconc+u...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/antconc/33239ac8-94fe-46dd-a4f5-c7143a347458n%40googlegroups.com.

[Adrian Stenton]

Thanks, Laurence. That’s interesting. I’d always assumed that .txt files were better (because they’re simpler?), but I’ll use the .docx files instead. I finally worked out that my problem was down to about half of my Word files being .doc rather than .docx. Both AntConc and AntFileConverter tend to spit out the .doc files!

All the best, Adrian

To view this discussion on the web visit https://groups.google.com/d/msgid/antconc/CAL6Fgv1MLt87oEwnDWAu9NcCEvcJ%3Dg0VqEV2jMWF1gQuqaFUdw%40mail.gmail.com.

[Laurence Anthony]

Have you tried the latest versions of AntConc and AntWordProfiler? They should support doc files (as well as docx files).

Laurence.

###############################################################
Laurence ANTHONY, Ph.D.
Professor of Applied Linguistics
Faculty of Science and Engineering
Waseda University
3-4-1 Okubo, Shinjuku-ku, Tokyo 169-8555, Japan
E-mail: antho...@gmail.com
WWW: http://www.laurenceanthony.net/
###############################################################

To view this discussion on the web visit https://groups.google.com/d/msgid/antconc/CAHGGLkZndbASgWtnYzhe_MsnrGPWpUDrANKswk56XCjcj9D14w%40mail.gmail.com.

[Adrian Stenton]

Laurence, To clarify: If I try to load my 555 files through “Quick Corpus” I lose about 200 files with that error message. It I try to load those same files through “Corpus Manager” it rejects just the one file. I’ll continue with “Corpus Manager”!

Adrian

On Sat, Oct 5, 2024 at 3:49 PM Adrian Stenton <adrian...@gmail.com> wrote:

Hi Laurence,

I’m using AntConc 4.3.1 and AntFileConverter 2.1.0 and I get the same message in both cases:

"UnicodeDecodeError: 'utf-8' codec can't decode byte 0xd0 in position 0: invalid continuation byte”

Adrian

To view this discussion on the web visit https://groups.google.com/d/msgid/antconc/CAL6Fgv2GEhwq7w39ZjYwFim%3D5QBVL7OHwBLa31S8Zxxi00sDZQ%40mail.gmail.com.

[Adrian Stenton]

Hi Laurence,

I’m using AntConc 4.3.1 and AntFileConverter 2.1.0 and I get the same message in both cases:

"UnicodeDecodeError: 'utf-8' codec can't decode byte 0xd0 in position 0: invalid continuation byte”

Adrian

To view this discussion on the web visit https://groups.google.com/d/msgid/antconc/CAL6Fgv2GEhwq7w39ZjYwFim%3D5QBVL7OHwBLa31S8Zxxi00sDZQ%40mail.gmail.com.

[Laurence Anthony]

That's interesting. Both the Quick Corpus and Corpus Manager are using the same back engine. Have you changed the settings to ignore Unicode errors? I wonder if that might be affecting things. If you are allowed to send me your corpus, I can have a look at it here.

Laurence.

###############################################################
Laurence ANTHONY, Ph.D.
Professor of Applied Linguistics
Faculty of Science and Engineering
Waseda University
3-4-1 Okubo, Shinjuku-ku, Tokyo 169-8555, Japan
E-mail: antho...@gmail.com
WWW: http://www.laurenceanthony.net/
###############################################################

To view this discussion on the web visit https://groups.google.com/d/msgid/antconc/CAHGGLkbAv15ATjD6w-xGHEV2iF5Y3dDY%3DjaSi5zGmUkZNtxMwg%40mail.gmail.com.

[Adrian Stenton]

That’s very kind of you. The copyright owner doesn’t permit the sharing of the data for analysis, but I assume they would be OK with sharing for technical issues. The .zip file is 232.9 MB. Are you OK with that?

I have tried switching to “Ignore errors”, and that resulted in fewer files being imported (232/555 vs. 305/555).

Adrian

To view this discussion on the web visit https://groups.google.com/d/msgid/antconc/CAL6Fgv1UhDvZF3e_44%3DTjRL5aVU4zBgVavHSPp-p8iF_x2aAPA%40mail.gmail.com.

[Laurence Anthony]

Hi,

I'm mostly intrigued about the difference between the Quick Corpus and Corpus Manager. They should act the same way. If you can email a link to say a Drive folder with the corpus in it, that would be fine.

Laurence.

###############################################################
Laurence ANTHONY, Ph.D.
Professor of Applied Linguistics
Faculty of Science and Engineering
Waseda University
3-4-1 Okubo, Shinjuku-ku, Tokyo 169-8555, Japan
E-mail: antho...@gmail.com
WWW: http://www.laurenceanthony.net/
###############################################################

To view this discussion on the web visit https://groups.google.com/d/msgid/antconc/CAHGGLkZLaj2Zt_cA__7bcUC%3DPCTDx-Yv_Poph_vxZ06pQkanFQ%40mail.gmail.com.

[Adrian Stenton]

Hi Laurence, You should have been sent a link by e-mail to my <AntConc files> folder on Google Drive.

Adrian

To view this discussion on the web visit https://groups.google.com/d/msgid/antconc/CAL6Fgv0kW%3Dx_6CTMStzE69%3D-dOHjKwojDUBxLuv3%3Dg%3D0weEwMQ%40mail.gmail.com.

[Laurence Anthony]

Hi,

I've got it. Thanks! I'll reply back to you directly and perhaps you can report here was the conclusion was.

Laurence.

###############################################################
Laurence ANTHONY, Ph.D.
Professor of Applied Linguistics
Faculty of Science and Engineering
Waseda University
3-4-1 Okubo, Shinjuku-ku, Tokyo 169-8555, Japan
E-mail: antho...@gmail.com
WWW: http://www.laurenceanthony.net/
###############################################################

To view this discussion on the web visit https://groups.google.com/d/msgid/antconc/CAHGGLka85o7wcZCUq9qDFP2ukyvcXoZzf82f-Fkip9bnhvx%3DVw%40mail.gmail.com.

[Adrian Stenton]

Will do.

Adrian

To view this discussion on the web visit https://groups.google.com/d/msgid/antconc/CAL6Fgv2JpC6nk%3DoC8TL1xPhcod6wWEB8POi9iz1mvZfdBO1enA%40mail.gmail.com.