Issues

123 views
Skip to first unread message

Rosie White

unread,
Mar 2, 2020, 1:55:44 PM3/2/20
to AntConc-Discussion
Hi I’ve been having some trouble running Antconc when I use a large data set (around 700 .txt files) it works on about 100 files but slows / freezes when I try to do much more. I am working on a MacBook with only 4GB of RAM do you think this could be the issue? If so how much RAM do you think I would need? If you have any other tips on speeding things up & improving performance with large data sets I’d appreciate it. (Processor of comp is 1.4 GHz intel i5). Many thanks for your wonderful software!

Talea Gotm

unread,
Mar 2, 2020, 2:45:35 PM3/2/20
to ant...@googlegroups.com
I have an 8gb RAM and a corpora of 1 Million words. This works perfect. Hope it helps. 

Rosie White <rosie...@hotmail.co.uk> schrieb am Mo., 2. März 2020, 19:55:
Hi I’ve been having some trouble running Antconc when I use a large data set (around 700 .txt files) it works on about 100 files but slows / freezes when I try to do much more. I am working on a MacBook with only 4GB of RAM do you think this could be the issue? If so how much RAM do you think I would need? If you have any other tips on speeding things up & improving performance with large data sets I’d appreciate it. (Processor of comp is 1.4 GHz intel i5). Many thanks for your wonderful software!

--
You received this message because you are subscribed to the Google Groups "AntConc-Discussion" group.
To unsubscribe from this group and stop receiving emails from it, send an email to antconc+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/antconc/0675e5ec-ecb6-4bc7-b2f7-88be86dc6718%40googlegroups.com.

Warren Tang

unread,
Mar 2, 2020, 3:58:39 PM3/2/20
to ant...@googlegroups.com
Try an older version like 2.5.3 which is using lighter code. The links are on Lawrence’s site, here:

Anything before 2.5.4 is fast. If memory serves me correctly 2.4.1 is the version which was least buggy. 

Good luck. 


Warren

On Tue, Mar 3, 2020 at 3:55 Rosie White <rosie...@hotmail.co.uk> wrote:
Hi I’ve been having some trouble running Antconc when I use a large data set (around 700 .txt files) it works on about 100 files but slows / freezes when I try to do much more. I am working on a MacBook with only 4GB of RAM do you think this could be the issue? If so how much RAM do you think I would need? If you have any other tips on speeding things up & improving performance with large data sets I’d appreciate it. (Processor of comp is 1.4 GHz intel i5). Many thanks for your wonderful software!

--
You received this message because you are subscribed to the Google Groups "AntConc-Discussion" group.
To unsubscribe from this group and stop receiving emails from it, send an email to antconc+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/antconc/0675e5ec-ecb6-4bc7-b2f7-88be86dc6718%40googlegroups.com.
--
Sent from iPhone

Laurence Anthony

unread,
Mar 5, 2020, 6:01:25 PM3/5/20
to ant...@googlegroups.com
Hi Rosie,

If you have a MacBook with only 4GB of RAM, I suspect much of that RAM is being used to run the operating system. So, you won't have much left to see results.

The problem will not be related to the number of files that you are looking at, though. There are only two things that affect the performance of AntConc:

1) The size of the file. AntConc has to open a file and read it before any processing can occur. If any one of files is very large requiring a lot of memory to read, that can cause AntConc to slow or freeze.

2) The number results generated. AntConc has to show the all the results of a search on the screen which takes up memory. If you generate many, many results that can also impact on the performance.

Try searching for a rare term with your 700 files and you should see that it works fine. If it doesn't, it means that the problem is probably 1) above.

I hope that helps.

Regards,

Laurence.

###############################################################
Laurence ANTHONY, Ph.D.
Professor of Applied Linguistics
Faculty of Science and Engineering
Waseda University
3-4-1 Okubo, Shinjuku-ku, Tokyo 169-8555, Japan
E-mail: antho...@gmail.com
WWW: http://www.laurenceanthony.net/
###############################################################


Rosie White

unread,
Mar 11, 2020, 9:09:16 AM3/11/20
to AntConc-Discussion
Thank you I will give all of these a try. KB/MB wise what would count as a big file? Will manually scan through the corpus and see if there is any 1 file tripping it up.

Laurence Anthony

unread,
Mar 11, 2020, 7:00:42 PM3/11/20
to ant...@googlegroups.com
Hi Rosie,

Just take your folder of files, sort them by size, and then take the smallest say 200 files and test them. If it works, you'll know that the number of files is not the problem.

Laurence.

###############################################################
Laurence ANTHONY, Ph.D.
Professor of Applied Linguistics
Faculty of Science and Engineering
Waseda University
3-4-1 Okubo, Shinjuku-ku, Tokyo 169-8555, Japan
E-mail: antho...@gmail.com
WWW: http://www.laurenceanthony.net/
###############################################################

On Wed, 11 Mar 2020 at 22:09, Rosie White <rosie...@hotmail.co.uk> wrote:
Thank you I will give all of these a try. KB/MB wise what would count as a big file? Will manually scan through the corpus and see if there is any 1 file tripping it up.

--
You received this message because you are subscribed to the Google Groups "AntConc-Discussion" group.
To unsubscribe from this group and stop receiving emails from it, send an email to antconc+u...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages