data intensive js to load in exhibit 2.0

[asmi]

Hi all,

I am using exhibit tool to display biological data on web. This comes from high throughput bio-imaging, so say the records in json data file are more than 20,000. A working example with lesser data is here : http://141.52.175.68:8080/experiments/askmeportal-gehrig.html

Now with around 1000 records all works perfectly fine. But for my usage 20000 records, firefox keeps on crashing plus after the usage of 2GB of ram. Is there any intelligent way to get it working somehow? say, just load the first 100 records in the browser's memory? Any input related to this is appreciated. Thanks a lot already.  

best,

asmi

[David Karger]

Asmi, you might want to take a look at exhibit3, which has been designed
for better scaling. It is mostly backwards compatible with exhibit 2:
http://simile-widgets.org/exhibit3
However, exhibit 2 has been used successfully for data sets as large as
27,000 items, so there's no a priori reason it should not work for you.
how many fields does each record have? do you need all of them?
discarding fields is a good way to slim the data.

> --
> You received this message because you are subscribed to the Google
> Groups "SIMILE Widgets" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/simile-widgets/-/OqTKSieEcY4J.
> To post to this group, send email to simile-...@googlegroups.com.
> To unsubscribe from this group, send email to
> simile-widget...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/simile-widgets?hl=en.

[Asmi Shah]

Hi David,

Thanks a lot for your reply. I am looking into 3.0 now. I have typically 35+ fields and I generate html files on the fly so narrowing down the data is a challenge, that's where I am focusing on now. If I am including images and also some video files are they also included in the database which is created in browser's memory? because this could be taking up the memory too. Can you please give me an estimate of what could be handled by exhibit3 like 20000 records * 20 fields? and I would try to tailor my data likewise.

On Fri, Mar 16, 2012 at 10:42 PM, David Karger <kar...@mit.edu> wrote:

Asmi, you might want to take a look at exhibit3, which has been designed for better scaling. It is mostly backwards compatible with exhibit 2:
http://simile-widgets.org/exhibit3
However, exhibit 2 has been used successfully for data sets as large as 27,000 items, so there's no a priori reason it should not work for you.
how many fields does each record have?  do you need all of them?  discarding fields is a good way to slim the data.

On 3/2/2012 9:58 AM, asmi wrote:

Hi all,

I am using exhibit tool to display biological data on web. This comes from high throughput bio-imaging, so say the records in json data file are more than 20,000. A working example with lesser data is here : http://141.52.175.68:8080/experiments/askmeportal-gehrig.html

Now with around 1000 records all works perfectly fine. But for my usage 20000 records, firefox keeps on crashing plus after the usage of 2GB of ram. Is there any intelligent way to get it working somehow? say, just load the first 100 records in the browser's memory? Any input related to this is appreciated. Thanks a lot already.

best,
asmi

--
You received this message because you are subscribed to the Google Groups "SIMILE Widgets" group.
To view this discussion on the web visit https://groups.google.com/d/msg/simile-widgets/-/OqTKSieEcY4J.

To post to this group, send email to simile-widgets@googlegroups.com.
To unsubscribe from this group, send email to simile-widgets+unsubscribe@googlegroups.com.

For more options, visit this group at http://groups.google.com/group/simile-widgets?hl=en.

--
Regards,
Asmi Shah