Memory issues
54 views
Skip to first unread message
Derek den Haas
Jun 22, 2016, 9:03:44 AM6/22/16
to RavenDB - 2nd generation document database
I was searching for a solution to the memory problem I have.
2 databases, 8gb memory, 80% usage of memory (standard), but if you search, save a bit and do some more stuff, it will eventually hit > 90%, then unresponsilbe for 30 seconds (doing a GC?) and then back to 78 / 80% memory usage.
When checking the databases I saw:
"ApproximateTaskCount": 93058,
With a database doing currently nothing, it seemed a bit high. Same database on my other server (without having apps on it) has 0 tasks. Could this be the problem? Or should I look somewhere else?
Grisha Kotler
Jun 22, 2016, 9:10:46 AM6/22/16
to rav...@googlegroups.com
Hi,
There was a bug related to processing tasks (delete from index tasks) in previous builds.
What build are you using?
Hibernating Rhinos Ltd 
Grisha Kotler l RavenDB Core Team Developer l Mobile: +972-54-586-8647
Office: +972-4-622-7811 l Fax: +972-153-4-622-7811
RavenDB paving the way to "Data Made Simple" http://ravendb.net/
--
You received this message because you are subscribed to the Google Groups "RavenDB - 2nd generation document database" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ravendb+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Derek den Haas
Jun 22, 2016, 9:24:39 AM6/22/16
to RavenDB - 2nd generation document database
30115
Op woensdag 22 juni 2016 15:10:46 UTC+2 schreef Grisha Kotler:
Op woensdag 22 juni 2016 15:10:46 UTC+2 schreef Grisha Kotler:
Derek den Haas
Jun 22, 2016, 9:26:56 AM6/22/16
to RavenDB - 2nd generation document database
ps would this also cause memory issues?
Op woensdag 22 juni 2016 15:24:39 UTC+2 schreef Derek den Haas:
Op woensdag 22 juni 2016 15:24:39 UTC+2 schreef Derek den Haas:
Grisha Kotler
Jun 22, 2016, 9:46:42 AM6/22/16
to rav...@googlegroups.com
It would cause high CPU usage.
The fix is already in this build.
Anything in the logs?
What is the tasks count now?
Hibernating Rhinos Ltd 
Grisha Kotler l RavenDB Core Team Developer l Mobile: +972-54-586-8647
Office: +972-4-622-7811 l Fax: +972-153-4-622-7811
RavenDB paving the way to "Data Made Simple" http://ravendb.net/
Derek den Haas
Jun 22, 2016, 10:17:38 AM6/22/16
to RavenDB - 2nd generation document database
ApproximateTaskCount": 95121,
But 0 ~ 5% CPU usage...
Op woensdag 22 juni 2016 15:46:42 UTC+2 schreef Grisha Kotler:
But 0 ~ 5% CPU usage...
Op woensdag 22 juni 2016 15:46:42 UTC+2 schreef Grisha Kotler:
Grisha Kotler
Jun 22, 2016, 10:33:02 AM6/22/16
to rav...@googlegroups.com
Any index errors? What do you see in the logs?
Hibernating Rhinos Ltd 
Grisha Kotler l RavenDB Core Team Developer l Mobile: +972-54-586-8647
Office: +972-4-622-7811 l Fax: +972-153-4-622-7811
RavenDB paving the way to "Data Made Simple" http://ravendb.net/
Derek den Haas
Jun 22, 2016, 11:05:41 AM6/22/16
to RavenDB - 2nd generation document database
Logs in studio only complaining about replication (20 hours ago) but that was due to my other test server which wasn't running.
Tasks:
Raven.Database.Tasks.RemoveFromIndexTask 90 DistributedPurchaseDebtorArticleSortLabelAll 194
2016-06-15T09:34:55.2587753Z
2016-06-22T14:27:19.4365643Z
(TaskId was 194 here...)
Debug log isn't showing that much usable info (loads of "replication" messages).
Op woensdag 22 juni 2016 16:33:02 UTC+2 schreef Grisha Kotler:
Op woensdag 22 juni 2016 16:33:02 UTC+2 schreef Grisha Kotler:
Grisha Kotler
Jun 22, 2016, 11:15:22 AM6/22/16
to rav...@googlegroups.com
Can you create a debug info package?
Hibernating Rhinos Ltd 
Grisha Kotler l RavenDB Core Team Developer l Mobile: +972-54-586-8647
Office: +972-4-622-7811 l Fax: +972-153-4-622-7811
RavenDB paving the way to "Data Made Simple" http://ravendb.net/
Derek den Haas
Jun 22, 2016, 2:14:40 PM6/22/16
to RavenDB - 2nd generation document database
[
{
"Id": 52073,
"IndexId": 141,
"IndexName": "ArticleSearchAll",
"AddedTime": "2016-06-15T09:34:55.2587753Z",
"Type": "Raven.Database.Tasks.RemoveFromIndexTask"
},
{
"Id": 52125,
"IndexId": 90,
"IndexName": "DistributedPurchaseDebtorArticleSortLabelAll",
"AddedTime": "2016-06-15T09:34:55.2587753Z",
"Type": "Raven.Database.Tasks.RemoveFromIndexTask"
},
{
"Id": 52361,
"IndexId": 90,
"IndexName": "DistributedPurchaseDebtorArticleSortLabelAll",
"AddedTime": "2016-06-15T09:38:07.5004839Z",
"Type": "Raven.Database.Tasks.RemoveFromIndexTask"
},
etc...
Version.json
{
"ProductVersion": "957b8e9",
"BuildVersion": 30115
}
System utilization:
{
"TotalPhysicalMemory": "8.191 MB",
"AvailableMemory": "3.239 MB",
"CurrentCpuUsage": [
{
"Name": "_Total",
"Usage": "0 %"
},
{
"Name": "0",
"Usage": "0 %"
},
{
"Name": "1",
"Usage": "0 %"
},
{
"Name": "2",
"Usage": "0 %"
},
{
"Name": "3",
"Usage": "0 %"
}
]
}
Op woensdag 22 juni 2016 17:15:22 UTC+2 schreef Grisha Kotler:
Derek den Haas
Jun 22, 2016, 2:16:12 PM6/22/16
to RavenDB - 2nd generation document database
Just to let you know:
{
"Id": 130194,
"IndexId": 90,
"IndexName": "DistributedPurchaseDebtorArticleSortLabelAll",
"AddedTime": "2016-06-22T05:35:16.9875805Z",
"Type": "Raven.Database.Tasks.RemoveFromIndexTask"
},
{
"Id": 130539,
"IndexId": 141,
"IndexName": "ArticleSearchAll",
"AddedTime": "2016-06-22T06:00:12.1062242Z",
"Type": "Raven.Database.Tasks.RemoveFromIndexTask"
},
These indexes are there hundred of times, the 2 indexes are disabled by the way.
Op woensdag 22 juni 2016 20:14:40 UTC+2 schreef Derek den Haas:
Oren Eini (Ayende Rahien)
Jun 22, 2016, 3:01:22 PM6/22/16
to ravendb
Which mean that we have to parse those tasks, then discard them.
Try deleting them, instead
Hibernating Rhinos Ltd
Oren Eini l CEO l Mobile: + 972-52-548-6969
Reply all
Reply to author
Forward
0 new messages