ColdFusion unable to roll cfusion-out.log & hangs after install of FusionReactor
Dawn - Atlanta, GA
which have not had previous versions of FR installed. The version of
FR installed is Revision: 4.0.10, Build: FusionReactor 4.0.x
Maintenance Branch.49.24583.
I am running ColdFusion 9,0,1,274733 Enterprise in a multi-instance
configuration. Patch hf901-00004.jar is installed and we are using
JRE 1.6.0_31. The OS is Windows Server 2003 SP2 Standard.
After each installation, the first time the cfusion-out.log file
reaches 201kb and is ready to "roll", ColdFusion stops responding. I
am unable to stop the ColdFusion service via the service manager and
must kill the task directly from Task Manager.
Once restarted, the log file rolls as expected and this doesn't happen
again.
I have 3 more production systems where I plan on installing
FusionReactor, but I will be unable to do so if I know the system is
going to go down once the log file rolls. These are high visibility
systems.
I haven't seen this issue reported here and was wondering if anyone
else experienced this issue.
David Tattersall (FusionReactor)
thank you for bringing this to our attention - I'm not aware of this issue - however, I will bring it to the attention of engineering and we will check it out.
Kind regards,
David
Darren Pywell
Charlie Arehart wrote an article recently about issues with CF
shutting down slowly:
http://www.carehart.org/blog/client/index.cfm/2011/10/19/cf_service_slow_shutdown_logging
I'm not aware of any issues that are FR specific. If you uninstall the
FusionReactor instance again does the service then stop quickly?
Thanks,
Darren
On May 9, 8:46 pm, "David Tattersall (FusionReactor)"
Dawn Hoagland
I thought the first incident was a fluke. It was a highly visible production server that went down at midnight and needed to be back up ASAP. Once I got the Windows error, I had no choice but to kill it. I watched the process like a hawk the next day during the first & second "roll" to make sure all was well.
Today I'm working on a TA server that has been misbehaving this week. I did wait an additional 5 minutes before I killed it. Since in both instances the cfusion-out.log was full and needed to roll, I suspect it was hung trying to roll the file. Both servers are running at the same patch level (OS, CF & JRE) - but the applications running on them are as different as can be.
If it can't be replicated by Integral, I'll carefully pick another server to test before rolling out the other planned production servers. But if Integral can reproduce it, maybe I can save someone else the 12:30 am call on a Sunday night....
--
Dawn
--
You received this message because you are subscribed to the Google Groups "FusionReactor" group.
To post to this group, send email to fusion...@googlegroups.com.
To unsubscribe from this group, send email to fusionreacto...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/fusionreactor?hl=en.
charlie arehart
Dawn, I’ll concur with Darren that I’ve never seen this to be an issue at all. In fact, I’m not aware of any connection between FR and the out logs at all. But let’s start here: do you have the FREC plugin installed (FusionReactor Extensions for CF)? It would require a separate (free) download and installation after FR. (More at http://www.fusion-reactor.com/fr/plugins/frec.cfm).
Even so, and while it does access some CF logs (the fr-coldfusion-log.log), as discussed at http://docs.intergral.com/pages/viewpage.action?pageId=9928730, I don’t think that’s the out.logs. I’ve asked the FR folks (in a separate email) to consider adding clarification there, but if I’m right, then it wouldn’t seem there’s a connection.
And even then, that would only be so if you DID install the FREC extensions. So let us know: did you?
Also, as Darren notes, uninstalling FR would be a way to tell if it’s a factor.
I’ll also note that you can change the size of those out logs, if you don’t want to have to wait for them to fill to 200, if you don’t have much causing them to fill. I’ve blogged about 2 techniques (command line or registry tweak) where you could make them smaller, to demonstrate your problem more quickly. (Normally, I’m showing this to people who want to let them grow bigger, since 200k is pretty tiny and could fill quickly when lots of info is being written to them.) See my blog entry for more:
http://www.carehart.org/blog/client/index.cfm/2010/10/15/controlling_size_of_CF_out_logs
Finally, I’ll note that the rotation also has a hand in another aspect of the registry: it looks at a value in the same key (discussed in the blog entry) called CurrentOverwriteLog. It reads and writes to that value when incrementing the next value to name for the rotation. And one thing that gets people in trouble is that they sometimes find that these logs seem “never” to rotate. In that case, it’s that the user account used for starting the CF service does not have permissions to write to that registry key (discussed in the blog entry).
But I’ve never seen it cause CF to “hang” for any reason related to this process.
I’m curious about one last thing: I noticed you said you’re running on JVM 1.6.0.31. That’s not a supported JVM version for CF. They did announce last year they had certified both CF 8 and CF9 for 1.6.0.24, but if you go beyond that, you’re pushing your luck. I’d recommend you may want to dial that down to 24 (you can install both on the machine at once, and change CF to use the earlier version just like you changed it to use the later one.) More on that here:
http://www.carehart.org/blog/client/index.cfm/2011/10/28/CF911-Have-you-updated-your-ColdFusion-JVM-to-24-yet-Important-security-fix-for-CF-89
Hope that’s helpful.
/charlie
PS One more thing, Dawn: I’m in Atlanta, too. If you may want some on-site assistance with anything related to CF server troubleshooting, including of course using FR or related tools, I’d be happy to help. Of course, I can also help you or anyone remotely over the web, too. I just know sometimes people like having someone “present”. More at www.carehart.org/consulting/.
Dawn Hoagland
As I said - I've never seen CF hang in this manner (and I've been a CF Developer/admin since '96). I've seen the cfusion-out.log overwrite itself over & over, nothing written to the log when drive space runs out, etc. - all without impacting CF actually serving pages. I've now CF hang twice in one week for the first "roll" of the log immediately after installing FR. Unfortunately, I don't have a good test environment to play with this at the office, but if I have some time this weekend I may be able to play at home with just a trial.
We've had no issues running the latest JRE. Our security team dictates what can and can't go in our environment - so as long as the apps are working as expected, if vulnerabilities are found & a patch is available - patching occurs. We've been on update 31 in all environments (except 1) without issue for 2 months now (and were on at least 28 for several months prior to that). To date, we haven't had any issues with support - but then rca of issues has shown the issue isn't on the server/CF side so bringing in Adobe wasn't necessary.
So - maybe I've uncovered something odd, maybe it's something exclusive to our environment. Maybe it is a fluke that happened twice. No way to know without testing.
--
Dawn
charlie arehart
Well, to be clear, I wasn’t recommending them. I was saying those are the only way I might possibly see Fr having any interaction with those CF logs. So I’ll be surprised if this ends up being connected to FR (but I could be wrong).
More to the point, did you try uninstalling FR where it was hanging? And did you try lowering the size to force it to happen sooner for you? Or are those things you’re saying you can only “play with” at home? I’m just surprised you’d have to wait, if this is causing such severe impact on production systems.
Hope you get it sorted. Will look forward to the conclusion.
/charlie
From: fusion...@googlegroups.com [mailto:fusion...@googlegroups.com] On Behalf Of Dawn Hoagland
Sent: Thursday, May 10, 2012 8:09 AM
To: fusion...@googlegroups.com
Subject: Re: [fusionreactor] Re: ColdFusion unable to roll cfusion-out.log & hangs after install of FusionReactor
I did NOT install the FREC extensions. Just the basic install and let it go. As much as I'd love to play with those extensions, I don't see it happening in this environment.
Dawn Hoagland
Unfortunately, we don't have an environment in the office where I can create/destroy VM's on a whim to test. Since I'm married to a VMware/Windows Guru, I have a nice environment at home I can test on if I'm so inclined. If I do get some testing done, I'll post any results.
--
You received this message because you are subscribed to the Google Groups "FusionReactor" group.
To post to this group, send email to fusion...@googlegroups.com.
To unsubscribe from this group, send email to fusionreacto...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/fusionreactor?hl=en.
--
Dawn
charlie arehart
Ok, but I will just say that this is all really unusual. I help people with hundreds of servers a year, using FR and CF, and this has never been an issue. But I do see people have problems with the rotation due to that registry permissions problem, having nothing to do with FR of course. Still, I’ve not ever seen this issue of CF hanging up on the log rotation (whether with or without FR in the mix).
But I’m not denying what you’ve seen. :-) Again, it will be interesting to hear the resolution for you.
/charlie
From: fusion...@googlegroups.com [mailto:fusion...@googlegroups.com] On Behalf Of Dawn Hoagland
Sent: Thursday, May 10, 2012 12:08 PM
To: fusion...@googlegroups.com
Subject: Re: [fusionreactor] Re: ColdFusion unable to roll cfusion-out.log & hangs after install of FusionReactor
That's just it - after I restarted ColdFusion when it choked the first time - it's been running fine since on both servers. It appears to just be the initial roll. Since some of these values are stored in the registry - my Windows Guru suggested a reboot after install. It's something to think about and what I'll likely do on my next install in the office....
Dawn - Atlanta, GA
issue. I successfully installed FR on two production servers over the
weekend and have not experienced problems.
Once I got FR successfully installed and monitoring the instances, I
shut the instances down and moved all "current" logs so that they
would start fresh. I started the instances back up and haven't had
any issues.
On May 10, 1:15 pm, "charlie arehart" <charlie_li...@carehart.org>
wrote:
Darren Pywell
On May 22, 5:16 pm, "Dawn - Atlanta, GA" <dawnhoagl...@gmail.com>
wrote: