Ahh I see.
One other option that might work for you would be to encapsulate the conditional processing within your controller, and expose the final outcome via the scope. Said another way, move most of the decision logic out of the template and into the controller.
Another option would be to make use of the newer ngIf directive. See the following for more info:
Note however that that directive is not available in the production ready version of AngularJS. From what I could tell I only found it in 1.1.5.
I had a similar need to yours a while back and due to the nature of what I was working on at the time I was comfortable using 1.1.5. The ngIf directive worked as advertised if I recall correctly. However as I moved forward with what I was working on I moved back to 1.0.7 and replaced my code with additional processing in the controller + utilization of the ngSwitch directive. Maybe not the most ideal solution in the grand scheme of things but for me it was a small part of the overall solution.
Sorry for the long winded reply. Hope some of that somewhat helps.
--
B