But they are called templates for a reason, and really should not change that much and that's why they are agressively cached.
Maybe you can read some more about angular's directives and services and/or review the way you have architected your app.
Your views should contain very little logic other than simple looping and ifs, they should use whatever scope their controllers give them and directives, both of which have services injected in them and these services can call whatever server side .py or .php you want through $http or $resources... Ui-router makes all that really easy!
Maybe if you show us some code, someone can chime in?