The trend charts are created dynamically using the available build results. So if you delete builds, then those results are also not available anymore. (This concept should be similar for all Jenkins plugins, or are e.g. test results shown for deleted builds?).
One workaround would be to delete unused data in the build folders (e.g. artifacts, etc.), but not the build.xml files.
An alternative approach would be
a) Store the data of the visible trend information in the current build as well. Then you cannot remove builds with broken warning results anymore from the charts. I’m not sure if that is something we should consider?
b) Create a new Jenkins Visualizer App - independent of the Jenkins UI, that renders the results of various plugins. The shown data could be stored in an associated build artifacts database. Then we could have a headless Jenkins on the one side and a modern UI app on the other side.