NON-LINEAR STATIONARITY:
"That's because I don't know if correlation functions are useful when
nonstationarity is present."
I wonder if Nonstationarity is responsible for predictions which have the proper shape but have a "DC" offset from the actual values?
Suppose a NN is trained with results that are from a stationary interval, but the inputs span backwards in time, a number of stationary intervals?
What if there were Stationary Type Flag Columns? Suppose you can say stationaryity changes no faster than by Quarter (3 month period)? So if you are using 4 years of data for the project, you would provide for the possibility of 4x4=16 regions of uniform stantionarity. This would involve 16 columns with a unit step for each region.
However, how would you deal with cases that use 2 years of previous history? or 8 Stat intervals? It almost like you need a 2nd dimension for each column to show what interval that column came from? Would this be something you would hand with a Complex Number Nnet?
Still, if a case had the stationarity flag associated with the prediction, it would still set up a matrix of "weight switches" that could only help predictions.
_________________________
CONTRADICTION (?): Output Lags in Input are Highly Correlated (Cxx).
If Output = P (price), it is customary to have input columns that are lags of P.
This results in both high Cxx and Cxy violates the desire to have no high Cxx.
Is this a problem or should Lags of Outputs be omitted from Cxx review?
Is it possible to get lags such that they have low Cxx and high Cxy?
I see that being an issue. One possible approach:
________________________
If Cxx and Cxy input culling is legitimate, might that not also hold for ACF and PACF cullings?