Thanks for the quick response Zoraze,
I have also tried the trace method described in the documentation you linked but results are the same.
About the realistic delay, I gotta say, I am no expert in NS-3 or LTE networks but logically considering that my Ue has a speed of 40kmph and is in different distances from eNBs while doing different handoffs, 4ms constant handover delay seems quite unlikely. I expected different handover delays and something in the range of 20-100ms (end to end handover including the preparation time which is not included in the documentation's trace method and is surprisingly 0ms for me).
I'm using a2a4 handover algorithm with threshold of 30 and I have tried both ideal and real RRC implementation and got the same result.