Hi Varun,
Yes, aggregation is only possible with QoS data, since aggregation (both A-MSDU and A-MPDU) relies on information available in QoS Control field (e.g. TID, ACK policy, etc.).
PCF was defined before 11e introduced QoS. HCCA/HCF was introduced to improve PCF and extend it for QoS. So if you need aggregation and a centralized scheme, better go for HCF.
Rediet