Hey there Kyle,
I've been sleeping on an everyman schedule for the better part of this
year, with a 3 hour core and 3x25 min naps (a bit longer than
recommended but it suits me). In the last month and a half I've been
weight lifting 4 times a week and doing intense cardio 4 times a week.
My appetite has sky-rocketed, my muscle mass has increased (i've put
on 5kg, and can't see a bit of it), and I'm stronger. Perhaps if I
wasn't sleeping polpyhasically the results would be even more
noticeable, but I think it's safe to say that, for me at least, it's
working out fine.
Remember that the most important part of any body building/weight
lifting program is food, food and more food.
Good luck!