Your commandline is wrong. You should do change directory to the appledoc root and use the installation script.
cd ~/Projects/OSX/appledoc (or whatever the location of your appledoc source)
And then run the installation script.
sudo ./install-appledoc.sh
(Added for posterity)