If you're trying this in the 'Your Company' file, then delete the existing budgets (it's not deleted in this company, by mistake). While deleting budgets, first delete the top-level one which has budget elements under it and then delete other budgets.
After this, you should be able to modify/delete the Fiscal Calendar.
Thanks and Regards,
Prashant