First order PA, and second order PA, are both purely syntactic constructions. The difference between them is however tied up in the semantics, because it is the interpretation of the second order quantifier as a "full powerset" quantifier that gives it its categorical status. You can also choose to interpret the second order quantifier as the set of (first order) definable subsets of nat, but this will have visible effects from within the theory, because second order PA can define what a first order definable subset of nat is, and so the second order statement |- A. X E. n X = {i | nth-definable-subset(n, i)} is true in this model but not true in the full powerset model.
There is nothing vague about "formulas with one distinguished variable". The variable can be fixed to something, like v_0, and FOL has a notion of what a formula is; schemes such as this abound in the definition of FOL itself. Formulas are built up from -> , -. , A. and variables, and for each formula you get a corresponding instance of the induction axiom scheme.
You can say that this is a variable of type "oi", but I disagree. There is no type "oi" in peano arithmetic. If such a type existed (and had the obvious properties), then it would be able to prove the consistency of (first order) PA, and indeed second order PA proves the consistency of first order PA. HOL is stronger still, capable of proving the consistency of third order PA and so on. First order PA is not finitely axiomatizable, second order PA and HOL are. There are ways to go second order without increasing the consistency strength - the natural choice being ACA_0 - but this requires a syntactic restriction on the formulas going into the induction axiom that is not at all naturally expressible in HOL: the formula must not use any higher order quantifiers.
In short: First order PA can be naturally embedded in second order PA, and HOL, but these theories are not the same as first order PA, they are stronger.
Mario