That's the first thing I'd do too.
BUT
If it measured the correct voltage, I'd put a load on it
and look at it with a scope.
This is FAR EASIER than taking the laptop apart, only to find
that the AC adapter was bad all along...and you broke a bunch
of the plastic snaps trying to pry it apart.
Been there, done that.
Make DARN sure the power supply is good before disassembling
a laptop.
In ANY diagnostic situation, you start asking questions to determine
the diagnostic tree. For each question, ask yourself, "What am I
gonna do with the answer once I have it?" If you can't do anything
with the answer, it doesn't help to ask the question. You can lop
off whole branches of your diagnostic tree. If your lack of test
equipment lops off ALL the branches, you're dead in the water.
Fixing it will be a matter of luck.
In this case, if you can't load the power supply and look at it with
a scope, you have two options.
1) output voltage is not correct on the multimeter.>> laptop ac supply
is probably defective.
2) no load output voltage is correct...and you don't have a scope>> you
probably shouldn't be taking the laptop apart until you have more info
or a known-good power supply.
"my laptopl froze then made a loud buzzing sound" is NOT a good symptom
That it didn't buzz next time suggests like the power supply is defective
and it blew a fuse or something inside the laptop.
Or that a static zap killed it when it was plugged in.
OR...OR...
In that case, trying a good power supply may not fix it.
And if you fix the inside problem and plug in the bad supply,
you may break it again.
Been there done that.