Well if transformations is what you want to do, you should look into all of the necessary things to do that ie - plasmid of choice, selective growth media, competent cells, or materials required to make the competent cells, incubator, tools necessary for sterile technique. I think a pGREEN or a pGLO would be a good start, moreso pGLO because it auto-fluoresces whereas pGREEN needs a UV light, but a UV light is good to have eventually for DNA visualization as well.
You mentioned you got a good bit of lab equipment, what exactly did you get?
As for Taq, New England Biolabs is a few towns over for me and an amazing institution. They were one of the first companies in the bio-tech area and make great products.
That kit might be a good choice because it has your polymerase, buffers, dNTP's, and even comes with a ladder. The kit allows you to modify PCR conditions as needed, by varying the concentration of your various buffers. That's great if you have a handle on what you're doing, and could make for a really detailed learning experience by varying things to see their effects, but you might also consider a master mix.
The master mix has everything pre-mixed, so you don't have to do reaction optimization, but the downside is...you can't do reaction optimization because everything is already mixed together at a set concentration. But for standard PCR, it should be OK. I use the Taq 2X mastermix from NEB and it's worked fine for me so far. Be aware of freeze-thaw cycles though. I sometimes aliquot out enough master mix for 5-10 rxns in another PCR tube, and pull that one out instead of the master mix to avoid degradation.
I don't think you'll find Taq anywhere else for much cheaper, or if you do, it won't be THAT much cheaper, and might not be worth sacrificing quality to save $5-$10 when NEB produces some of the best stuff in the business. On another note though, you might find it very difficult / impossible to get it sent to a residential address.
NEB also sells good ladders.
You can find Taq and other things like ladders and dNTP's from other sites, and they probably wont ask questions about where it is going to.
is where I've made my most recent purchases.
I've heard good things about MOBIO but havn't used them, they seemed to cut down on their samples a bunch, perhaps because it was being abused.
Epoch Lifesciences is also where I get all my spin kits, they're cheap and good.
Figure out exactly what it is you want to do and people can probably provide more direct advice. I have pGREEN and pGLO I could give you as well as primers, but I have no bacteria for the transformation that would survive via shipping.