packer's built-in http server only works during pre-seeding and building. During the provisioning phase it gets shut down I believe.
So you'd have to set up your own http local repo.
Then have a script in the provisioner phase that will have packer ssh into your ubuntu trusty box and run the updater grabbing the updates rom your http local repo.
So a solution would be this:
1) Create an unattended install script (ks.cfg for ubuntu)
2) place that in the packer http directory
3) feed it in for the auto install.
4) after the install have the provisioners kick in to do your custom updates.
done.
this is pretty much what we do, and we have created automation around this pumping out vagrant .box files for our esx.