Creating our own cf-release

171 views
Skip to first unread message

Nicholas Terry

unread,
Jan 2, 2013, 7:01:55 PM1/2/13
to bosh-...@cloudfoundry.org
So we are trying to create our own release, but we ultimately don't want to host the public blobs, just our own custom blobs. Is there a way to be able to create a release that gets the upstream cf-release blobs, but also allows us to get our own blobs from our own blobstore?

Dr Nic Williams

unread,
Jan 2, 2013, 7:13:14 PM1/2/13
to bosh-users
Currently there isn't.

Is the hosting of the 1G+ of blobs a substantial burden? Or is the feature request a "nice thing to have"?

Nic


On Wed, Jan 2, 2013 at 4:01 PM, Nicholas Terry <nick.i...@gmail.com> wrote:
So we are trying to create our own release, but we ultimately don't want to host the public blobs, just our own custom blobs. Is there a way to be able to create a release that gets the upstream cf-release blobs, but also allows us to get our own blobs from our own blobstore?



Nicholas Terry

unread,
Jan 2, 2013, 7:15:24 PM1/2/13
to bosh-...@cloudfoundry.org
Its just, we are having issues recreating the blobs.yml for our s3 bucket. The items are uploaded, but we dont have a mapping of blob id to filename. and we dont want to have to manually create it every time.

Dr Nic Williams

unread,
Jan 2, 2013, 7:21:02 PM1/2/13
to bosh-users
I've not been following 100% the process you're going through to recreate cf-release.

Perhaps try bosh-gen, which includes the ability to sync blobs from one release to another.

bosh-gen new my-cf-release
cd my-cf-release
bosh-gen extract-job /path/to/cf-release/jobs/cloud_controller
bosh-gen extract-job /path/to/cf-release/jobs/nats

bosh upload blobs
etc

Let me know how that goes for you. If it doesn't work, I'll make it work :)

Nic

Martin Englund

unread,
Jan 3, 2013, 3:45:46 AM1/3/13
to bosh-users
Nick,

what you want is composite releases, where you can do a deployment
using two different releases, i.e. the public cf-release & your own
private release.

Just update your deployment manifest from:

release:
name: your-release
version: x

to:

releases:
- name: cf-release
version: latest
- name: your-release
version: x

/M
--
cheers,
/Martin
--
Martin Englund, Staff Engineer, Cloud Foundry, VMware Inc.
"The question is not if you are paranoid, it is if you are paranoid enough."

Dr Nic Williams

unread,
Jan 3, 2013, 3:48:03 AM1/3/13
to bosh-users
Martin, does it fail gracefully if both releases have a "cloud_controller" job or will it randomly pick one or pick on from the first release in the list?

Nic

Martin Englund

unread,
Jan 3, 2013, 4:20:21 AM1/3/13
to bosh-users
It'll take the first cloud_controller found in the order you defined
the releases (releases is an array)

/M

Nicholas Terry

unread,
Jan 3, 2013, 8:21:08 PM1/3/13
to bosh-...@cloudfoundry.org, meng...@vmware.com
AWESOME!!!! A composite release seems like EXACTLY what i need!!!!

Dr Nic Williams

unread,
Jan 3, 2013, 10:13:27 PM1/3/13
to bosh-...@cloudfoundry.org, meng...@vmware.com
We have an happy customer!! :)

Joseph Noall

unread,
Jan 4, 2013, 12:20:19 PM1/4/13
to bosh-...@cloudfoundry.org, meng...@vmware.com
Martin,

Can this still work if a package or job in the first release has a dependency on a package from the second release?  Or does that prevent you from being able to create the releases?


On Thursday, January 3, 2013 1:45:46 AM UTC-7, Martin Englund wrote:

Martin Englund

unread,
Jan 4, 2013, 3:09:13 PM1/4/13
to bosh-users
bosh create release will fail if you have unresolvable dependencies

/M

Dr Nic Williams

unread,
Jan 4, 2013, 3:25:16 PM1/4/13
to bosh-users
Martin, if 

* cf-release has a package "dea_ruby19" (v10), and a job "cloud_controller" and
*  mypersonal-release has a package dea_ruby19 (v2), and a job "my_cloud_controller"

Will the bosh agent job spec know to get the correct blob for the correct release?

If the two jobs are run on the same VM via colocation, then will both /var/vcap/data/packages/10/dea_ruby  and /var/vcap/data/packages/2/dea_ruby be installed? Which one will /var/vcap/packages/dea_ruby symlink to?

Nic

Martin Englund

unread,
Jan 4, 2013, 3:27:04 PM1/4/13
to bosh-users
Ask Oleg ;)

I'll have to check the source...

/M

Nicholas Terry

unread,
Jan 4, 2013, 4:40:37 PM1/4/13
to bosh-...@cloudfoundry.org, meng...@vmware.com
So I get the following error when deploying:


Error 140001: Cannot tell what release job `debian_nfs_server' supposed to use, please reference an existing release 

I have two releases, cf-release and my own release (called fs-appcloud). fs-appcloud does not have the debian_nfs-server job in it, and the cf-release does. What am I missing? Do I need to add an item to the job definition in my deployment manifest?

Oleg Shaldybin

unread,
Jan 5, 2013, 8:40:28 PM1/5/13
to bosh-...@cloudfoundry.org
It's currently not possible to collocate jobs from different releases.
--
Best,
Oleg

Dr Nic Williams

unread,
Jan 5, 2013, 10:11:56 PM1/5/13
to bosh-users
Thx Oleg. I don't think its a big ask to say "put your own release on your own VM" :)
Reply all
Reply to author
Forward
0 new messages