[boost] Migrating www.boost.org to another server

[DongInn Kim]

Hi,

The CREST is planning to move all the boost services that OSL/CREST has provided to another server.

All the services in the current OSL/CREST server are:
- Web services:
www.boost.org
boostcon.boost.org
svn.boost.org/svnmanager
svn.boost.org/trac/boost
beta.boost.org

- Subversion, trac, and SVNManager

- Mailinglist
mailman
hypermail


First, we would like to migrate www.boost.org and beta.boost.org which are not dependent on any other services and domains at all.

The data of www.boost.org and beta.boost.org can be simply moved but I need someone's help who can switch the domain record to make these two hostnames point to the new server.

Who can I talk to about this domain migration?

I will setup another schedule for the next migrations and I do not have any particular lists yet but probably the rest of web services and Subversion would be the candidate. We will see.

Regards,

--
- DongInn


_______________________________________________
Unsubscribe & other changes: http://lists.boost.org/mailman/listinfo.cgi/boost

[DongInn Kim]

Any helps on the migration?

The current wowbagger machine is pretty old and it may stop running someday.

Regards,

--
- DongInn

[Daniel James]

On 20 May 2013 12:50, DongInn Kim <di...@cs.indiana.edu> wrote:
>>
>> First, we would like to migrate www.boost.org and beta.boost.org which are not dependent on any other services and domains at all.
>>
>> The data of www.boost.org and beta.boost.org can be simply moved but I need someone's help who can switch the domain record to make these two hostnames point to the new server.

I don't think it's that simple. Those sites are automatically updated
in a subversion post commit hook, which looks like it needs to be on
the same server. The code is:

#
# Update boost website
#
WEBDIR=/home/www/beta.boost.org
cd $WEBDIR
svn up
cd /home/www/live.boost.org
svn up

I'm not sure where this is on the server. I got it from:

http://svn.boost.org/svn/boost/trunk/tools/server/subversion/hooks/

As part of the git transition, we're going to need to trigger updating
the site from another machine, but I don't know what the plan for that
is. I think David Abrahams had some sort of plan, so I'm cc-ing him.

>> Who can I talk to about this domain migration?

Beman Dawes I think. I guess he was at C++Now for the last week, so he
might have missed this, so I've cc-ed him as well.

[DongInn Kim]

Hi Daniel,

Thanks for following up with this.

I have rsyched live.boost.org and beta.boost.org so that we can simply run the script to update the website on the new server.
I do not see any complexities.

Regards,

--
- DongInn

[DongInn Kim]

Any news from Beman?

Regards,

--
- DongInn

On May 21, 2013, at 12:14 AM, Daniel James <dan...@calamity.org.uk> wrote:

> On 21 May 2013 05:00, Marshall Clow <mclow...@gmail.com> wrote:
>> On May 20, 2013, at 8:54 PM, Daniel James <dan...@calamity.org.uk> wrote:
>>
>>> On 21 May 2013 02:34, Marshall Clow <mclow...@gmail.com> wrote:
>>>> [ Off-list ]
>>>> Just as an update - Beman was _not_ at C++Now this year (the first time he has missed it).
>>>
>>> Do you know if he's available?
>>
>> Well, not at the moment - he's on the east coast (GMT-4), but in general, yes.
>
> I'll send him an email later then. Cc'd emails can get lost in the
> noise of the list.

[Daniel James]

On 23 May 2013 13:51, DongInn Kim <di...@cs.indiana.edu> wrote:
> Any news from Beman?

No. I'll send a more shouty email.

[Beman Dawes]

On Thu, May 23, 2013 at 8:51 AM, DongInn Kim <di...@cs.indiana.edu> wrote:
> Any news from Beman?
>

I've sent a private rely, listing the DNS information.

--Beman

[DongInn Kim]

Hi,

How do the beta.boost.org and live.boost.org (i.e., www.boost.org) directories are updated? Is there a cron job running to update the page or SVN commit hook is used or such?
We are just about to update the DNS record for beta.boost.org and www.boost.org and this change would not cause any downtime.

Regards,

--
- DongInn

[Daniel James]

On 23 May 2013 22:07, DongInn Kim <di...@cs.indiana.edu> wrote:
>
> How do the beta.boost.org and live.boost.org (i.e., www.boost.org) directories are updated? Is there a cron job running to update the page or SVN commit hook is used or such?
> We are just about to update the DNS record for beta.boost.org and www.boost.org and this change would not cause any downtime.

It's done in an SVN post commit hook. You can see a copy of it at:

http://svn.boost.org/svn/boost/trunk/tools/server/subversion/hooks/post-commit

The update is at the end. Hopefully you know the location to update
this on the server? I can see the file in a couple of places.

[DongInn Kim]

OK, can I put the following line right after the last "svn up" line in the post commit hook script to update the web pages of the new web server until svn.boost.org is migrated to the new server?

/opt/python-2.6/bin/fab -f /home/www/fabric/fabfile.py update_website

The above line would update the web pages of the new server.

Once this change works fine, I will ask Beman to update the DNS record.

Regards,

--
- DongInn

[Daniel James]

Well, Rene's normally the person who deals with these things, but it
looks okay to me. Once you've done that, I'll commit something so that
we can check it worked.

Also, have you rsynced the contents of
'/u/grafik/www.boost.org/archives/live'? This is where the
documentation is stored. There should be softlinks to this directory
from /home/www/live.boost.org/doc/archives and
/home/www/beta.boost.org/doc/archives.

[DongInn Kim]

I see.

I put the command to the boost SVN post commit hook script and then I just rsynced Rene's $HOME to the new server:/home/grafik.

> Also, have you rsynced the contents of
> '/u/grafik/www.boost.org/archives/live'? This is where the
> documentation is stored. There should be softlinks to this directory
> from /home/www/live.boost.org/doc/archives and
> /home/www/beta.boost.org/doc/archives.

I believe that the new website also has the proper link for them too now.

Rene, can you please work on the new server once the DNS record is updated?

Regards,

--
- DongInn

[Rene Rivera]

On Thu, May 23, 2013 at 6:38 PM, DongInn Kim <di...@cs.indiana.edu> wrote:

> I see.
>
> I put the command to the boost SVN post commit hook script and then I just
> rsynced Rene's $HOME to the new server:/home/grafik.
>
> > Also, have you rsynced the contents of
> > '/u/grafik/www.boost.org/archives/live'? This is where the
> > documentation is stored. There should be softlinks to this directory
> > from /home/www/live.boost.org/doc/archives and
> > /home/www/beta.boost.org/doc/archives.
>
> I believe that the new website also has the proper link for them too now.
>
> Rene, can you please work on the new server once the DNS record is updated?
>

I could try.. What's left to do?


--
--
-- Grafik - Don't Assume Anything
-- Redshift Software, Inc. - http://redshift-software.com
-- rrivera/acm.org - grafik/redshift-software.com
-- 102708583/icq - grafikrobot/aim - grafikrobot/yahoo

[DongInn Kim]

Hi Rene,

Well, all you have to do is do the same thing in the new server (wowbagger.crest.iu.edu) as you have done on the current wowbagger?

Can you tell me if you find any issues on running your scripts on the new server?

Regards,

--
- DongInn

[Rene Rivera]

None of the documentation links work. For example <
http://wowbagger.crest.iu.edu/doc/libs/release/more/getting_started/>. Most
likely because the PHP scripts and/or the .htaccess are not being used?

Rene.

[DongInn Kim]

Well, actually you have to make your client machine look at the new sever when you access www.boost.org.
For example, I tricked my client by adding the following line to /etc/hosts
129.79.13.33 www.boost.org

So, after your /etc/hosts has the above entry, whenever you access www.boost.org, it will go to the virtual host (www.boost.org) of new server which is supposed to host the boost web site in the very new future.

Please let me know if you still have a problem after you have the updated /etc/hosts.

I have tested this on linux and mac machines and they work fine. I have no idea how to trick this on Windows though yet.

Regards,

--
- DongInn

[Rene Rivera]

I couldn't find any problems.

[DongInn Kim]

Great!
Rene, so then can I forget about rsynching your $HOME any more (i.e., can I expect that you will keep working on the new server machine)?
Do you have any scripts to run on the new machine like the current wowbagger machine?

Regards,

--
- DongInn

On May 23, 2013, at 10:35 PM, Rene Rivera <grafi...@gmail.com> wrote:

> I couldn't find any problems.
>
> On Thu, May 23, 2013 at 8:53 PM, DongInn Kim <di...@cs.indiana.edu> wrote:
>
>>
>> Well, actually you have to make your client machine look at the new sever
>> when you access www.boost.org.
>> For example, I tricked my client by adding the following line to /etc/hosts
>> 129.79.13.33 www.boost.org
>>
>> So, after your /etc/hosts has the above entry, whenever you access
>> www.boost.org, it will go to the virtual host (www.boost.org) of new
>> server which is supposed to host the boost web site in the very new future.
>>
>> Please let me know if you still have a problem after you have the updated
>> /etc/hosts.
>>
>> I have tested this on linux and mac machines and they work fine. I have no
>> idea how to trick this on Windows though yet.
>>
>> Regards,
>>
>> --
>> - DongInn

[Rene Rivera]

As part my checking earlier I logged in and nothing was amiss. But since
I'm not the only one pushing data into the server what I would suggest is
to turn off the rsync as soon as the DNS is switched. If there are
any stragglers still hitting the old server after the DNS switch it should
be OK as it's only intermittent data that might get lost which is just
fine. We can deal with any problems that crop up after the switch as they
happen.

Rene.

--
--
-- Grafik - Don't Assume Anything
-- Redshift Software, Inc. - http://redshift-software.com
-- rrivera/acm.org - grafik/redshift-software.com
-- 102708583/icq - grafikrobot/aim - grafikrobot/yahoo

[Daniel James]

Hi,

I'm going to need to access to the new machine, as I often upload the
documentation.

thanks,

Daniel

[DongInn Kim]

Yes, I will rsync your $HOME until the DNS record is updated.
Then, please do not work on a new machine until the DNS is switched. Of course, once the DNS is switched, you have to use the new server only.

Regards,

--
- DongInn

[DongInn Kim]

Hi Daniel,

Do have an account in the current server (wowbagger.osl.iu.edu)? It seems that I can not find yours.

If not, can you email me (di...@cs.indiana.edu) with your preferred username (if possible, <= 8chars) and encrypted password which is generated via the following link?
https://www.cs.indiana.edu/cgi-bin/csg/cryptit.cgi

Regards,

--
- DongInn

On May 24, 2013, at 2:38 AM, Daniel James <dan...@calamity.org.uk> wrote:

> Hi,
>
> I'm going to need to access to the new machine, as I often upload the
> documentation.
>
> thanks,
>
> Daniel
>

[Daniel James]

Yes, I have an account, it's 'dnljms'.

[DongInn Kim]

OK, Daniel.

I setup your account on the new server.

Regards,

--
- DongInn

[Beman Dawes]

Any time estimate as to when to do the DNS switch?

--Beman

[DongInn Kim]

Hi Beman,

Can we do that 2:00pm (E.T.) today?
We need to restart a new server to take a snapshot of it this morning.

Is 2:00pm (E.T.) OK with you?

Regards,

--
- DongInn

[Beman Dawes]

On Fri, May 24, 2013 at 8:49 AM, DongInn Kim <di...@cs.indiana.edu> wrote:
> Hi Beman,
>
> Can we do that 2:00pm (E.T.) today?
> We need to restart a new server to take a snapshot of it this morning.
>
> Is 2:00pm (E.T.) OK with you?

Works well for me. I'll do it at 2:00pm (E.T.) unless I hear
differently from you.

Thanks,

[DongInn Kim]

Great! I will make sure that the $HOME directories of Rene and Daniel's are rsynched to the new server at the last moment.

Regards,

--
- DongInn

[Beman Dawes]

DNS for beta.boost.org and live.boost.org updated.

(The other records, including www.boost.org, were not changed.)

In theory this can take up to one hour to propagate to DNS servers
worldwide. In practice I started getting the new addresses almost
instantly.


HTH,

[DongInn Kim]

Great!

Thank Beman for taking care of the DNS record.
Mine shows the old address yet. Let's see what happens in an hour.

Regards,

--
- DongInn

[Beman Dawes]

www.boost.org is now (4:10pm ET) also switched.

That leaves these still pointing to the old address:

boost.org
boostcon.boost.org
lists.boost.org
svn.boost.org
wiki.boost.org
www2.boost.org

Should boost.org and www2.boost.org also be switched?

[DongInn Kim]

Hi Beman,

> Should boost.org and www2.boost.org also be switched?

Thanks for asking this but I was not sure what other services are using boost.org.
I just double checked it and I confirm that there are no other services using the "boost.org" hostname but the web service.
It would be safe to switch boost.org too.

But we have not moved www2.boost.org yet. So please do not switch www2.boost.org yet.

BTW, I think Daniel mentioned that you guys may want to remove it.

Regards,

--
- DongInn

[Beman Dawes]

On Fri, May 24, 2013 at 4:24 PM, DongInn Kim <di...@cs.indiana.edu> wrote:
> Hi Beman,
>
>> Should boost.org and www2.boost.org also be switched?
>
> Thanks for asking this but I was not sure what other services are using boost.org.
> I just double checked it and I confirm that there are no other services using the "boost.org" hostname but the web service.
> It would be safe to switch boost.org too.

Done.

> But we have not moved www2.boost.org yet. So please do not switch www2.boost.org yet.
>
> BTW, I think Daniel mentioned that you guys may want to remove it.

I'm not sure what its purpose is, so I'll let Daniel decide that one.

Thanks,

[Daniel James]

On 24 May 2013 21:32, Beman Dawes <bda...@acm.org> wrote:
>
>> But we have not moved www2.boost.org yet. So please do not switch www2.boost.org yet.
>>
>> BTW, I think Daniel mentioned that you guys may want to remove it.
>
> I'm not sure what its purpose is, so I'll let Daniel decide that one.

It was intended to be used as a new site for boost, but it never went
anywhere. I think it should be removed.

Also, does anyone know who I should talk to about the old boostcon site?

[Gottlob Frege]

On Fri, May 24, 2013 at 4:50 PM, Daniel James <dan...@calamity.org.uk>wrote:

>
> It was intended to be used as a new site for boost, but it never went
> anywhere. I think it should be removed.
>
> Also, does anyone know who I should talk to about the old boostcon site?
>
>

I would suggest Ray Fix (... at gmail.com), who handles most of the
cppnow.org stuff.

Tony

[Daniel James]

On 24 May 2013 21:53, Gottlob Frege <gottlo...@gmail.com> wrote:
> On Fri, May 24, 2013 at 4:50 PM, Daniel James <dan...@calamity.org.uk>wrote:
>
>>
>> It was intended to be used as a new site for boost, but it never went
>> anywhere. I think it should be removed.
>>
>> Also, does anyone know who I should talk to about the old boostcon site?
>>
>>
> I would suggest Ray Fix (... at gmail.com), who handles most of the
> cppnow.org stuff.

Thanks, I've sent him an email.

[Sergey Cheban]

17.05.2013 16:10, DongInn Kim пишет:

> The CREST is planning to move all the boost services that OSL/CREST has provided to another server.
It looks that the boost regression test results at
http://www.boost.org/development/tests/release/developer/summary.html
have not been updated since Fri, 24 May 2013 14:48:22 +0000. Can it be
related to the server upgrade?

--
Best regards,
Sergey Cheban

[Daniel James]

On 27 May 2013 20:38, Sergey Cheban <s.ch...@drweb.com> wrote:
> 17.05.2013 16:10, DongInn Kim пишет:
>
>
>> The CREST is planning to move all the boost services that OSL/CREST has
>> provided to another server.
>
> It looks that the boost regression test results at
> http://www.boost.org/development/tests/release/developer/summary.html have
> not been updated since Fri, 24 May 2013 14:48:22 +0000. Can it be related to
> the server upgrade?

Possibly. The results haven't been uploaded to either the old or new
server since then. I don't know how it's normally uploaded. Maybe it's
connecting to the new site, but can't log in?

[Steven Watanabe]

AMDG

On 05/27/2013 12:38 PM, Sergey Cheban wrote:
> 17.05.2013 16:10, DongInn Kim пишет:
>
>> The CREST is planning to move all the boost services that OSL/CREST
>> has provided to another server.
> It looks that the boost regression test results at
> http://www.boost.org/development/tests/release/developer/summary.html
> have not been updated since Fri, 24 May 2013 14:48:22 +0000. Can it be
> related to the server upgrade?
>

Yep. It should update in a couple minutes.

In Christ,
Steven Watanabe

[Daniel James]

On 24 May 2013 11:14, DongInn Kim <di...@cs.indiana.edu> wrote:
> OK, Daniel.
>
> I setup your account on the new server.

I had sudo access on the old server, please can I have it on this one
as well? I used it to access the web logs and make changes to files
served by apache. Thanks.

[DongInn Kim]

Hi Daniel,

I would like to restrict the sudo access only to the system admin for the new server now.

I setup the group ownership on /var/log/httpd/ so that you can have the access to read all the files under /var/log/httpd/

Please let me know if you have any other files that you need to have the access to.

Regards,

--
- DongInn

[Daniel James]

OK, sure. I'll let you know if there's anything.

Actually there is one thing. Please can you create a directory in
/home/www/ where we can store extra files needed for the site. Perhaps
something like /home/www/shared, although if you prefer another name.
Just somewhere to place the documentation files, test results and
things like that. Thanks.

[DongInn Kim]

OK, Daniel. I just created a directory /home/www/shared with the boost group ACL setup so that any users in the boost group and apache user can have the r/w access to all the (new) files under /home/www/shared.

Please let me know if this is not what you are asking for.

Regards,

--
- DongInn

[Sergey Cheban]

On 28.05.2013 0:30, Steven Watanabe wrote:

>>> The CREST is planning to move all the boost services that OSL/CREST
>>> has provided to another server.
>> It looks that the boost regression test results at
>> http://www.boost.org/development/tests/release/developer/summary.html
>> have not been updated since Fri, 24 May 2013 14:48:22 +0000. Can it be
>> related to the server upgrade?
> Yep. It should update in a couple minutes.

As I can see, the regression test results have not been updated since
Fri, 14 Jun 2013 14:42:56 +0000.



--
Sergey Cheban