[Rocks-Discuss] /etc/passwd file not syncing
J. Greenbaum
Several of the nodes in our cluster were just reinstalled and for some reason the /etc/passwd files (and possibly others) are not being synced with the head node. We have 4 nodes and 3 of them do not seem to be synced to the head node. I've tried issuing the 'rocks sync users' command, but it does not seem to do the trick. Any help would be appreciated.
Thanks,
J
--
Jason Greenbaum
Manager, Bioinformatics Core | jgb...@liai.org
La Jolla Institute for Allergy and Immunology
-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://lists.sdsc.edu/pipermail/npaci-rocks-discussion/attachments/20120127/3b345a1a/attachment.html
Philip Papadopoulos
which version of Rocks?
-P
--
Philip Papadopoulos, PhD
University of California, San Diego
858-822-3628 (Ofc)
619-331-2990 (Fax)
-------------- next part --------------
An HTML attachment was scrubbed...
J. Greenbaum
-J
Sent from mobile device
"Hung-Sheng Tsao (Lao Tsao 老曹) Ph.D."
do
ssh compute-?? 411get
On 1/27/2012 8:08 PM, J. Greenbaum wrote:
> All,
>
>
> Several of the nodes in our cluster were just reinstalled and for some reason the /etc/passwd files (and possibly others) are not being synced with the head node. We have 4 nodes and 3 of them do not seem to be synced to the head node. I've tried issuing the 'rocks sync users' command, but it does not seem to do the trick. Any help would be appreciated.
>
> Thanks,
>
>
> J
>
>
--
Hung-Sheng Tsao Ph D.
Founder& Principal
HopBit GridComputing LLC
cell: 9734950840
http://laotsao.blogspot.com/
http://laotsao.wordpress.com/
http://blogs.oracle.com/hstsao/
-------------- next part --------------
A non-text attachment was scrubbed...
Name: laotsao.vcf
Type: text/x-vcard
Size: 608 bytes
Desc: not available
Url : https://lists.sdsc.edu/pipermail/npaci-rocks-discussion/attachments/20120127/742e0035/laotsao.vcf
J. Greenbaum
/etc.auto..home
/etc.auto..master
/etc.auto..misc
/etc.auto..net
/etc.auto..share
/etc.auto..smb
/etc.group
/etc.passwd
/etc.shadow
However, the files seem to be unchanged...
-J
--
Jason Greenbaum
Manager, Bioinformatics Core | jgb...@liai.org
La Jolla Institute for Allergy and Immunology
----- Original Message -----
An HTML attachment was scrubbed...
"Hung-Sheng Tsao (Lao Tsao 老曹) Ph.D."
do compute-??s' /etc/passwd and /etc/shadow get updated?
On 1/27/2012 9:53 PM, J. Greenbaum wrote:
> I just tried that, but it does not seem to work. The output of the
> command is:
>
> /etc.auto..home
> /etc.auto..master
> /etc.auto..misc
> /etc.auto..net
> /etc.auto..share
> /etc.auto..smb
> /etc.group
> /etc.passwd
> /etc.shadow
>
> However, the files seem to be unchanged...
>
> -J
>
> --
> *Jason Greenbaum
> *Manager, Bioinformatics Core | jgb...@liai.org <mailto:jgb...@liai.org>
> La Jolla Institute for Allergy and Immunology
>
>
> ------------------------------------------------------------------------
>
> *From: *"Hung-Sheng Tsao (Lao Tsao 老曹) Ph.D." <lao...@gmail.com>
> *To: *"Discussion of Rocks Clusters" <npaci-rocks...@sdsc.edu>
> *Cc: *"J. Greenbaum" <jgb...@liai.org>
> *Sent: *Friday, January 27, 2012 5:27:58 PM
> *Subject: *Re: [Rocks-Discuss] /etc/passwd file not syncing
-------------- next part --------------
A non-text attachment was scrubbed...
Name: laotsao.vcf
Type: text/x-vcard
Size: 608 bytes
Desc: not available
Url : https://lists.sdsc.edu/pipermail/npaci-rocks-discussion/attachments/20120128/59e57bf7/laotsao.vcf
J. Greenbaum
-J
--
Jason Greenbaum
Manager, Bioinformatics Core | jgb...@liai.org
La Jolla Institute for Allergy and Immunology
----- Original Message -----
> From: "Hung-Sheng Tsao (Lao Tsao 老曹) Ph.D." <lao...@gmail.com>
> To: "J. Greenbaum" <jgb...@liai.org>
> Cc: "Discussion of Rocks Clusters" <npaci-rocks...@sdsc.edu>
> Sent: Saturday, January 28, 2012 3:49:59 AM
> Subject: Re: [Rocks-Discuss] /etc/passwd file not syncing
> do compute-??s' /etc/passwd and /etc/shadow get updated?
> On 1/27/2012 9:53 PM, J. Greenbaum wrote:
> > I just tried that, but it does not seem to work. The output of the
> > command is:
>
> > /etc.auto..home
>
> > /etc.auto..master
>
> > /etc.auto..misc
>
> > /etc.auto..net
>
> > /etc.auto..share
>
> > /etc.auto..smb
>
> > /etc.group
>
> > /etc.passwd
>
> > /etc.shadow
>
> > However, the files seem to be unchanged...
>
> > -J
>
> > --
>
> > Jason Greenbaum
>
> > Manager, Bioinformatics Core | jgb...@liai.org
>
> > La Jolla Institute for Allergy and Immunology
>
> > ----- Original Message -----
>
> > > From: "Hung-Sheng Tsao (Lao Tsao 老曹) Ph.D." <lao...@gmail.com>
> >
>
> > > To: "Discussion of Rocks Clusters"
> > > <npaci-rocks...@sdsc.edu>
> >
>
> > > Cc: "J. Greenbaum" <jgb...@liai.org>
> >
>
> > > Sent: Friday, January 27, 2012 5:27:58 PM
> >
>
> > > Subject: Re: [Rocks-Discuss] /etc/passwd file not syncing
> >
>
> Founder & Principal
> HopBit GridComputing LLC
> cell: 9734950840 http://laotsao.blogspot.com/
> http://laotsao.wordpress.com/ http://blogs.oracle.com/hstsao/
-------------- next part --------------
An HTML attachment was scrubbed...
J. Greenbaum
Thanks,
J
--
Jason Greenbaum
Manager, Bioinformatics Core | jgb...@liai.org
La Jolla Institute for Allergy and Immunology
----- Original Message -----
> From: "Hung-Sheng Tsao (laoTsao)" <lao...@gmail.com>
> Cc: "J. Greenbaum" <jgb...@liai.org>
> Sent: Saturday, January 28, 2012 4:04:54 PM
> Subject: Re: [Rocks-Discuss] /etc/passwd file not syncing
> may be younshould start all over again
> Sent from my iPad
> On Jan 28, 2012, at 6:49, "Hung-Sheng Tsao (Lao Tsao 老曹)
> Ph.D."<lao...@gmail.com> wrote:
> > > -J
> >
>
> > > ----- Original Message -----
> >
>
> > <laotsao.vcf>
>
-------------- next part --------------
An HTML attachment was scrubbed...
"Hung-Sheng Tsao (Lao Tsao 老曹) Ph.D."
On 1/28/2012 7:17 PM, J. Greenbaum wrote:
> Starting over is my absolute last resort. Anyone have any other
> ideas? This system has been running fine for several months and I'm
> not sure what could have caused this.
IMHO, you have done some things!!
most likely some file in /var/411/*
Makefile
Files.mk
Group.mk
get changed
check out the rocks-411-master rpm to recover these files
do
make -C /var/411
or
make-C /var/411 force
rocks run host command="411get --all"
>
> Thanks,
>
> J
>
> --
> *Jason Greenbaum
> *Manager, Bioinformatics Core | jgb...@liai.org <mailto:jgb...@liai.org>
> La Jolla Institute for Allergy and Immunology
>
>
> ------------------------------------------------------------------------
>
> *From: *"Hung-Sheng Tsao (laoTsao)" <lao...@gmail.com>
> *Cc: *"J. Greenbaum" <jgb...@liai.org>
> *Sent: *Saturday, January 28, 2012 4:04:54 PM
> *Subject: *Re: [Rocks-Discuss] /etc/passwd file not syncing
>
> may be younshould start all over again
>
>
> Sent from my iPad
>
> On Jan 28, 2012, at 6:49, "Hung-Sheng Tsao (Lao Tsao 老曹)
> Ph.D."<lao...@gmail.com> wrote:
>
>
> do compute-??s' /etc/passwd and /etc/shadow get updated?
>
> On 1/27/2012 9:53 PM, J. Greenbaum wrote:
>
> I just tried that, but it does not seem to work. The
> output of the command is:
>
> /etc.auto..home
> /etc.auto..master
> /etc.auto..misc
> /etc.auto..net
> /etc.auto..share
> /etc.auto..smb
> /etc.group
> /etc.passwd
> /etc.shadow
>
> However, the files seem to be unchanged...
>
> -J
>
> --
> *Jason Greenbaum
> *Manager, Bioinformatics Core | jgb...@liai.org
> <mailto:jgb...@liai.org>
> La Jolla Institute for Allergy and Immunology
>
>
> ------------------------------------------------------------------------
>
> *From: *"Hung-Sheng Tsao (Lao Tsao 老曹) Ph.D."
> <lao...@gmail.com>
> *To: *"Discussion of Rocks Clusters"
> <npaci-rocks...@sdsc.edu>
> *Cc: *"J. Greenbaum" <jgb...@liai.org>
> *Sent: *Friday, January 27, 2012 5:27:58 PM
> *Subject: *Re: [Rocks-Discuss] /etc/passwd file not
> <laotsao.vcf>
>
>
--
Hung-Sheng Tsao Ph D.
Founder& Principal
HopBit GridComputing LLC
cell: 9734950840
-------------- next part --------------
An HTML attachment was scrubbed...
-------------- next part --------------
A non-text attachment was scrubbed...
Name: laotsao.vcf
Type: text/x-vcard
Size: 608 bytes
Desc: not available
Url : https://lists.sdsc.edu/pipermail/npaci-rocks-discussion/attachments/20120128/f188b428/laotsao.vcf
Philip Papadopoulos
please try the following
# rocks sync host sharedkey compute
then try 411get -all on one of your nodes.
if that works,
then try rocks sync users on the frontend
-P
--
Philip Papadopoulos, PhD
University of California, San Diego
858-822-3628 (Ofc)
619-331-2990 (Fax)
-------------- next part --------------
An HTML attachment was scrubbed...
J. Greenbaum
[root@herman ~]# ls -l /var/411/
total 28
-rw-r--r-- 1 root root 994 Oct 10 19:21 411.mk
-rw-r--r-- 1 root root 2952 Oct 10 19:21 Files.mk
-rw-r--r-- 1 root root 5784 Aug 8 23:44 Group.mk
drwxr-xr-x 3 root root 4096 Oct 10 19:12 groups
-r--r--r-- 1 root root 5362 Oct 10 19:21 Makefile
I've tried issuing the commands that you sent and here are the results:
[root@herman ~]# make -C /var/411
make: Entering directory `/var/411'
make: Nothing to be done for `all'.
make: Leaving directory `/var/411'
[root@herman ~]# rocks run host command="411get --all"
Traceback (most recent call last):
File "/opt/rocks/bin/411get", line 214, in ?
app.run()
File "/opt/rocks/bin/411get", line 177, in run
contents, meta = self.get(file)
File "/opt/rocks/lib/python2.4/site-packages/rocks/service411.py", line 519, in get
return self.decrypt(contents)
File "/opt/rocks/lib/python2.4/site-packages/rocks/service411.py", line 710, in decrypt
self.readKeys()
File "/opt/rocks/lib/python2.4/site-packages/rocks/service411.py", line 588, in readKeys
shared_file = open(self.shared_filename, 'r')
IOError: [Errno 2] No such file or directory: '/etc/411-security/shared.key'
Traceback (most recent call last):
File "/opt/rocks/bin/411get", line 214, in ?
app.run()
File "/opt/rocks/bin/411get", line 177, in run
contents, meta = self.get(file)
File "/opt/rocks/lib/python2.4/site-packages/rocks/service411.py", line 519, in get
return self.decrypt(contents)
File "/opt/rocks/lib/python2.4/site-packages/rocks/service411.py", line 710, in decrypt
self.readKeys()
File "/opt/rocks/lib/python2.4/site-packages/rocks/service411.py", line 588, in readKeys
shared_file = open(self.shared_filename, 'r')
IOError: [Errno 2] No such file or directory: '/etc/411-security/shared.key'
Traceback (most recent call last):
File "/opt/rocks/bin/411get", line 214, in ?
app.run()
File "/opt/rocks/bin/411get", line 177, in run
contents, meta = self.get(file)
File "/opt/rocks/lib/python2.4/site-packages/rocks/service411.py", line 519, in get
return self.decrypt(contents)
File "/opt/rocks/lib/python2.4/site-packages/rocks/service411.py", line 710, in decrypt
self.readKeys()
File "/opt/rocks/lib/python2.4/site-packages/rocks/service411.py", line 588, in readKeys
shared_file = open(self.shared_filename, 'r')
IOError: [Errno 2] No such file or directory: '/etc/411-security/shared.key'
Wrote: /etc/auto.home
Wrote: /etc/auto.master
Wrote: /etc/auto.misc
Wrote: /etc/auto.net
Wrote: /etc/auto.share
Wrote: /etc/auto.smb
Wrote: /etc/group
Wrote: /etc/passwd
Wrote: /etc/shadow
Looks like there is a file missing called '/etc/411-security/shared.key'. Is this something I can place in the install image so that it will be replaced when the nodes are reinstalled?
-J
--
Jason Greenbaum
Manager, Bioinformatics Core | jgb...@liai.org
La Jolla Institute for Allergy and Immunology
----- Original Message -----
> From: "Hung-Sheng Tsao (Lao Tsao 老曹) Ph.D." <lao...@gmail.com>
> To: "J. Greenbaum" <jgb...@liai.org>
> Cc: "Discussion of Rocks Clusters" <npaci-rocks...@sdsc.edu>
> Sent: Saturday, January 28, 2012 5:27:19 PM
> Subject: Re: [Rocks-Discuss] /etc/passwd file not syncing
> On 1/28/2012 7:17 PM, J. Greenbaum wrote:
> > Starting over is my absolute last resort. Anyone have any other
> > ideas? This system has been running fine for several months and I'm
> > not sure what could have caused this.
>
> IMHO, you have done some things!!
> most likely some file in /var/411/*
> Makefile
> Files.mk
> Group.mk
> get changed
> check out the rocks-411-master rpm to recover these files
> do
> make -C /var/411
> or
> make-C /var/411 force
> rocks run host command="411get --all"
> > Thanks,
>
> > J
>
> > --
>
> > Jason Greenbaum
>
> > Manager, Bioinformatics Core | jgb...@liai.org
>
> > La Jolla Institute for Allergy and Immunology
>
> > ----- Original Message -----
>
> > > From: "Hung-Sheng Tsao (laoTsao)" <lao...@gmail.com>
> >
>
> > > Cc: "J. Greenbaum" <jgb...@liai.org>
> >
>
> > > Sent: Saturday, January 28, 2012 4:04:54 PM
> >
>
> > > Subject: Re: [Rocks-Discuss] /etc/passwd file not syncing
> >
>
> > > may be younshould start all over again
> >
>
> > > Sent from my iPad
> >
>
> > > On Jan 28, 2012, at 6:49, "Hung-Sheng Tsao (Lao Tsao 老曹) Ph.D."
> > > <lao...@gmail.com> wrote:
> >
>
> > > > do compute-??s' /etc/passwd and /etc/shadow get updated?
> > >
> >
>
> > > > On 1/27/2012 9:53 PM, J. Greenbaum wrote:
> > >
> >
>
> > > > > I just tried that, but it does not seem to work. The output
> > > > > of
> > > > > the
> > > > > command is:
> > > >
> > >
> >
>
> > > > > /etc.auto..home
> > > >
> > >
> >
>
> > > > > /etc.auto..master
> > > >
> > >
> >
>
> > > > > /etc.auto..misc
> > > >
> > >
> >
>
> > > > > /etc.auto..net
> > > >
> > >
> >
>
> > > > > /etc.auto..share
> > > >
> > >
> >
>
> > > > > /etc.auto..smb
> > > >
> > >
> >
>
> > > > > /etc.group
> > > >
> > >
> >
>
> > > > > /etc.passwd
> > > >
> > >
> >
>
> > > > > /etc.shadow
> > > >
> > >
> >
>
> > > > > However, the files seem to be unchanged...
> > > >
> > >
> >
>
> > > > > -J
> > > >
> > >
> >
>
> > > > > --
> > > >
> > >
> >
>
> > > > > Jason Greenbaum
> > > >
> > >
> >
>
> > > > > Manager, Bioinformatics Core | jgb...@liai.org
> > > >
> > >
> >
>
> > > > > La Jolla Institute for Allergy and Immunology
> > > >
> > >
> >
>
> > > > > ----- Original Message -----
> > > >
> > >
> >
>
> > > > > > From: "Hung-Sheng Tsao (Lao Tsao 老曹) Ph.D."
> > > > > > <lao...@gmail.com>
> > > > >
> > > >
> > >
> >
>
> > > > > > To: "Discussion of Rocks Clusters"
> > > > > > <npaci-rocks...@sdsc.edu>
> > > > >
> > > >
> > >
> >
>
> > > > > > Cc: "J. Greenbaum" <jgb...@liai.org>
> > > > >
> > > >
> > >
> >
>
> > > > > > Sent: Friday, January 27, 2012 5:27:58 PM
> > > > >
> > > >
> > >
> >
>
> > > > > > Subject: Re: [Rocks-Discuss] /etc/passwd file not syncing
> > > > >
> > > >
> > >
> >
>
> > > > Founder & Principal
> > >
> >
>
> > > > HopBit GridComputing LLC
> > >
> >
>
> > > > cell: 9734950840 http://laotsao.blogspot.com/
> > > > http://laotsao.wordpress.com/ http://blogs.oracle.com/hstsao/
> > >
> >
>
> > > > <laotsao.vcf>
> > >
> >
>
> --
> Hung-Sheng Tsao Ph D.
> Founder & Principal
> HopBit GridComputing LLC
> cell: 9734950840 http://laotsao.blogspot.com/
> http://laotsao.wordpress.com/ http://blogs.oracle.com/hstsao/
-------------- next part --------------
An HTML attachment was scrubbed...
J. Greenbaum
Any idea what could have caused the issue?
-J
--
Jason Greenbaum
Manager, Bioinformatics Core | jgb...@liai.org
La Jolla Institute for Allergy and Immunology
----- Original Message -----
> -P
"Hung-Sheng Tsao (Lao Tsao 老曹) Ph.D."
see philip answer
rocks sync host sharedkey compute
> *Manager, Bioinformatics Core | jgb...@liai.org <mailto:jgb...@liai.org>
> La Jolla Institute for Allergy and Immunology
>
>
>
> *From: *"Hung-Sheng Tsao (Lao Tsao 老曹) Ph.D." <lao...@gmail.com>
> *To: *"J. Greenbaum" <jgb...@liai.org>
> *Cc: *"Discussion of Rocks Clusters" <npaci-rocks...@sdsc.edu>
> *Sent: *Saturday, January 28, 2012 5:27:19 PM
> *Subject: *Re: [Rocks-Discuss] /etc/passwd file not syncing
>
>
>
> On 1/28/2012 7:17 PM, J. Greenbaum wrote:
>
> Starting over is my absolute last resort. Anyone have any
> other ideas? This system has been running fine for several
> months and I'm not sure what could have caused this.
>
> IMHO, you have done some things!!
> most likely some file in /var/411/*
>
> Makefile
> Files.mk
> Group.mk
>
> get changed
> check out the rocks-411-master rpm to recover these files
>
> do
> make -C /var/411
> or
> make-C /var/411 force
> rocks run host command="411get --all"
>
>
>
>
> Thanks,
>
> J
>
> --
> La Jolla Institute for Allergy and Immunology
>
>
>
> *From: *"Hung-Sheng Tsao (laoTsao)" <lao...@gmail.com>
> *Cc: *"J. Greenbaum" <jgb...@liai.org>
> *Subject: *Re: [Rocks-Discuss] /etc/passwd file not syncing
>
> may be younshould start all over again
>
>
> Sent from my iPad
>
> On Jan 28, 2012, at 6:49, "Hung-Sheng Tsao (Lao Tsao 老曹)
> Ph.D."<lao...@gmail.com> wrote:
>
>
> do compute-??s' /etc/passwd and /etc/shadow get updated?
>
> On 1/27/2012 9:53 PM, J. Greenbaum wrote:
>
> I just tried that, but it does not seem to work.
> The output of the command is:
>
> /etc.auto..home
> /etc.auto..master
> /etc.auto..misc
> /etc.auto..net
> /etc.auto..share
> /etc.auto..smb
> /etc.group
> /etc.passwd
> /etc.shadow
>
> However, the files seem to be unchanged...
>
> -J
>
> --
> La Jolla Institute for Allergy and Immunology
>
>
>
> *From: *"Hung-Sheng Tsao (Lao Tsao 老曹)
> Ph.D." <lao...@gmail.com>
> *To: *"Discussion of Rocks Clusters"
> <npaci-rocks...@sdsc.edu>> *Sent: *Friday, January 27, 2012 5:27:58 PM
> *Subject: *Re: [Rocks-Discuss] /etc/passwd
>
>
>
> --
> Hung-Sheng Tsao Ph D.
> HopBit GridComputing LLC
> cell: 9734950840
>
> http://laotsao.blogspot.com/
> http://laotsao.wordpress.com/
> http://blogs.oracle.com/hstsao/
>
>
--
Hung-Sheng Tsao Ph D.
Founder& Principal
HopBit GridComputing LLC
cell: 9734950840
-------------- next part --------------
An HTML attachment was scrubbed...
-------------- next part --------------
A non-text attachment was scrubbed...
Name: laotsao.vcf
Type: text/x-vcard
Size: 608 bytes
Desc: not available
Url : https://lists.sdsc.edu/pipermail/npaci-rocks-discussion/attachments/20120128/5e2685c0/laotsao.vcf
Philip Papadopoulos
sharedkey. It usually works,
but apparently not always (e.g. a rocks bug). Without the shared key, the
nodes can't decode the 411 files (by design). the 411 files do contain
crypted passwords.
We don't transfer any security sensitive information in the kickstart file.
Thanks,
Phil