[Labs-admin] Quick note on gridengine and bindmounts

• Previous message: [Labs-admin] Cron <root at labstore2004> /usr/local/sbin/block_sync 10.64.37.20 misc misc-project misc-snap /dev/backup/misc-project
• Next message: [Labs-admin] tools: main page (and possibly other tools) just died, then (after about half an hour) restarted itself (?)
• Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

I did my best to carry through the elimination of bind mounts for grid
operation yesterday.  Yuvi noticed a few straggling puppet disables later
on, and one of those (for whatever reason) had escaped my process and was a
valid grid node.  The rest I must have missed via clush -g all somehow?
I'm not sure.

A quick primer if you run into this.  A node where /var/lib/gridengine is
not a symlink, and /etc/fstab has a bind defined for /var/lib/gridengine is
not in an expected state.

To convert a bind mount (as root):

* exec-manage depool $fqdn (from bastion)
* bash /data/project/remove-var-lib-grid.sh
* usually easiest here to logout and back in post mount removal.
* bash /data/project/grid-convert-bind-to-link.sh
* puppet agent --test
* exec-manage depool $fqdn


https://gerrit.wikimedia.org/r/#/c/321786/
https://gerrit.wikimedia.org/r/#/c/322008/
https://gerrit.wikimedia.org/r/#/c/321584/

Thanks,

Chase
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/labs-admin/attachments/20161117/e0ec252d/attachment.html>

• Previous message: [Labs-admin] Cron <root at labstore2004> /usr/local/sbin/block_sync 10.64.37.20 misc misc-project misc-snap /dev/backup/misc-project
• Next message: [Labs-admin] tools: main page (and possibly other tools) just died, then (after about half an hour) restarted itself (?)
• Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]