[Labs-l] Outage report: short user/group lookup outage due to code deployment

Tue Apr 2 19:13:18 UTC 2013

The changes necessary for per-project service users and groups were pushed
today, which included changes to nslcd.conf. We added a few base lookups
for the passwd, shadow, and group maps for each project. This pointed at
OUs specific to the projects.

The OUs weren't created prior to the puppet change. This wouldn't normally
cause any problems, but it seems that nslcd has a bug. In lucid this caused
all user/group lookups to fail. In precise user lookups worked, but group
lookups failed (which means the bug was half fixed). I ran a maintenance
script to automatically create the OUs for all projects and everything
started working properly again.

New projects created automatically have the OUs created, so we don't expect
any future issues with this bug.

- Ryan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wikimedia.org/pipermail/labs-l/attachments/20130402/1d039e50/attachment.html>