[Labs-l] No space left on device?

Thu May 1 14:36:29 UTC 2014

Andrew Bogott <abogott at wikimedia.org> wrote:

>>> I was tracking down why my PHP session data is lost, and I found the
>>> following warning in the error.log:
>>> 2014-04-30 19:27:03: (mod_fastcgi.c.2701) FastCGI-stderr: PHP Warning:
>>>   Unknown: write failed: No space left on device (28) in Unknown on
>>> line 0
>>> PHP Warning:  Unknown: Failed to write session data (files). Please
>>> verify that the current setting of session.save_path is correct
>>> (/var/lib/php5) in Unknown on line 0
>>> So, does that simply mean the webservers' drive is full, or that my
>>> storage is full? Or should I point the  session.save_path somewhere to
>>> my data storage?
>> This was caused by me flooding /var/log/auth.log with sudo
>> logs; sorry, I'll fix that immediately.  I filed
>> https://bugzilla.wikimedia.org/64683 for tracking.

> This could also be (temporarily) address via
> role::labs::lvm::biglogs, if you haven't already partitioned
> everything.

On the webnodes, the logs usually don't take up much space
as the lighttpd processes log to /data/project, so the stan-
dard allocation is adequate and I wouldn't want to mess with
it unless I make screwing it up a habit :-).

Tim