[Labs-l] Out file generator is really screwy

Fri Sep 4 15:05:13 UTC 2015

That would make sense, but I never route multiple jobs to the same file for
that very reason.  I checked and there are no duplicates.

On Fri, Sep 4, 2015 at 10:59 AM, Brad Jorsch (Anomie) <bjorsch at wikimedia.org
> wrote:

> On Fri, Sep 4, 2015 at 10:50 AM, Maximilian Doerr <
> maximilian.doerr at gmail.com> wrote:
>
>> When using the grid to run jobs and directing the output to an out file,
>> after about an hour the file becomes really screwy.  Bits and pieces get
>> duplicated and pasted around, and the log ultimately gets scrambled about,
>> which defeats the purpose of the log file.  This kind of makes me want to
>> move off of the grid, if it's costing me my logs.
>>
>
> Are you directing the output from multiple concurrent jobs to the same
> file? If so, my first guess would be that the jobs aren't atomically
> appending log lines (I don't know if such atomic writes are even
> supported), so the writes from different jobs wind up being interleaved
> unexpectedly.
>
> _______________________________________________
> Labs-l mailing list
> Labs-l at lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/labs-l
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/labs-l/attachments/20150904/4b3b04b6/attachment.html>