[Labs-l] Processing dumps with Wikimedia Utilities

Sun May 18 16:14:27 UTC 2014

Well, the dump is reachable from the machine. But my script do this:

fp = subprocess.Popen('7za e -bd -so %s 2>/dev/null' % dumpfilename,
shell=True, stdout=subprocess.PIPE, bufsize=65535)

Is this correct in a grid?

2014-05-18 17:57 GMT+02:00 Emilio J. Rodríguez-Posada <emijrp at gmail.com>:

> Yeah... I have done that, but now a new problem. I can't read the dump in
> the destination machine.
>
> Where do I have to copy the dump?
>
>
> 2014-05-18 17:21 GMT+02:00 Jeremy Baron <jeremy at tuxmachine.com>:
>
>>  On May 18, 2014 11:16 AM, "Emilio J. Rodríguez-Posada" <emijrp at gmail.com>
>> wrote:
>> > I have created the virtualenv for Python3, installed
>> mediawiki-utilities, etc. I can launch my script in that virtualenv and
>> works fine, but when I do 'jsub', the destination machine obviously doesn't
>> have that module:
>>
>> Sounds like you need to use the activate script for your virtualenv. You
>> could do that in a wrapper shell script.
>>
>>
>> http://virtualenv.readthedocs.org/en/latest/virtualenv.html#activate-script
>>
>> -Jeremy
>>
>> _______________________________________________
>> Labs-l mailing list
>> Labs-l at lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/labs-l
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wikimedia.org/pipermail/labs-l/attachments/20140518/39c5c1df/attachment-0001.html>