Re: parallel 1.3: simple parallel processing.
- From: Janis <janis_papanagnou@xxxxxxxxxxx>
- Date: Fri, 4 Apr 2008 06:22:54 -0700 (PDT)
On 4 Apr., 06:40, Edward Rosten <Edward.Ros...@xxxxxxxxx> wrote:
Version 1.3 of ssh_parallel and parallel have been released.
This release features much better error handling in ssh_parallel, so
network errors are less likely to cause jobs to go missing.
Additionally, it allows you to specify a nice level for processes.
Same as the last time, I'm interested in any comments/critiques anyone
may have.
Original release notes (with updated URLs):
If you ever write a shell script along the lines of:
some | pipieline | bash
then you may be interested in my program parallel. The above line
would be written as:
some | pipeline | parallel 4
to perform the same task, but with 4 commands running in parallel.
There is a companion program, ssh_parallel which will distribute the
jobs over a number of machines (assuming you have passwordless SSH set
up).
Webpage:http://mi.eng.cam.ac.uk/~er258/code/index.html
Download:http://mi.eng.cam.ac.uk/~er258/code/dist/parallel-1.3.tar.gz
-Ed
I had a peek into the sources of parallel.c and wonder about the
feature to be able to start 2 or more processes but the restriction
to not start a single one. Though, the latter may be useful if the
argument is computed instead of hard coded. It seems an unnecessary
restriction. Just curious.
A useful program, BTW.
Janis
.
- Follow-Ups:
- Re: parallel 1.3: simple parallel processing.
- From: Edward Rosten
- Re: parallel 1.3: simple parallel processing.
- References:
- [ANN] parallel 1.3: simple parallel processing.
- From: Edward Rosten
- [ANN] parallel 1.3: simple parallel processing.
- Prev by Date: Re: I need to know a correct group to ask this question
- Next by Date: Re: math oriented script
- Previous by thread: [ANN] parallel 1.3: simple parallel processing.
- Next by thread: Re: parallel 1.3: simple parallel processing.
- Index(es):
Relevant Pages
|
