Vesper Terminology¶

What is a job ?¶

A llob is a python function but decorated by the decorator @as—llob, which has no return value, it w ill not block the caller. in this decorator as—llob,
we could define some dependencies, it accept a function which return a list of file names. A llob w ill be send to a idle worker after
its depedencies was satisified.

What is a worker?¶

a worker is a prcoess run our binary verper but works in worker—mode, in this mode, it run a loop to get llob from the scheduler and execute the llob.
A worker could be launche in either local machine or remote machines.

what is the launcher?¶

the launcher is a tool to launch worker in local machine or cluster, currently we have local launc her and lsf launcher,
the local launcher will launch worker with system call, and the lsf launcher will launch worker wi th command bsub,
here user need specified how to select a machine with bsub.

what is the map reduce?¶

the map reduce works in the similar way of python map reduce, but run in multi machines. there is an example:

mm = MapReduce(list(range(S)), map—func, reduce—func)
mm.map—reduce()
res = mm.get()

Notice that mm.get() will block and wait the result