Changes between Version 48 and Version 49 of RemoteJobs

Timestamp:

Oct 12, 2016, 3:56:02 PM (8 years ago)

Author:

davea

Comment:

--

RemoteJobs

@@ -454 +454 @@
 }}}
 
+== Python binding ==
+
+The file tools/submit_api.py contains a Python binding of some of above RPCs.
+For examples of its use, se tools/submit_api_test.py.
+
+To build a description of a batch of jobs,
+use the BATCH_DESC, JOB_DESC, and FILE_DESC objects:
+{{{
+def make_batch():
+    file = FILE_DESC()
+    file.mode = 'remote'
+    file.url = 'http://isaac.ssl.berkeley.edu/validate_logic.txt'
+    file.md5 = "eec5a142cea5202c9ab2e4575a8aaaa7"
+    file.nbytes = 4250
+
+    job = JOB_DESC()
+    job.files = [file]
+
+    batch = BATCH_DESC()
+    batch.project = 'http://isaac.ssl.berkeley.edu/test/'
+    batch.authenticator = get_auth()
+    batch.app_name = "uppercase"
+    batch.batch_name = "blah"
+    batch.jobs = []
+
+    for i in range(3):
+        job.rsc_fpops_est = i*1e9
+        job.command_line = '-i %s' %(i)
+        batch.jobs.append(copy.copy(job))
+
+    return batch
+}}}
+You can then pass this to either estimate_batch() or submit_batch():
+{{{
+    batch = make_batch()
+    r = estimate_batch(batch)
+    if r.tag == 'error':
+        print 'error: ', r.find('error_msg').text
+        return
+    print 'estimated time: ', r.text, ' seconds'
+}}}
+
+The return value of all the API functions is an !EntityTree representation
+of the XML returned by the RPC.
+
+Other requests use a REQUEST object.
+For example, to query the status of batch 271:
+{{{
+    req = REQUEST()
+    req.project = 'http://isaac.ssl.berkeley.edu/test/'
+    req.authenticator = get_auth()
+    req.batch_id = 271
+    req.get_cpu_time = True
+    r = query_batch(req)
+    if r[0].tag == 'error':
+        print 'error: ', r[0].find('error_msg').text
+        return
+    print 'njobs: ', r.find('njobs').text
+    print 'fraction done: ', r.find('fraction_done').text
+    print 'total CPU time: ', r.find('total_cpu_time').text
+    # ... various other fields
+    print 'jobs:'
+    for job in r.findall('job'):
+        print '   id: ', job.find('id').text
+        print '      n_outfiles: ', job.find('n_outfiles').text
+        # ... various other fields
+
+}}}
+
 == HTTP/XML interface ==
 
@@ -471 +540 @@
 However, you will have to modify it heavily for your particular
 applications and web site.
-