Difference: AtlasGanga (4 vs. 5)

Revision 52009-11-13 - JamesRobinson

Line: 1 to 1

META TOPICPARENT	name="HEPGroup.AtlasStuff"

Running a Grid Job using GANGA

Ganga is a frontend tool for job definition and management with access to all grid infrastucture supported by ATLAS. Detailed Information about GANGA can be found in http://documentation.hepcg.org/res/ap3/w_301106.pdf

Line: 16 to 16

Change directory to the run directory of the whichever package you are working on and then start ganga with:

ganga

Changed:

<
<

Using GANGA

>
>

Using GANGA with the LCG backend

The ganga command line is a python shell which can be used to submit jobs. A sample job script is shown here:

Line: 33 to 33

ganga scriptname

For more information about submitting your own jobs see the GANGA tutorial: https://twiki.cern.ch/twiki/bin/view/Atlas/FullGangaAtlasTutorial

Added:

>
>

Using the Panda backend

The Panda backend has to be used for jobs sent to US sites. It requires a slightly different form of job submission script. A sample job script is shown here:

j = Job()
j.application = Athena()
j.name='PTResolution.LowPT.SmallEta.J5'
j.application.option_file=[ '/home/robinson/athena/15.6.0/PhysicsAnalysis/ForwardJets/run/jobOptions.PTResolution.LowPT.SmallEta.py' ]
j.application.athena_compile = True
j.application.atlas_release='15.6.0'
j.application.prepare()
j.inputdata=DQ2Dataset()
j.inputdata.dataset=[ 'mc08.105014.J5_pythia_jetjet.merge.AOD.e344_s479_s520_r809_r838/' ]
j.outputdata=DQ2OutputDataset()
j.splitter=DQ2JobSplitter()
j.splitter.numsubjobs=500
j.backend=Panda()
j.submit()

Using the NorduGrid backend

If submitting jobs to NorduGrid in the Netherlands there is only one cloud. Therefore, the your script needs to be of the following form, changing the backend to 'NG'.

j = Job()
j.application = Athena()
j.name='PTResolution.LowPT.SmallEta.J5'
j.application.option_file=[ '/home/robinson/athena/15.6.0/PhysicsAnalysis/ForwardJets/run/jobOptions.PTResolution.LowPT.SmallEta.py' ]
j.application.athena_compile = True
j.application.atlas_release='15.6.0'
j.application.prepare()
j.inputdata=DQ2Dataset()
j.inputdata.dataset=[ 'mc08.105014.J5_pythia_jetjet.merge.AOD.e344_s479_s520_r809_r838/' ]
j.outputdata=DQ2OutputDataset()
j.outputdata.outputdata=['PTResolution.root']
j.splitter=DQ2JobSplitter()
j.splitter.numsubjobs=500
j.backend=NG()
j.submit()

*Useful GANGA python shell commands

exit GANGA: ctrl-D
get online help: help (exit help: ctrl-D)

Line: 44 to 54

view job output directory of finished jobs that is retrieved back to the job repository: jobs(jobid).peek()
view stdout or stderr for debugging failed jobs: jobs(jobid).peek('stdout.gz','emacs')
export job configuration to a file: export(jobs[jobid], '~/jobconf.py')

Changed:

<
<

force a job into a particular status: jobs(jobid).force_status("failed")

The repository for input/output files for every job is located by default at: $HOME/gangadir/workspace/username/LocalAMGA

>
>

force a job into a particular status: jobs(jobid).force_status("failed") The repository for input/output files for every job is located by default at: $HOME/gangadir/workspace/username/LocalAMGA

Common GANGA Problems

The datasets belonging to the container that you want to run on must all be present on the same cloud (although not necessarily at the same site). You can check where datasets are available by running:

Changed:

<
<

dq2-ls -r "datasetname" (outside ganga) The Athena version that you request must be present at all sites that your job is sent to. You can check which versions are available at which sites by running:
lcg-infosites --vo atlas ce tag

Using the Panda backend

The Panda backend has to be used for jobs sent to US sites. It requires a slightly different form of job submission script. A sample job script is shown here:

>
>

dq2-ls -r "datasetname" (outside ganga)

Changed:

<
<

>
>

If the data is not present, you can go here to request replication: http://panda.cern.ch:25980/server/pandamon/query?mode=ddm_req

Changed:

<
<

-- JamesRobinson - 13 Nov 2009

>
>

The Athena version that you request must be present at all sites that your job is sent to. You can check which versions are available at which sites by running:

lcg-infosites --vo atlas ce tag -- JamesRobinson - 13 Nov 2009

OLD BUT MAY STILL BE RELEVANT

Deleted:

<
<

GANGA on NorduGrid

By default GANGA submits your jobs to the LCG. Since GANGA version 4.3.0, you can also submit your jobs to NorduGrid using the new NG backend. More information on how to change your jobs from LCG to NG can be found here:

https://twiki.cern.ch/twiki/bin/view/Atlas/GangaNGTutorial430

Sandbox fun

* Input Sandbox:

View topic | History: r6 < r5 < r4 < r3 | More topic actions...