Difference: AtlasDQ2 (3 vs. 4)

Revision 42010-05-06 - JamesRobinson

Line: 1 to 1

META TOPICPARENT	name="HEPGroup.AtlasStuff"

DQ2 Things

dq2 is handy software for copying files (things like AODs, ESDs, EVNTs, TAGs...) off the grid. To set it up, do this:

Line: 6 to 6

source /afs/cern.ch/atlas/offline/external/GRID/ddm/DQ2Clients/setup.sh
voms-proxy-init -voms atlas

Changed:

<
<

export DQ2_LOCAL_SITE_ID=UKI-LT2-UCL-CENTRAL_LOCALGROUPDISK

>
>

export DQ2_LOCAL_SITE_ID=UKI-LT2-UCL-HEP_LOCALGROUPDISK

Then there are two main commands you'll probably feel like using:

Line: 18 to 17

The dq2-ls lists files in a dataset. The dq2-get gets them. The -g tells it to list files in the global catalogue, -r says look remotely, -v says tell me what the hell you're doing.

Changed:

<
<

Dataset names are either official things like mc12.005200.T1_McAtNlo_Jimmy.evgen.EVNT.v12000401 or your own job output like user.adamdavison.005667.ntuples.v6

>
>

Dataset names are either official things like mc12.005200.T1_McAtNlo_Jimmy.evgen.EVNT.v12000401 or your own job output like user.adamdavison.005667.ntuples.v6. You can also use "*" as a wildcard in dataset names.

If you want a certain number of files from the dataset without caring which ones, you can do

dq2-get -n<desired number> <dataset name>

You also sometimes want a whole dataset rather than just one or two files for testing, then you just do:

Changed:

<
<

dq2-get -r -v <dataset name>

>
>

dq2-get -r -v <dataset name>

Changed:

<
<

And hope you've got enough free disk space.

-- AdamD - 14 Nov 2007

>
>

And hope you've got enough free disk space!

Combining multiple datasets

View topic | History: r4 < r3 < r2 < r1 | More topic actions...