This module is designed to generate Kafka events that simulate real events produced by Rucio, enabling the ingestion of files already replicated in a destination butler by ctrl_ingestd. It need a valid proxy to access Rucio and the environment variable RUCIO_CONFIG set to point to yout Rucio config.
Setup the environment:
export RUCIO_CONFIG="/path/to/your/rucio/config.conf" source /cvmfs/sw.lsst.eu/linux-x86_64/lsst_distrib/w_2024_37/loadLSST.zsh && setup lsst_distrib
To use it:
git clone [email protected]:gabrimaine/RucioDummyEventCreator.git cd RucioDummyEventCreator/ export PYTHONPATH=$PWD/python:$PYTHONPATH scons ./bin/dummy_event_generator --help
Usage:
dummy_event_generator [-h] (-d DID [DID ...] | -f FILE) -r RSE [-t TOPIC] [-v]
Process a list of DIDs and send events to Kafka.
Options:
-h, --help
show this help message and exit
-d DID [DID ...], --dids DID [DID ...]
List of DIDs in the format "scope:name".
-f FILE, --file FILE
Path to a file containing a list of DIDs in the format "scope:name", one per line.
-r RSE, --rse RSE
Specify the RSE to be used for processing.
-t TOPIC, --topic TOPIC
Specify Kafka topic. Defaults to RSE name if not provided.
-v, --verbose
Increase the verbosity level of the output.