Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PM-1950] enable users to use container universe when running containerized jobs in pure condor environments #2063

Open
mayani opened this issue Dec 14, 2024 · 3 comments
Assignees
Labels

Comments

@mayani
Copy link
Member

mayani commented Dec 14, 2024

[https://htcondor.readthedocs.io/en/latest/users-manual/env-of-job.html#container-universe-jobs]

Reporter: @vahi
Watchers:
@vahi

@mayani
Copy link
Member Author

mayani commented Dec 14, 2024

Author: @vahi

a test job that works on osg

 

universe = container

requirements = TestPool =!= True && isUndefined(AnnexName)
+ProjectName = "OSG-Staff"

initialdir = /home/rynge/testjobs/ospool-container/initdir
container_image = llm-rag-v1.sif

executable = job.sh
output       = outputs/$(Cluster).$(Process).out
error        = outputs/$(Cluster).$(Process).err
log          = outputs/$(Cluster).log

request_cpus = 1
request_memory = 512 MB

queue 1 

@mayani
Copy link
Member Author

mayani commented Dec 14, 2024

Author: @vahi

@rynge do you know how to tell HTCondor additonal mount points to bind to the container at runtime?

@mayani
Copy link
Member Author

mayani commented Dec 14, 2024

Author: @vahi

@rynge while working on associated workflow tests, one issue is what to do about auxillary jobs. so the way this is exposed is that a user specifies container universe profile in the site catalog. 

now if a transfer job gets scheduled to be run remotely on the site, the planner should explicitly disable container universe for all pegasus auxiliary jobs.

@mayani mayani changed the title PM-1950 [PM-1950] enable users to use container universe when running containerized jobs in pure condor environments Dec 14, 2024
@mayani mayani added the major Major loss of function. label Dec 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants