GreenSiteDirector updates #2
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# Conflicts: # src/GreenDIRAC/WorkloadManagementSystem/Agent/GreenReportingAgent.py # src/GreenDIRAC/__init__.py
- Introduced SiteDirectorGreen for green-aware pilot scheduling - Integrates with GD-CI and CIM APIs to fetch live PUE and carbon intensity (CI) - Caches metrics and computes combined green efficiency score (30% PUE / 70% CI) - Sorts queues by green efficiency before submitting pilots - Maintains full compatibility with standard DIRAC SiteDirector logic - Initial implementation does not yet use class inheritance; will be refactored in a future PR to extend the base SiteDirector cleanly
…robust JobDB storage - Added direct CIM API integration for fetching PUE and CI via GOCDB site mapping. - Implemented automatic JWT token retrieval and caching for CIM API authentication. - Computed energy (kWh) and CO₂ emissions (gCO₂) per job using TDP, PUE, and CI. - Enhanced logging: added site-level summaries and detailed per-job reporting.
atsareg
reviewed
Nov 12, 2025
| self.maxJobsAtOnce = self.am_getOption("MaxJobsAtOnce", self.maxJobsAtOnce) | ||
| self.login = self.am_getOption("CIM_EMAIL", self.login) | ||
| self.password = self.am_getOption("CIM_PASSWORD", self.password) | ||
| self.cim_api_base = self.am_getOption("cim_api_base", self.cim_api_base) |
atsareg
reviewed
Nov 12, 2025
| def initialize(self): | ||
| """Sets defaults""" | ||
| # CIM API settings | ||
| self.login = "atsareg@in2p3.fr" |
atsareg
reviewed
Nov 12, 2025
| pue, ci, gocdb = siteRes["Value"] | ||
|
|
||
| cpu_s = float(rec.get("TotalCPUTime(s)", 0)) | ||
| energy_kwh = cpu_s * tdp / cores / 1000.0 / 3600.0 |
Member
There was a problem hiding this comment.
Make this a separate function. Later we can have several models/functions to compare
atsareg
reviewed
Nov 12, 2025
| emissions = energy_kwh * pue * ci / 1000.0 # gCO2 | ||
|
|
||
| rec.update({ | ||
| "Energy(kwh)": energy_kwh, |
Member
There was a problem hiding this comment.
Check the record field values against the common "Catalin's" document
atsareg
reviewed
Nov 12, 2025
| age = (time.time() - float(self.token_ts)) / 3600 | ||
| if age < self.token_max_age_hours: | ||
| return self.token | ||
| url = f"{self.cim_api_base.rstrip('/')}/../gd-cim-api/get-token" |
instead of gd-cim-api
…sed on the GreenScore CEE/(PUE*CI)
README for GreenDIRAC overview
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The current repository for Green DIRAC still contains the initial impl of the GreenSiteDirector (e.g., CIM token is not dynamic), This PR shall correct the issue and contains the latest updates...