-
-
Notifications
You must be signed in to change notification settings - Fork 44
Add option to use t0 embedding features #505
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
| embedding_dim=None, | ||
| include_sun=False, | ||
| include_time=True, | ||
| t0_embedding_dim=3, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This might be my lack of understanding, but is it obvious how know the t0_embedding_dim from the t0_embedding embedding (below)?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Well in the function docstring it explains that the embedding_dim parameter is for the location ID. We could rename embedding_dim->loc_embedding_dim or something similar to be more explicit. But for that we'd need to migrate all our production models
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Oh sorry, I think I misunderstood your question. You mean how can you know what the t0_embedding_dim needs to be given t0_embedding config? That info is in data-sampler.
Basically:
t0_embedding_dim = sum([1 if e=="linear" else 2 for e in t0_embedding.embeddings])
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ah i see, could you put this comment in the docstrings? (Or if there somewhere else more suitable)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This feels like bloat here since it is explained in full in data-sampler
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Maybe a compromise is to put the explanation in the example config
|
Other than my questions, this looks good and clear |
6c004cf to
f6b9a10
Compare
f6b9a10 to
d076bc4
Compare
Pull Request
Description
This adds the option to use the t0-embedding features which were added to data-sampler in openclimatefix/ocf-data-sampler#385 in PVNet
Checklist: