Skip to content

Major update #48

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
lintangsutawika wants to merge 34 commits into
base: main
Choose a base branch
from
Open

Major update #48

lintangsutawika wants to merge 34 commits into from

Conversation

@lintangsutawika
Copy link
Collaborator

@lintangsutawika lintangsutawika commented Dec 28, 2025

  1. More rewards (include cosine rewards)
  2. Handle both step-wise and non-step-wise training
  3. Add non-thinking
  4. maintain max length but train on shorter (adjustable) train length. This is so that rollouts length and training can be decoupled.

@lintangsutawika
add utility to truncate prompts
84ab1f4
@lintangsutawika
add swe-smith option
8f60b52
@lintangsutawika
adjust so trajectories can be saved to gcs
337ee36
@lintangsutawika
add step_wise flag
2ee6bd1
@lintangsutawika
process both step wise or non-step wise. Mask non-step wise
c7c0e49
@lintangsutawika
fix working_dir
4601e0c
@lintangsutawika
fix reward return
06e10b1
@lintangsutawika
add max_train_length
767ae8a
@lintangsutawika
apply patch for swe-smith
5bc750f
@lintangsutawika
add additional args
f648708
@lintangsutawika
many different types of rewards
a6773b2
@lintangsutawika
cosine_rewards with option to turn off parts
ec0ce46
@lintangsutawika
fix turn count
86646ea
@lintangsutawika
fix turn count
3277171
@lintangsutawika
add length reward
ec86b20
@lintangsutawika
hf checkpoint every 10
a78bc49
@lintangsutawika
add format reward
e07cb9c
@lintangsutawika
temporarily hardcode tools
c2b6bd4
@lintangsutawika
latest version
f22d1a7
@lintangsutawika
add templates
fe05c86
@lintangsutawika
add starter for no think
fc338ef
@lintangsutawika
temporariliy remove tool
f89fcf7
@lintangsutawika
rename
ff7c5d0
@lintangsutawika
removed unused lines
5de22ae
@lintangsutawika
update message
5a5648f
@lintangsutawika
add weight calculation for reward
fc04637
@lintangsutawika
fix padding
97bc1d8
@lintangsutawika
add new config
01568bc
@lintangsutawika
checkpoint for working system
b1c4376
@lintangsutawika
add weighted f05
97efad2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@lintangsutawika @adityasoni9998