Transfer Queue

[JacobHelwig]

Hi, I'm thinking about working on migrating TQ from experimental to the Ray Trainer, is this something that would be good for me to work on? @wuxibin89 @vermouth1992

[wuxibin89]

@0oshowero0 is working on this: https://gitcode.com/Ascend/TransferQueue, github repo will be public soon.

[0oshowero0]

Hi! It’s great to see your interest in TQ!

Currently, we are working on:

• Integrating all new RayPPOTrainer features into our experimental folder: https://github.com/TransferQueue/verl/tree/trainer_main. CC @MissFishY
• Migrate the experimental folder into main by inheriting the RayPPOTrainer and overriding the fit method.
• Dispatching all computations from RayPPOTrainer to remote workers to improve scalability. You can check our progress on reward dispatching here: https://github.com/TransferQueue/verl/tree/dispatch_reward. CC @walter

If you're interested, I can send you an invitation to collaborate on this fork~.

Note: due to the migration of recipe #4795, some extra work is needed. I will notify you when the adaptation has been pushed to the above branches (they are still empty now).

[JacobHelwig]

Thanks for the reply and info, @wuxibin89

Thanks @0oshowero0! Yes, I would love to contribute -- please send the invite when you get a chance. Is anyone working on the second bullet (Migrate the experimental folder into main) ?

[0oshowero0]

I have added you on linkedin. We can further discuss the following plans.