Skip to content

Commit

Permalink
revert process_group
Browse files Browse the repository at this point in the history
  • Loading branch information
Function-Samuel committed Jan 16, 2025
1 parent 16723e9 commit 305f5af
Showing 1 changed file with 3 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -229,7 +229,9 @@ def instantiate(self):
alltoall_tmp = paddle.empty(
shape=[self.nranks, self.nranks], dtype="int32"
)
paddle._C_ops.all_to_all(alltoall_tmp, ring_id)
paddle._legacy_C_ops.all_to_all(
alltoall_tmp, 'use_calc_stream', True, 'ring_id', ring_id
)
paddle.device.cuda.synchronize()

if self.nranks > 1:
Expand Down

0 comments on commit 305f5af

Please sign in to comment.