assert self.world_size == dp_size * pp_size * tp_size, f"World size ({self.world_size}) != DP ({self.dp_size}) * PP ({self.pp_size}) * TP ({self.tp_size})" self.grid ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results