Searched refs:allreduce (Results 1 – 4 of 4) sorted by relevance
94 summed = mpi.allreduce(tensor, average=False)138 summed = mpi.allreduce(tensor, average=False)173 session.run(mpi.allreduce(tensor))183 session.run(mpi.allreduce(tensor))200 session.run(mpi.allreduce(tensor))
136 def allreduce(tensor, average=True): function204 return [(allreduce(gradient), var) for (gradient, var) in gradients]
97 all_gather = mpi.allreduce(to_gather[my_rank], average_allgather)
81 stage_input = mpi.allreduce(inter_output,