Glenn Jocher fad27c0046 Update DDP for `torch.distributed.run` with `gloo` backend (#3680) ... * Update DDP for `torch.distributed.run` * Add LOCAL_RANK * remove opt.local_rank * backend="gloo|nccl" * print * print * debug * debug * os.getenv * gloo * gloo * gloo * cleanup * fix getenv * cleanup * cleanup destroy * try nccl * return opt * add --local_rank * add timeout * add init_method * gloo * move destroy * move destroy * move print(opt) under if RANK * destroy only RANK 0 * move destroy inside train() * restore destroy outside train() * update print(opt) * cleanup * nccl * gloo with 60 second timeout * update namespace printing		2021-06-19 16:30:25 +02:00
..
__init__.py	Start setup for improved W&B integration (#1948)	2021-02-01 21:38:41 -08:00
log_dataset.py	Implement yaml.safe_load() (#2876)	2021-04-21 14:34:45 +02:00
wandb_utils.py	Update DDP for `torch.distributed.run` with `gloo` backend (#3680)	2021-06-19 16:30:25 +02:00