Ayush Chaurasia
59aae85a7e
W&B: Fix dataset check ( #4879 )
* evolve fix
* Enable login timeout
* fix pkg
* check rank
* don't relogin
* fix
* reformat
3 yıl önce
Ayush Chaurasia
9febea79de
W&B: Login only in master processes ( #4866 )
* evolve fix
* Enable login timeout
* fix pkg
* check rank
* don't relogin
3 yıl önce
Glenn Jocher
4d1a2ac87e
Update `sys.path.append(str(ROOT))` ( #4852 )
* Update `sys.path.append(str(ROOT))`
* Cleanup
3 yıl önce
Ayush Chaurasia
302a1b0bb0
W&B: Enable login timeout ( #4843 )
* evolve fix
* Enable login timeout
* fix pkg
3 yıl önce
Glenn Jocher
c47be26f34
Replace `path.absolute()` with `path.resolve()` ( #4763 )
3 yıl önce
Ayush Chaurasia
11e7c7b48d
W&B: Don't log models in evolve operation ( #4611 )
3 yıl önce
Ayush Chaurasia
7316b78e36
W&B: Refactor the wandb_utils.py file ( #4496 )
* Improve docstrings and run names
* default wandb login prompt with timeout
* return key
* Update api_key check logic
* Properly support zipped dataset feature
* update docstring
* Revert tuorial change
* extend changes to log_dataset
* add run name
* bug fix
* bug fix
* Update comment
* fix import check
* remove unused import
* Hardcore .yaml file extension
* reduce code
* Reformat using pycharm
* Remove redundant try catch
* More refactoring and bug fixes
* retry
* Reformat using pycharm
* respect LOGGERS include list
* Fix
* fix
* refactor constructor
* refactor
* refactor
* refactor
* PyCharm reformat
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
3 yıl önce
Glenn Jocher
24bea5e4b7
Standardize headers and docstrings ( #4417 )
* Implement new headers
* Reformat 1
* Reformat 2
* Reformat 3 - math
* Reformat 4 - yaml
3 yıl önce
Glenn Jocher
63e09fdc48
Remove `encoding='ascii'` ( #4413 )
* Remove `encoding='ascii'`
* Reinstate `encoding='ascii'` in emojis()
3 yıl önce
Ayush Chaurasia
a4e4553040
W&B: Fix for 4360 ( #4388 )
* Improve docstrings and run names
* default wandb login prompt with timeout
* return key
* Update api_key check logic
* Properly support zipped dataset feature
* update docstring
* Revert tuorial change
* extend changes to log_dataset
* add run name
* bug fix
* bug fix
* Update comment
* fix import check
* remove unused import
* Hardcore .yaml file extension
* reduce code
* Reformat using pycharm
* Remove redundant try catch
* More refactoring and bug fixes
* retry
* Reformat using pycharm
* respect LOGGERS include list
* Fix
* fix
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
3 yıl önce
Glenn Jocher
b60b62e874
PyCharm reformat ( #4209 )
* PyCharm reformat
* YAML reformat
* Markdown reformat
3 yıl önce
Ayush Chaurasia
750465edae
W&B: More improvements and refactoring ( #4205 )
* Improve docstrings and run names
* default wandb login prompt with timeout
* return key
* Update api_key check logic
* Properly support zipped dataset feature
* update docstring
* Revert tuorial change
* extend changes to log_dataset
* add run name
* bug fix
* bug fix
* Update comment
* fix import check
* remove unused import
* Hardcore .yaml file extension
* reduce code
* Reformat using pycharm
* Remove redundant try catch
* More refactoring and bug fixes
* retry
* Reformat using pycharm
* respect LOGGERS include list
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
3 yıl önce
Ayush Chaurasia
e88e8f7a98
W&B: Restructure code to support the new dataset_check() feature ( #4197 )
* Improve docstrings and run names
* default wandb login prompt with timeout
* return key
* Update api_key check logic
* Properly support zipped dataset feature
* update docstring
* Revert tuorial change
* extend changes to log_dataset
* add run name
* bug fix
* bug fix
* Update comment
* fix import check
* remove unused import
* Hardcore .yaml file extension
* reduce code
* Reformat using pycharm
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
3 yıl önce
Glenn Jocher
5d66e48723
Train from `--data path/to/dataset.zip` feature ( #4185 )
* Train from `--data path/to/dataset.zip` feature
* Update dataset_stats()
* cleanup
* cleanup2
3 yıl önce
Ayush Chaurasia
63a1971e31
Improve docstrings and run names ( #4174 )
3 yıl önce
Glenn Jocher
0ad6301c96
Update script headers ( #4163 )
* Update download script headers
* cleanup
* bug fix attempt
* bug fix attempt2
* bug fix attempt3
* cleanup
3 yıl önce
Glenn Jocher
efe60b5681
Refactor train.py and val.py `loggers` ( #4137 )
* Update loggers
* Config
* Update val.py
* cleanup
* fix1
* fix2
* fix3 and reformat
* format sweep.py
* Logger() class
* cleanup
* cleanup2
* wandb package import fix
* wandb package import fix2
* txt fix
* fix4
* fix5
* fix6
* drop wandb into utils/loggers
* fix 7
* rename loggers/wandb_logging to loggers/wandb
* Update message
* Update message
* Update message
* cleanup
* Fix x axis bug
* fix rank 0 issue
* cleanup
3 yıl önce
imyhxy
4495e00016
Fix indentation in `log_training_progress()` ( #4126 )
3 yıl önce
Ayush Chaurasia
0cc7c58787
W&B: fix refactor bugs ( #4069 )
3 yıl önce
Glenn Jocher
f7d8562060
`val.py` refactor ( #4053 )
* val.py refactor
* cleanup
* cleanup
* cleanup
* cleanup
* save after eval
* opt.imgsz bug fix
* wandb refactor
* dataloader to train_loader
* capitalize global variables
* runs/hub/exp to runs/detect/exp
* refactor wandb logging
* Refactor wandb operations (#4061 )
Co-authored-by: Ayush Chaurasia <ayush.chaurarsia@gmail.com>
3 yıl önce
Ayush Chaurasia
62409eea08
W&B sweeps support ( #3938 )
* Add support for W&B Sweeps
* Update and reformat
* Update search space
* reformat
* reformat sweep.py
* Update sweep.py
* Move sweeps files to wandb dir
* Remove print
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
3 yıl önce
Ayush Chaurasia
ffb6e11050
W&B: Update Tables API and comply with new dataset_check ( #3772 )
* Update tables API and windows path fix
* update dataset check
3 yıl önce
Ayush Chaurasia
75c0ff43af
[x]W&B: Don't resume transfer learning runs ( #3604 )
* Allow config cahnge
* Allow val change in wandb config
* Don't resume transfer learning runs
* Add entity in log dataset
3 yıl önce
Glenn Jocher
fad27c0046
Update DDP for `torch.distributed.run` with `gloo` backend ( #3680 )
* Update DDP for `torch.distributed.run`
* Add LOCAL_RANK
* remove opt.local_rank
* backend="gloo|nccl"
* print
* print
* debug
* debug
* os.getenv
* gloo
* gloo
* gloo
* cleanup
* fix getenv
* cleanup
* cleanup destroy
* try nccl
* return opt
* add --local_rank
* add timeout
* add init_method
* gloo
* move destroy
* move destroy
* move print(opt) under if RANK
* destroy only RANK 0
* move destroy inside train()
* restore destroy outside train()
* update print(opt)
* cleanup
* nccl
* gloo with 60 second timeout
* update namespace printing
3 yıl önce
Ayush Chaurasia
daab682b06
Suppress wandb images size mismatch warning ( #3611 )
* supress wandb images size mismatch warning
* supress wandb images size mismatch warning
* PEP8 reformat and optimize imports
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
3 yıl önce
Ayush Chaurasia
53d4fc2e26
W&B: Allow changed in config variable #3588
3 yıl önce
Charles Frye
19100ba007
Improves docs and handling of entities and resuming by WandbLogger ( #3264 )
* adds latest tag to match wandb defaults
* adds entity handling, 'last' tag
* fixes bug causing finished runs to resume
* removes redundant "last" tag for wandb artifact
3 yıl önce
Ayush Chaurasia
d2a17289c9
Explicitly convert artifact path to posix_path ( #3067 )
* Explicitly convert artifact path to posix_path
* Remove redudant str() casting
3 yıl önce
Ayush Chaurasia
b18ca31ff5
use check_file for --data ( #3035 )
3 yıl önce
Ayush Chaurasia
801b469878
Improve performance of dataset Logger ( #2943 )
* Improve performance of Dataset Logger
* Fix scaling bug
3 yıl önce
Glenn Jocher
f7bc685c2c
Implement yaml.safe_load() ( #2876 )
* Implement yaml.safe_load()
* yaml.safe_dump()
3 yıl önce
Glenn Jocher
0cae7576a9
utils/wandb_logging PEP8 reformat ( #2755 )
* wandb_logging PEP8 reformat
* Update wandb_utils.py
3 yıl önce
Ayush Chaurasia
3067429307
Add support for list-of-directory data format for wandb ( #2719 )
3 yıl önce
Ayush Chaurasia
514ebcdf33
Fix : #2674 ( #2683 )
* Set resume flag to false
* Check existance of val dataset
3 yıl önce
Ayush Chaurasia
518c09578e
W&B resume ddp from run link fix ( #2579 )
* W&B resume ddp from run link fix
* Native DDP W&B support for training, resuming
3 yıl önce
Ayush Chaurasia
1bf9365280
W&B DDP fix ( #2574 )
3 yıl önce
Ayush Chaurasia
e8fc97aa38
Improved W&B integration ( #2125 )
* Init Commit
* new wandb integration
* Update
* Use data_dict in test
* Updates
* Update: scope of log_img
* Update: scope of log_img
* Update
* Update: Fix logging conditions
* Add tqdm bar, support for .txt dataset format
* Improve Result table Logger
* Init Commit
* new wandb integration
* Update
* Use data_dict in test
* Updates
* Update: scope of log_img
* Update: scope of log_img
* Update
* Update: Fix logging conditions
* Add tqdm bar, support for .txt dataset format
* Improve Result table Logger
* Add dataset creation in training script
* Change scope: self.wandb_run
* Add wandb-artifact:// natively
you can now use --resume with wandb run links
* Add suuport for logging dataset while training
* Cleanup
* Fix: Merge conflict
* Fix: CI tests
* Automatically use wandb config
* Fix: Resume
* Fix: CI
* Enhance: Using val_table
* More resume enhancement
* FIX : CI
* Add alias
* Get useful opt config data
* train.py cleanup
* Cleanup train.py
* more cleanup
* Cleanup| CI fix
* Reformat using PEP8
* FIX:CI
* rebase
* remove uneccesary changes
* remove uneccesary changes
* remove uneccesary changes
* remove unecessary chage from test.py
* FIX: resume from local checkpoint
* FIX:resume
* FIX:resume
* Reformat
* Performance improvement
* Fix local resume
* Fix local resume
* FIX:CI
* Fix: CI
* Imporve image logging
* (:(:Redo CI tests:):)
* Remember epochs when resuming
* Remember epochs when resuming
* Update DDP location
Potential fix for #2405
* PEP8 reformat
* 0.25 confidence threshold
* reset train.py plots syntax to previous
* reset epochs completed syntax to previous
* reset space to previous
* remove brackets
* reset comment to previous
* Update: is_coco check, remove unused code
* Remove redundant print statement
* Remove wandb imports
* remove dsviz logger from test.py
* Remove redundant change from test.py
* remove redundant changes from train.py
* reformat and improvements
* Fix typo
* Add tqdm tqdm progress when scanning files, naming improvements
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
3 yıl önce
Ayush Chaurasia
73a0669930
Start setup for improved W&B integration ( #1948 )
* Add helper functions for wandb and artifacts
* cleanup
* Reorganize files
* Update wandb_utils.py
* Update log_dataset.py
We can remove this code, as the giou hyp has been deprecated for a while now.
* Reorganize and update dataloader call
* yaml.SafeLoader
* PEP8 reformat
* remove redundant checks
* Add helper functions for wandb and artifacts
* cleanup
* Reorganize files
* Update wandb_utils.py
* Update log_dataset.py
We can remove this code, as the giou hyp has been deprecated for a while now.
* Reorganize and update dataloader call
* yaml.SafeLoader
* PEP8 reformat
* remove redundant checks
* Update util files
* Update wandb_utils.py
* Remove word size
* Change path of labels.zip
* remove unused imports
* remove --rect
* log_dataset.py cleanup
* log_dataset.py cleanup2
* wandb_utils.py cleanup
* remove redundant id_count
* wandb_utils.py cleanup2
* rename cls
* use pathlib for zip
* rename dataloader to dataset
* Change import order
* Remove redundant code
* remove unused import
* remove unused imports
Co-authored-by: Glenn Jocher <glenn.jocher@ultralytics.com>
3 yıl önce