yolov5/utils
Glenn Jocher 264d860f8d
ACON activation function (#2893)
* ACON Activation Function

## 🚀 Feature

There is a new activation function [ACON (CVPR 2021)](https://arxiv.org/pdf/2009.04759.pdf) that unifies ReLU and Swish. 
ACON is simple but very effective, code is here: https://github.com/nmaac/acon/blob/main/acon.py#L19

![image](https://user-images.githubusercontent.com/5032208/115676962-a38dfe80-a382-11eb-9883-61fa3216e3e6.png)

The improvements are very significant:
![image](https://user-images.githubusercontent.com/5032208/115680180-eac9be80-a385-11eb-9c7a-8643db552c69.png)

## Alternatives

It also has an enhanced version meta-ACON that uses a small network to learn beta explicitly, which may influence the speed a bit.

## Additional context

[Code](https://github.com/nmaac/acon) and [paper](https://arxiv.org/pdf/2009.04759.pdf).

* Update activations.py
2021-04-22 17:26:05 +02:00
..
aws Implement yaml.safe_load() (#2876) 2021-04-21 14:34:45 +02:00
flask_rest_api Flask REST API Example (#2732) 2021-04-15 13:26:08 +02:00
google_app_engine adding the configuration to deploy yolov5 in in app engine (#964) 2020-09-22 11:48:44 -07:00
wandb_logging Implement yaml.safe_load() (#2876) 2021-04-21 14:34:45 +02:00
__init__.py initial commit 2020-05-29 17:04:54 -07:00
activations.py ACON activation function (#2893) 2021-04-22 17:26:05 +02:00
autoanchor.py Implement yaml.safe_load() (#2876) 2021-04-21 14:34:45 +02:00
datasets.py Cleanup load_image() (#2871) 2021-04-21 15:50:28 +02:00
general.py VisDrone2019-DET Dataset Auto-Download (#2882) 2021-04-22 12:10:26 +02:00
google_utils.py Uppercase model filenames enabled (#2890) 2021-04-22 16:51:21 +02:00
loss.py Add --label-smoothing eps argument to train.py (default 0.0) (#2344) 2021-03-29 18:45:46 +02:00
metrics.py bug fix: switched rows and cols for correct detections in confusion matrix (#2883) 2021-04-22 00:49:55 +02:00
plots.py Implement yaml.safe_load() (#2876) 2021-04-21 14:34:45 +02:00
torch_utils.py Speed profiling improvements (#2648) 2021-03-29 15:19:07 +02:00