Treffer: EdgeTune: Inference-Aware Hyperparameter Tuning

EdgeTune: Inference-Aware Hyperparameter Tuning The results of EdgeTune have been presented at the ACM Middleware 2022 conference. If you use this software, please cite us: ``` @inproceedings{10.1145/3528535.3533273, author = {Rocha, Isabelly and Felber, Pascal and Schiavoni, Valerio and Chen, Lydia}, title = {EdgeTune: Inference-Aware Multi-Parameter Tuning}, year = {2022}, isbn = {9781450393409}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, url = {https://doi.org/10.1145/3528535.3533273}, doi = {10.1145/3528535.3533273}, booktitle = {Proceedings of the 23rd Conference on 23rd ACM/IFIP International Middleware Conference}, pages = {1–14}, numpages = {14}, keywords = {tuning, deep neural networks, training, inference}, location = {Quebec, QC, Canada}, series = {Middleware '22} } ``` ## Install pip3 ```Shell $ sudo apt-get update $ sudo apt-get install python3-pip ``` ## Install Python dependencies - Intel (nuc) ```Shell $ pip3 install torch torchvision keras tensorflow ray[rllib] pandas tensorflow_datasets ``` - ARM (RaspberryPi) ```Shell $ git clone https://github.com/Ben-Faessler/Python3-Wheels.git $ sudo pip3 install Python3-Wheels/pytorch/torch-1.5.0a0+4ff3872-cp37-cp37m-linux_armv7l.whl $ sudo pip3 install Python3-Wheels/torchvision/torchvision-0.6.0a0+b68adcf-cp37-cp37m-linux_armv7l.whl ``` - Jetson Nano ```Shell $ wget https://nvidia.box.com/shared/static/wa34qwrwtk9njtyarwt5nvo6imenfy26.whl -O torch-1.7.0-cp36-cp36m-linux_aarch64.whl $ sudo apt-get install python3-pip libopenblas-base libopenmpi-dev $ pip3 install Cython $ pip3 install numpy torch-1.7.0-cp36-cp36m-linux_aarch64.whl $ sudo apt-get install libjpeg-dev zlib1g-dev $ git clone --branch v0.8.1 https://github.com/pytorch/vision torchvision $ cd torchvision $ export BUILD_VERSION=0.8.1 $ sudo python3 setup.py install ``` ## Install cpupower (for frequency scaling) ```Shell $ sudo apt-get install linux-cpupower $ cpufreq-info # get cpu frequency information $ cpufreq-set -u min -d max # set cpu frequency ``` ...