Improved artificial neural network training with advanced methods
| buir.advisor | Morgül, Ömer | |
| dc.contributor.author | Çatalbaş, Burak | |
| dc.date.accessioned | 2018-09-13T09:21:44Z | |
| dc.date.available | 2018-09-13T09:21:44Z | |
| dc.date.copyright | 2018-09 | |
| dc.date.issued | 2018-09 | |
| dc.date.submitted | 2018-09-11 | |
| dc.description | Cataloged from PDF version of article. | en_US |
| dc.description | Thesis (M.S.): Bilkent University, Department of Electrical and Electronics Engineering, İhsan Doğramacı Bilkent University, 2018. | en_US |
| dc.description | Includes bibliographical references (leaves 111-115). | en_US |
| dc.description.abstract | Artificial Neural Networks (ANNs) are used for different machine learning tasks such as classification, clustering etc. They have been utilized in important tasks and offering new services more and more in our daily lives. Learning capabilities of these networks have accelerated significantly since 2000s, with the increasing computational power and data amount. Therefore, research conducted on these networks is renamed as Deep Learning, which emerged as a major research area - not only in the neural networks, but also in the Machine Learning discipline. For such an important research field, the techniques used in the training of these networks can be seen as keys for more successful results. In this work, each part of this training procedure is investigated by using of different and improved - sometimes new - techniques on convolutional neural networks which classify grayscale and colored image datasets. Advanced methods included the ones from the literature such as He-truncated Gaussian initialization. In addition, our contributions to the literature include ones such as SinAdaMax Optimizer, Dominantly Exponential Linear Unit (DELU), He-truncated Laplacian initialization and Pyramid Approach for Max-Pool layers. In the chapters of this thesis, success rates are increased with the addition of these advanced methods accumulatively, especially with DELU and SinAdaMax which are our contributions as upgraded methods. In result, success rate thresholds for different datasets are met with simple convolutional neural networks - which are improved with these advanced methods and reached promising test success increases - within 15 to 21 hours (typically less than a day). Thus, better performances are obtained by those different and improved techniques are shown using well-known classification datasets. | en_US |
| dc.description.provenance | Submitted by Betül Özen (ozen@bilkent.edu.tr) on 2018-09-13T09:21:44Z No. of bitstreams: 1 10210913.pdf: 1277281 bytes, checksum: c9e08e65032667b2e49513a9cf6e3640 (MD5) | en |
| dc.description.provenance | Made available in DSpace on 2018-09-13T09:21:44Z (GMT). No. of bitstreams: 1 10210913.pdf: 1277281 bytes, checksum: c9e08e65032667b2e49513a9cf6e3640 (MD5) Previous issue date: 2018-09 | en |
| dc.description.statementofresponsibility | by Burak Çatalbaş. | en_US |
| dc.format.extent | xvii, 115 leaves : illustrations, charts (some color) ; 30 cm. | en_US |
| dc.identifier.itemid | B158935 | |
| dc.identifier.uri | http://hdl.handle.net/11693/47866 | |
| dc.language.iso | English | en_US |
| dc.rights | info:eu-repo/semantics/openAccess | en_US |
| dc.subject | Arti cial Neural Networks | en_US |
| dc.subject | Convolutional Neural Networks | en_US |
| dc.subject | Deep Learning | en_US |
| dc.subject | Neural Network Training | en_US |
| dc.subject | CIFAR-10 | en_US |
| dc.subject | MNIST | en_US |
| dc.title | Improved artificial neural network training with advanced methods | en_US |
| dc.title.alternative | İleri yöntemlerle geliştirilmiş yapay sinir ağı eğitimi | en_US |
| dc.type | Thesis | en_US |
| thesis.degree.discipline | Electrical and Electronic Engineering | |
| thesis.degree.grantor | Bilkent University | |
| thesis.degree.level | Master's | |
| thesis.degree.name | MS (Master of Science) |