Journal of Computer and Knowledge Engineering, Volume (5), No (1), Year (2022-6) , Pages (47-58)

Title : ( Towards Leveraging Structure for Neural Predictor in NAS )

Authors: Saeideh Eslami , Reza Monsefi , Mohammad Akbari ,

Citation: BibTeX | EndNote

Abstract

Neural Architecture Search (NAS), which automatically designs a neural architecture for a specific task, has attracted much attention in recent years. Properly defining the search space is a key step in the success of NAS approaches, which allows us to reduce the required time for evaluation. Thus, late strategies for searching a NAS space is to leverage supervised learning models for ranking the potential neural models, i.e., surrogate predictive models. The predictive model takes the specification of an architecture (or its feature representation) and predicts the probable efficiency of the model ahead of training. Therefore, proper representation of a candidate architecture is an important factor for a predictor NAS approach. While several works have been devoted to training a good surrogate model, there exits limited research focusing on learning a good representation for these neural models. To address this problem, we investigate how to learn a representation with both structural and non-structural features of a network. In particular, we propose a tree structured encoding which permits to fully represent both networks’ layers and their intra-connections. The encoding is easily extendable to larger or more complex structures. Extensive experiments on two NAS datasets, NasBench101 and NasBench201, demonstrate the effectiveness of the proposed method as compared with the state-of-the-art predictors.

Keywords

, Neural Architecture Search (NAS), Search Space Pruning, Network Architecture, Representation Learning
برای دانلود از شناسه و رمز عبور پرتال پویا استفاده کنید.

@article{paperid:1093420,
author = {Eslami, Saeideh and Monsefi, Reza and محمد اکبری},
title = {Towards Leveraging Structure for Neural Predictor in NAS},
journal = {Journal of Computer and Knowledge Engineering},
year = {2022},
volume = {5},
number = {1},
month = {June},
issn = {2538-5453},
pages = {47--58},
numpages = {11},
keywords = {Neural Architecture Search (NAS); Search Space Pruning; Network Architecture; Representation Learning},
}

[Download]

%0 Journal Article
%T Towards Leveraging Structure for Neural Predictor in NAS
%A Eslami, Saeideh
%A Monsefi, Reza
%A محمد اکبری
%J Journal of Computer and Knowledge Engineering
%@ 2538-5453
%D 2022

[Download]