Dynamic Cell Structure via Recursive-Recurrent Neural Networks

Xin Qian*, Matthew Kennedy, Diego Klabjan

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution


In a recurrent setting, conventional approaches to neural architecture search find and fix a general model for all data samples and time steps. We propose a novel algorithm that can dynamically search for the structure of cells in a recurrent neural network model. Based on a combination of recurrent and recursive neural networks, our algorithm is able to construct customized cell structures for each data sample and time step, leading to an efficient sample-level architecture search model. Experiments on three common datasets show that the algorithm discovers high-performance cell architectures and achieves better performance compared to the GRU structure for language modelling with the same network capacity.

Original languageEnglish (US)
Title of host publicationProceedings - 2022 IEEE International Conference on Big Data, Big Data 2022
EditorsShusaku Tsumoto, Yukio Ohsawa, Lei Chen, Dirk Van den Poel, Xiaohua Hu, Yoichi Motomura, Takuya Takagi, Lingfei Wu, Ying Xie, Akihiro Abe, Vijay Raghavan
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages14
ISBN (Electronic)9781665480451
StatePublished - 2022
Event2022 IEEE International Conference on Big Data, Big Data 2022 - Osaka, Japan
Duration: Dec 17 2022Dec 20 2022

Publication series

NameProceedings - 2022 IEEE International Conference on Big Data, Big Data 2022


Conference2022 IEEE International Conference on Big Data, Big Data 2022


  • Data-dependent and Time-varying Algorithm
  • Language Modelling
  • Recurrent Neural Networks
  • Recursive Neural Networks

ASJC Scopus subject areas

  • Modeling and Simulation
  • Computer Networks and Communications
  • Information Systems
  • Information Systems and Management
  • Safety, Risk, Reliability and Quality
  • Control and Optimization


Dive into the research topics of 'Dynamic Cell Structure via Recursive-Recurrent Neural Networks'. Together they form a unique fingerprint.

Cite this