Neural networks and evolutionary computation have a rich intertwined history. They most commonly appear together when an evolutionary algorithm optimises the parameters and topology of a neural network for reinforcement learning problems, or when a neural network is applied as a surrogate fitness function to aid the evolutionary optimisation of expensive fitness functions. In this paper we take a different approach, asking the question of whether a neural network can be used to provide a mutation distribution for an evolutionary algorithm, and what advantages this approach may offer? Two modern neural network models are investigated, a Denoising Autoencoder modified to produce stochastic outputs and the Neural Autoregressive Distribution Estimator. Results show that the neural network approach to learning genotypes is able to solve many difficult discrete problems, such as MaxSat and HIFF, and regularly outperforms other evolutionary techniques.
Deep Recurrent Neural Networks for Sequential Phenotype Prediction in Genomics
Faculty of Applied Sciences of Communications(应用科学通信学院);UMTS Project Partners bv.(UMTS项目伙伴有限公司);Farnoud Data Communication Company(法努德数据通信公司);Mobile Communication Company of Iran (MCI)(伊朗移动通信公司(MCI))
Protein pathways as a catalyst to directed evolution of the topology of artificial neural networks
Institute of Evolutionary Biology (CSIC-Universitat Pompeu Fabra)(进化生物学研究所(西班牙高等科研理事会-庞培法布拉大学));Technical University of Crete(克里特技术大学);ATHENA, Industrial Systems Institute(雅典娜工业系统研究所);University of Turin(都灵大学);ISI Foundation(ISI基金会);Telefónica Innovación Digital(西班牙电信数字创新部)
Plan, Attend, Generate: Character-level Neural Machine Translation with Planning in the Decoder
University of Montreal(蒙特利尔大学);Microsoft Maluuba(微软 Maluuba)
我们研究的规划机制集成到一个编码器-解码器架构与字符级机器翻译的显式对齐。我们开发了一个模型,在计算源序列和目标序列之间的比对时提前计划,构建拟议的未来比对矩阵和控制是否遵循或重新计算计划的承诺向量。这一机制的灵感来自于策略性的专注读者和作者(StrategicAttentive Reader and Writer,缩写为ESTA)模型。我们提出的模型是端到端可训练的,具有完全可区分的操作。我们证明了它在WMT'15语料库上的三个字符级解码器神经机器翻译上的性能优于强基线。我们的分析表明,我们的模型可以计算定性直观的路线,并实现了更少的参数优越的性能。