MetaNeural Network
Taken from medium.com/@jasikpark
A deep neural network should be trained to generate neural networks based on the string sequence submitted to it. (Allowing different types) This neural network should learn how to combine neural networks akin to sexual reproduction and learn how to improve a neural network based on the neural network and the supervised learning things. It will learn through reinforcement gradient backpropagation: if it does something right, it back propagates on that output. Over time, the reward network becomes more discerning and rewards less often for better performance. The neural network will also learn how to optimize networks by reducing lines and edges and consolidating neurons. Also, it should have one input for each character for text input: i.e. a scanning paragraph reading. To generate the neural network, it might have a similar output, with a prediction of each character for each output. hopefully this can generalize to larger inputs and outputs or simply serialized. LTSM!!! That’s what can be used! (Basically we create a ltsm network with a larger input array for text).
a. a network that removes nodes and edges and consolidates them into simpler functions.
b. a network that generates a network based on the string that is input
c. a network that can combine two neural networks to form a new, possibly better, neural network
d. a neural network that learns how to optimize similar to back propagation but better?
e. a reward network that determines whether a generated output is good or bad.
TODO: learn about generative adversarial networks: they seem like this ^^^^