Skip to content

Instantly share code, notes, and snippets.

@PtrMan
Last active June 13, 2020 20:48
Show Gist options
  • Select an option

  • Save PtrMan/bef5447e8b8abd9186cc9c290c3349b7 to your computer and use it in GitHub Desktop.

Select an option

Save PtrMan/bef5447e8b8abd9186cc9c290c3349b7 to your computer and use it in GitHub Desktop.
Minipaper FFNNN.md

"Feed forward NAL-based Neural Network".

Introduction

Neural networks are one way to represent any computable function. They can be trained with a training algorithm. Non-bayesian NN's can't handle uncertainty. This paper proposes a way on how to leaverage some of the advantages of NN's to represent and learn a function which also computes uncertainty. This is archived by using functions which use NAL truth values. Advances in deep learning training methods may also get leaveraged in the future, but this is not explored in this work.

Core Idea

  • All values are represented as NAL-Truth Values
  • ring of addition is replaced with revision, ring of multiplication is replaced with deduction (TODO - verify if this makes sense)
  • nonlinearities may get represented as nonlinear functions which get (f,c) as input and return (f,c) as output
  • uncertainty is fed into the inputs - outputs have a uncertainty too
  • input-output mapping of hidden units is learned with a learning/optimization algorithm, for example back propagation or evolutionary algorithms (EA)

TODO< write core ideas up>

Example implementation

TODO< write rust code to demonstrate that it really works for small problems.

References

TODO< reference to bayesian NN networks >
Non-axiomatic reasoning system: Exploring the essence of intelligence
Deep Learning

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment