ann/README at master · abhirathb/ann · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
Artificial Neural Network to study HMC


PRE-REQUISITE:
==============
numpy
scipy
python2.7


RUNNING:
========
python ann.py < input file path >


OPTIONS:
========

an input file with the following options needs to be specificed to run the program

input_vector:
-------------
path to the file containint input unit values for each subject

output_vector:
-------------
path to the expected output file

num_hidden_units:
-----------------
number of hidden units to be used

hidden_weights:
---------------
can either supply the path to a file which can be loaded directly as a weights file for hidden units or provide variance of a gaussian from which the weights will be drawn.

hidden_biases:
-------------
same as hidden_weights

output_weights:
---------------
same as hidden_weights

output_biases:
--------------
same as hidden_weights

initialise:
----------
whether to run the initialise routine: possible values: "true" or "false"

initialise_steps:
----------------
number of iterations in the initialisation routine

initialise_eps:
--------------
step-size (epsilon) for the initialise routine

initialize_verbose:
-------------------
whether or not to print iteration-wise state of the neural network. [ not implemented in current version ]

descent:
-------
what descent algorithm to use "log"(for log-like) or "error"(for RMSD)

hmc:
----
whether to call the HMC routine

hmc_steps:
---------
number of steps to run HMC for.

hmc_eps:
-------
step-size(epsilon) value for HMC steps

hmc_verbose:
-----------
whether or not to print iteration-wise state of the neural network. [ not implemented in current version ]

log_on:
-------
whether to include log-like contribution in the hamiltonian for HMC: Possible values being "true" or "false"

prior_on:
--------
whether to include prior contribution in the hamiltonian for HMC: Possible values being "true" or "false"

precision:
----------
machine precision for all values: Possible values are "single" or "double"

ard_prior_scale:
---------------
scale parameter for the ARD prior of the hidden layer

ard_prior_shape:
---------------
shape parameter for the ARD prior of the hidden layer

ard_init:
---------------
initial value of the  ARD prior of the hidden layer. [Implemented to imitate Andy's code ]