This commit is contained in:
marcinj 2016-06-14 01:03:07 +02:00
parent aa5c13931d
commit 4f0d8244ea

View File

@ -116,7 +116,7 @@
"\n",
"Differences in comparing with the model from Bahdanau:\n",
"* different place for bias.\n",
"* The reset $r_i$ and update $u_i$ vectors are computed together (there are concatenated).\n",
"* The reset $r_i$ and update $u_i$ vectors are computed together (they are concatenated).\n",
"\n",
"$$\n",
"\\renewcommand{\\ora}[1]{\\overrightarrow{#1}}\n",
@ -144,7 +144,7 @@
"\n",
"The backward pass is similar. The pass over the words is reversed, but the implementation stays the same.\n",
"\n",
"For every word, the $ora{h}_i$ and $\\ola{h}_i$ are concatenated into $h_i$:\n",
"For every word, the $\\ora{h}_i$ and $\\ola{h}_i$ are concatenated into $h_i$:\n",
"\n",
"$$\n",
"h_i = \\left[\n",