Hi, I would like to ask about the dynamic routing implementation in the MIND model (this logic). According to the paper, the routing logit bij will get initialised for every batch training/inference. But in the code, I only saw it got initialised in the build() phase, which means it only initialised once. Below is an image that illustrates the MIND routing logit, and here is the link to the paper (link). Looking forward to hearing from you soon, thank you in advance!
Hi, I would like to ask about the dynamic routing implementation in the MIND model (this logic). According to the paper, the routing logit bij will get initialised for every batch training/inference. But in the code, I only saw it got initialised in the
build()phase, which means it only initialised once. Below is an image that illustrates the MIND routing logit, and here is the link to the paper (link). Looking forward to hearing from you soon, thank you in advance!