How to implement the addtion of grad in the backback-propagating,how to add extra term (which is the gradient to middle net layer output) to the network

[mxnetwqs]

@mxnetwqs

keep touch for bettter forward!

this is my new progress! can u give me some advice … , MAY THE FORCE BE WITH YOU!

How to make custome operator as middle layer using symbol not gluon

i am a chinese in Beijing, the website below is more info about my question: https://discuss.gluon.ai/t/topic/7499 1 i need to realize a function which add the extra term as part of ReLU layer’s output’s gradient to the original back-propagating, what that mean is that i want to change the original network back-propagating, add something to effect the normal parameter iteration. i ever try the multi-mask idea, just write two loss-function based on same layer ReLU, outcome is not good, so now i…