You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@MariusDrulea Hey, the link for struct Tracked{T} is redirecting to this issue page only. Where is it supposed to link to? Please clarify, in case I am missing something.
Motivation and description
Currently the
scan
method is used to mark the nodes before applying the actual backpropagation in the graph.https://github.com/FluxML/Tracker.jl/blob/master/src/back.jl#L19
We can achieve the same results without employing the this pre-marking of nodes. In this proposal the
back
function shall not use thescan
method, but rather take care of the nodes itself, without a pre-marking.https://github.com/FluxML/Tracker.jl/blob/master/src/back.jl#L74
The functions and files involved are only where the
ref
field is used: https://github.com/FluxML/Tracker.jl/blob/master/src/Tracker.jl#L41.The following structures/functions/algos have to be understood in order to remove
scan
:back.jl
.Note the function back(g::Grads, x::Tracked, Δ) is used for higher-gradients and we should not focus on this use-case in this proposal.
The text was updated successfully, but these errors were encountered: