How Long Does a Word Last?

Read a long sentence one word at a time and watch how much of an early clue survives in a plain RNN versus a gated memory cell.