To Neglect the Root and Attend to the Tip