Applications

You must think how this lexical analysis has been used for developing NLP applications. So, here we have listed some of the NLP applications which uses lexical analysis concepts:

• Lexical analysis such as sentence tokenization and stop word identification is often used in preprocessing.
• Lexical analysis also used to develop a POS tagger. A POS tagger is a tool that generates POS tags for a stream of text.