Using a threaded analyzer

If libboost_thread is installed, the installation process will build the program threaded_analyzer. This program behaves like analyzer, and has almost the same options.

The program threaded_analyzer launches each processor in a separate thread, so while one sentece is being parsed, the next is being tagged, and the following one is running through the morphological analyzer. In this way, the multi-core capabilities of the host are better exploited and the analyzer runs faster.

Although it is intended mainly as an example for developers wanting to build their own threaded applications, this program can also be used to analyze texts, in the same way than analyzer.

Nevertheless, notice that this example program does not include modules that are not token- or sentence-oriented, namely, language identification and coreference resolution.



Lluís Padró 2013-09-09