GLTR

GLTR (Giant Language model Test Room) is a forensic tool for detecting automatically generated text from large language models.

It works by inspecting the 'visual footprint' of the said text and helping predict if an automatic system generated the content.

GLTR uses the same models responsible for generating the text to identify if the text has been artificially produced.

It primarily functions with the GPT-2 117M language model from OpenAI, employing large language models to analyze textual input and evaluate what GPT-2 might have predicted at each position.

The tool provides a colored overlay mask to illustrate the likelihood of each word being used under the model.

The colors range from green for most likely (top 10 words) to purple for least likely words.

The tool consists of histograms to aggregate the information related to the whole text, indicating the ratio between the top predicted word and subsequent word, and demonstrating the distribution over the uncertainties of the predictions.

While GLTR is efficient, its revelations are somewhat alarming, highlighting the ease with which AI could produce forged text, thereby underscoring the need for more robust, discerning detection mechanisms.