Using Statistics to Understand Language – from stepya.com

Original Post from stepya.com.

When learning a new language students often spend many hours trying to learn and decipher meanings of sentences by understanding grammar and the structure of the sentence. What is the subject of the sentence? What is the verb? What objects is the sentence talking about? However, Stanford’s Natural Language Processing Group is using statistics and probability to help computers understand sentences and human language. After getting enough sentences and breaking them down manually, a probabilistic parser will try to use that knowledge to produce a “most likely analysis” of the new sentence.
Try it out Stanford’s statistical parser yourself here!

Probabilistic parsers use knowledge of language gained from hand-parsed sentences to try to produce the most likely analysis of new sentences. These statistical parsers still make some mistakes, but commonly work rather well.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.