?url_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&rft.title=Frequency+Value+Grammar+and+Information+Theory&rft.creator=Stepak%2C+Asa+M&rft.subject=Neurolinguistics&rft.subject=Statistical+Models&rft.subject=Language&rft.subject=Computational+Linguistics&rft.subject=Psycholinguistics&rft.subject=Cognitive+Psychology&rft.subject=Syntax&rft.description=I+previously+laid+the+groundwork+for+Frequency+Value+Grammar+(FVG)+in+papers+I+submitted+in+the+proceedings+of+the+4th+International+Conference+on+Cognitive+Science+(2003)%2C+Sydney+Australia%2C+and+Corpus+Linguistics+Conference+(2003)%2C+Lancaster%2C+UK.+FVG+is+a+formal+syntax+theoretically+based+in+large+part+on+Information+Theory+principles.+FVG+relies+on+dynamic+physical+principles+external+to+the+corpus+which+shape+and+mould+the+corpus+whereas+generative+grammar+and+other+formal+syntactic+theories+are+based+exclusively+on+patterns+(fractals)+found+occurring+within+the+well-formed+portion+of+the+corpus.+However%2C+FVG+should+not+be+confused+with+Probability+Syntax%2C+(PS)%2C+as+described+by+Manning+(2003).+PS+is+a+corpus+based+approach+that+will+yield+the+probability+distribution+of+possible+syntax+constructions+over+a+fixed+corpus.+PS+makes+no+distinction+between+well+and+ill+formed+sentence+constructions+and+assumes+everything+found+in+the+corpus+is+well+formed.+In+contrast%2C+FVG%E2%80%99s+primary+objective+is+to+distinguish+between+well+and+ill+formed+sentence+constructions+and%2C+in+so+doing%2C+relies+on+corpus+based+parameters+which+determine+sentence+competency.+In+PS%2C+a+syntax+of+high+probability+will+not+necessarily+yield+a+well+formed+sentence.+However%2C+in+FVG%2C+a+syntax+or+sentence+construction+of+high+%E2%80%98frequency+value%E2%80%99+will+yield+a+well-formed+sentence%2C+at+least%2C+95%25+of+the+time+satisfying+most+empirical+standards.+Moreover%2C+in+FVG%2C+a+sentence+construction+of+%E2%80%98high+frequency+value%E2%80%99+could+very+well+be+represented+by+an+underlying+syntactic+construction+of+low+probability+as+determined+by+PS.+The+characteristic+%E2%80%98frequency+values%E2%80%99+calculated+in+FVG+are+not+measures+of+probability+but+rather+are+fundamentally+determined+values+derived+from+exogenous+principles+which+impact+and+determine+corpus+based+parameters+serving+as+an+index+of+sentence+competency.+The+theoretical+framework+of+FVG+has+broad+applications+beyond+that+of+formal+syntax+and+NLP.+In+this+paper%2C+I+will+demonstrate+how+FVG+can+be+used+as+a+model+for+improving+the+upper+bound+calculation+of+entropy+of+written+English.+Generally+speaking%2C+when+a+function+word+precedes+an+open+class+word%2C+the+backward+n-gram+analysis+will+be+homomorphic+with+the+information+source+and+will+result+in+frequency+values+more+representative+of+co-occurrences+in+the+information+source.+%0A%0A&rft.date=2004&rft.type=Preprint&rft.type=NonPeerReviewed&rft.format=application%2Fpdf&rft.identifier=http%3A%2F%2Fcogprints.org%2F3657%2F1%2FzzzFVGINFLICogp.pdf&rft.identifier=++Stepak%2C+Asa+M++(2004)+Frequency+Value+Grammar+and+Information+Theory.++%5BPreprint%5D+++++&rft.relation=http%3A%2F%2Fcogprints.org%2F3657%2F