?url_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&rft.title=Building+large-scale+hierarchical+models+of+the+world+with+binary+sparse+distributed+representations&rft.creator=Rachkovskij%2C+Dmitri+A.&rft.creator=Kussul%2C+Ernst+M.&rft.subject=Artificial+Intelligence&rft.subject=Neural+Nets&rft.description=Many+researchers+agree+on+the+basic+architecture+of+the+%22world+model%22+where+knowledge+about+the+world+required+for+organization+of+agent's+intelligent+behavior+is+represented.+However%2C+most+proposals+on+possible+implementation+of+such+a+model+are+far+from+being+plausible+both+from+computational+and+neurobiological+points+of+view.+%0AImplementation+ideas+based+on+distributed+connectionist+representations+offer+a+huge+information+capacity%2C+flexibility+of+similarity+representation%2C+and+possibility+to+use+a+distributed+neural+network+memory.+However%2C+for+a+long+time+distributed+representations+suffered+from+the+%22superposition+catastrophe%22.+Local+representations+are+vivid%2C+pictorial+and+easily+interpretable%2C+allow+for+an+easy+manual+construction+of+hierarchical+structures+and+an+economical+computer+simulation+of+toy+tasks.+The+problems+of+local+representations+show+up+with+scaling+to+the+real+world+models%2C+and+it+is+unclear+how+to+solve+them+under+reasonable+requirements+imposed+on+memory+size+and+speed.+%0AWe+discuss+the+architecture+of+Associative-Projective+Neural+Networks+(APNNs)+that+is+based+on+binary+sparse+distributed+representations+of+fixed+dimensionality+for+items+of+various+complexity+and+generality%2C+and+provides+a+promise+for+scaling+up+to+the+full-sized+model+of+the+real+world.+An+on-the-fly+binding+procedure+proposed+for+APNNs+overcomes+the+superposition+catastrophe%2C+permitting+representation+of++the+order+and+grouping+of+structure+components.+These+representations+allow+a+simple+estimation+of+structures'+similarity%2C+as+well+as+finding+various+kinds+of+associations+based+on+their+context-dependent+similarity.+Structured+distributed+auto-associative+neural+network+is+used+as+long-term+memory%2C+wherein+representations+of+items+organized+into+part-whole+(compositional)+and+concept+(generalization)+hierarchies+are+built.+Examples+of+schematic+APNN+architectures+and+processes+for+recognition%2C+prediction%2C+reaction%2C+analogical+reasoning%2C+and+other+tasks+required+for+functioning+of+an+intelligent+system%2C+as+well+as+APNN+implementations%2C+are+considered.+%0A&rft.date=2000-11&rft.type=Other&rft.type=NonPeerReviewed&rft.format=application%2Fpdf&rft.identifier=http%3A%2F%2Fcogprints.org%2F1287%2F3%2FBbsapnn1.pdf&rft.identifier=++Rachkovskij%2C+Dmitri+A.+and+Kussul%2C+Ernst+M.++(2000)+Building+large-scale+hierarchical+models+of+the+world+with+binary+sparse+distributed+representations.+++++(Unpublished)++&rft.relation=http%3A%2F%2Fcogprints.org%2F1287%2F