Paper published: Complexity measurement of natural and artificial languages

We compared entropy for texts written in natural languages (English, Spanish) and artificial languages (computer software) based on a simple expression for the entropy as a function of message length and specific word diversity. Code text written in artificial languages showed higher entropy than text of similar length expressed in natural languages. Spanish texts exhibit more symbolic diversity than English ones. Results showed that algorithms based on complexity measures differentiate artificial from natural languages, and that text analysis based on complexity measures allows the unveiling of important aspects of their nature. We propose specific expressions to examine entropy related aspects of tests and estimate the values of entropy, emergence, self-organization, and complexity based on specific diversity and message length.


Complexity measurement of natural and artificial languages
Gerardo Febres, Klaus Jaffé and Carlos Gershenson
Complexity, Early View
http://dx.doi.org/10.1002/cplx.21529

Comments

Post a Comment

Popular posts from this blog

The Past, Present and Future of Cybernetics and Systems Research

Summary of "The Past, Present and Future of Cybernetics and Systems Research" Symposium M at  European Meetings on Cybernetics and Systems Research (EMCSR), Vienna, Austria, April 12, 2012. Organizer: Carlos Gershenson This guided reflection on the challenges and opportunities of cybernetics and systems research (CSR) included initial interventions by panelists Peter Erdi, Helena Knyazeva, Stefan Thurner, Peter Csermely, and Alexander Lazlo. Afterwards, the floor was opened to interventions from the general public and further interventions by panelists. Commentaries were made from a broad variety of perspectives, but several general ideas can be distilled from the discussion. CSR have strongly influenced all scientific disciplines. As an example, the term "system" is used commonly in daily language. One of the breakthroughs of CSR lies in the search of commonalities across disciplines. Even when this was achieved to a certain degree, there is still a lack of...
Read more

New Book: Complexity: 5 Questions

Image
This volume consists of short, interview-style contributions by leading figures in the field of complexity, based on five questions. The answers trace their personal experience and expose their views on the definition, aspects, problems and future of complexity. The aim of the book is to bring together the opinions of researchers with different backgrounds on the emerging study of complex systems. In this way, we will see similarities and differences, agreements and debates among the approaches of different schools. Contributors: Peter M. Allen, Philip W. Anderson, W. Brian Arthur, Yaneer Bar-Yam, Eric Bonabeau, Paul Cilliers, Jim Crutchfield, Bruce Edmonds, Nigel Gilbert, Hermann Haken, Francis Heylighen, Bernardo A. Huberman, Stuart A. Kauffman, Seth Lloyd, Gottfried Mayer-Kress, Melanie Mitchell, Edgar Morin, Mark Newman, Grégoire Nicolis, Jordan B. Pollack, Peter Schuster, Ricard V. Solé, Tamás Vicsek, Stephen Wolfram. Get it at Amazon.com Check out more books from the 5 Questions s...
Read more

Sites that revolutionized the Web

I compiled a list of the websites that have changed the way information is produced, handled, or distributed over the Internet. Many of these sites have something in common: they enable users (human or software) to judge the relevance of their content, to provide "interesting" information to others. This has been called distributed cognition or collective intelligence: like diligent ants, the small contributions of many people or sites lead to great achievements and sources of information. Google . The most effective search engine for several years now. It judges the relevance of a webpage (its PageRank) by the PageRank of webpages that link to it. Thus, if many webpages link to a certain site, this should be interesting. And even more if those webpages are interesting themselves. Google has become an empire of free web-based utilities (in some cases buying other companies): GMail . One of the most flexible free web-based mail providers , it gives users almost 3Gb of disk sp...
Read more