• Introduction
• Art and the Brain
• New Musicology
• New Media, Multimedia and Computational Narratology
• Creative Projects
• Some Related Writings
• Some Other Links

This page contains links to various projects concerned with the arts and consciousness, especially new media, music and multimedia, including research papers, essays, editorial work, and creative projects, such as poetry and librettos. Here is a link to a short arts oriented CV.

Art and the Brain is a series of special issues of the Journal of Consciousness Studies, which are also published as books, by Imprint Academic.

• Art and the Brain, III, edited by Joseph Goguen and Erik Myin, Imprint Academic, May 2004, ISBN 0-907-84598-3; also, special issue of Journal of Consciousness Studies, vol. 11, no. 3/4, 2004, with a special focus on music. The Introduction by Joseph Goguen and Erik Myin, pages 5-8, and the Call for Papers are available, as is Musical Qualia, Context, Time, and Emotion, pages 117-147 of the same volume, a paper on the philosophy and cognitive science of music; a postscript version is also available.
   
• Art and the Brain, II, edited by Joseph Goguen and Eric Myin, Imprint Academic, October 2000, ISBN 0-907-84512-6; also, special issue of Journal of Consciousness Studies, volume 7, no. 8/9, 2000. Joseph Goguen's introduction, pages 7-15, What is Art?, is available, as is his review of Visual Space Perception: A Primer, by Maurice Hershenson (MIT 1998), on pages 157-160 of the same volume.
   
• Art and the Brain, ed. Joseph Goguen, Imprint Academic, October 1999, ISBN 0-907-84545-2, and Journal of Consciousness Studies, volume 6, no. 6/7, June/July 1999. This is the first volume of the series; its Editorial Introduction, pages 5-14, is available.

• [New] Slides for lecture in Bremen, 10 October 2005, Improvisation, Nonlinear Dynamics and Qualia: Experiencing music and poetry, preceding a concert by Ryoko Goguen, Jazz, Klassik, Pop, mit japanischer Aesthetik. Also available in pdf. Warning: these are big files.
   
• [New] The Qualia Project Homepage: musings on qualia and links to papers about qualia and music.
   
• [New] Rivers of Conscousness: The Nonlinear Dynamics of Free Jazz, by David Borgo and Joseph Goguen, to appear in Jazz Research Yearbook, ed. Larry Fisher, IAJE, 2005. Proceedings of conference in Long Beach CA, 5-8 January 2004. It is in MS Word.
   
• [New] Time, Structure and Emotion in Music, by Joseph Goguen and Ryoko Goguen, Japanese translation by Sumi Adachi to appear in book of University Lectures at Keio University in 2003-2004 academic year; there is also a postscript English version.
   
• Musical Qualia, Context, Time, and Emotion, in Journal of Consciousness Studies 11, 3/4, pages 117-147, 2004; Art and the Brain, Part III . This is a paper on the philosophy and cognitive science of music, using Husserl's phenomenology of time consciousness, hierarchical information theory, and dynamical systems theory. A postscript version is also available.
   
• Extended abstract of Sync or Swarm: Group Dynamics in Musical Free Improvisation, by David Borgo and Joseph Goguen, and shorter abstract, in Proceedings, Conference on Interdisciplinary Musicology, Dept. Musicology, University of Graz, 2004; the short abstract appears on pages 52-53, and the extended abstract in the attached CD. Held in Graz, Austria, 15-18 April 2004. Sorry, both are in MS Word.
   
• Abstract of lecture/demonstration, Qualia in Music, by Joseph and Ryoko Goguen, University of Vienna, Depts. Computer Science and Art, 20 March 2003.
   
• Abstract of lecture/demonstration, Metaphor, blending and Information in Music, by Joseph and Ryoko Goguen, University of Music and Dramatic Arts in Vienna, 25 March 2003, Dept. of Music.
   
• Structure and Values in Music, a brief description of a project in its early stages, on implicit values and formal structure in music, including improvised music. For more detail on certain aspects, see Musical Qualia, Context, Time, and Emotion, in Journal of Consciousness Studies 11, 3/4, pages 117-147, 2004; Art and the Brain, Part III . A postscript version is also available.
   
• Abstract of concert/lecture, Improvisation, Situatedness and Emotion in Music, by Ryoko and Joseph Goguen, Keio University, Faculty of Literature, Tokyo, 9 December 2003.

In collaboration with Fox Harrell, Shlomo Dubnov, and Lev Manovich, we are developing new technology and theory for generative multimedia events/objects, with some emphasis on those having narrative structure; see also the Computatinal Narratology page. Potential applications include adaptive multimedia information kiosks, "polypoems" that are different each time they are read (as well as other polymorphic objects), performance pieces, generative greeting cards, etc. The following works are relevant to this effort:

• [New] Information on our performance, The Griot Sings Haibun on 28 October, celebrating the opening of the California Institute for Tececommunications and Information Technology building, in cooperation with the UCSD Center for Research in Computing and the Arts. The performers were: Bertram Turetzky, contrabass; David Borgo, saxophones & flutes; Ryoko Amadee Goguen, piano; Joseph Goguen, direction, poetry performance, and polypoem source; D. Fox Harrell, Griot implementation and polypoem execution. Links to Program for the whole concert and Photo of participants in concert (plus some family).
   
• [Newly Re-Revised, 13 May 06] Style as Choice of Blending Principles, by Joseph Goguen and Fox Harrell, to appear in The Structure of Style: Algorithmic Approaches to Understanding Manner and Meaning, ed. by Shlomo Argamon, Kevin Burns, and Shlomo Dubnov, Springer 2006; postscript version also available. An earlier version appeared in Style and Meaning in Language, Art, Music and Design, ed. by Shlomo Argamon, Shlomo Dubnov and Julie Jupp; Proceedings of a Symposium at 2004 AAAI Fall Symposium Series, Technical Report FS-04-07, AAAI Press, 2004, pages 49 to 56 (Washington DC, October 21-24); there are also a postscript version, and powerpoint slides for the lecture. This paper proposes a new approach to style based on the principles for blending that works employ; it also includes an implementation approach to syntax based on structural blending and cognitive grammar, and proposes a reconsideration and generalization of optimality principles for blending. A poetry generation system based on this ideas is also explained, and some output is included.
   
• Foundations for Active Multimedia Narrative: Semiotic spaces and structural blending, with Fox Harrell. To appear in Interaction Studies: Social Behaviour and Communication in Biological and Artificial Systems. A postscript version is also available.
   
• Steps towards a Design Theory for Virtual Worlds, by Joseph Goguen. In Developing Future Interactive Systems, edited by Maribel Sanchez-Segura, Idea Group, 2005, pages 116-152; an html version is also available.
   
• Semiotic Morphisms, Representations, and Blending for User Interface Design, by Joseph Goguen, in Proceedings of AMAST Workshop on Algebraic Methods in Language Processing (Verona, Italy, 25 - 27 August 2003), pages 1-15. This paper extends algebraic semiotics to handle interaction by using shows how hidden algebra; some examples are given in detail. A postscript version is also available.
   
• CSE 87C, an undergraduate seminar on Computational Narratology. The following is its synopsis: Computers are significant in contemporary storytelling, as subjects in cyberpunk, and as a platform for narrative video games. This seminar explores these and other topics, such as computer gaming, semiotics, narratology, hypertext, metaphor, values, implementation technology, experimental novels, and conceptual blending. Taught Spring 2003, and again Spring 2004.
   
• Information Visualization and Semiotic Morphisms, by Joseph Goguen and D. Fox Harrell. An informal introduction to the notion of semiotic morphism from the field of algebraic semiotics, showing how information visualization, in both analysis and design, can benefit from a viewpoint based on structure-preserving morphisms. In Multidisciplinary Approaches to Visual Representations and Interpretations, ed. Grant Malcolm (Elsevier 2004), pages 93-106. This book consists of revised versions of papers from the Second International Conference on Visual Representations and Interpretations, Liverpool UK, 9-12 September 2002. An older html version of the paper is also available, as is a postscript version. Background for this paper can be found in the webnote Semiotic Morphisms and the paper On Notation.
   
• What is Art?, by Joseph Goguen, editorial introduction to Art and the Brain (Part 2), edited by Joseph Goguen and Eric Myin, pages 7-15, Imprint Academic, October 2000, ISBN 0-907-84512-6; also, special issue of Journal of Consciousness Studies, volume 7, no. 8/9, 2000, pages 7-15.
   
• An Introduction to Algebraic Semiotics, with Applications to User Interface Design, by Joseph Goguen, in Computation for Metaphor, Analogy and Agents, edited by Chrystopher Nehaniv, Springer Lecture Notes in Artificial Intelligence, volume 1562, 1999, pages 242-291. This is the original paper on the mathematical foundations of algebraic semiotics, with 3/2-categories, 3/2-colimits, and many examples, especially from user interface design. a postscript version is available, and a preliminary version appeared in Proceedings, Conf. on Computation for Metaphor, Analogy and Agents (Aizu-Wakamatsu, Japan, 6-10 April 1998) pages 54-79, an earlier version of which is Semiotic Morphisms, Technical Report CS97-553, August 1997. A now obsolete extended abstract appeared in Proceedings, Conference on Intelligent Systems: A Semiotic Perspective, Volume II (National Institute of Standards and Technology, Gaithersberg MD, 20-23 Oct 1996) pages 26-31.
   
• Notes on Narrative, by Joseph Goguen. A brief webnote surveying some techniques for the analysis of stories, including summaries of the structural theory of narrative, and techniques for the extraction of value systems from stories. October 2003. Used in CSE 171, CSE 175, CSE 271, and CSE 275.

• [New] Information on our performance, The Griot Sings Haibun on 28 October, celebrating the opening of the California Institute for Tececommunications and Information Technology building, in cooperation with the UCSD Center for Research in Computing and the Arts. The performers were: Bertram Turetzky, contrabass; David Borgo, saxophones & flutes; Ryoko Amadee Goguen, piano; Joseph Goguen, direction, poetry performance, and polypoem source; D. Fox Harrell, Griot implementation and polypoem execution. Links to Program for the whole concert and Photo of participants in concert (plus some family).
   
• November Qualia, poem by Joseph Goguen, in J. Consciousness Studies 12, No. 11, November 2005, page 73.
   
• Stage directions for performance of Ryoko Goguen's Toy Piano Concerto, by Joseph Goguen, 13 August 2004, UCSD Music Library.
   
• Confessions from a Travel-worn Briefcase, poem by Joseph Goguen, in Scale 1, no. 3, pages 12-14, April 2004.
   
• Zero, Connected, Empty, by Ryoko Amadee Goguen, with lyrics by Joseph Goguen, in Recent Trends in Algebraic Development Techniques, Lecture Notes in Computer Science, volume 2755, edited by Martin Wirsing, Dirk Pattinson and Rolf Hennicker, Springer, pages 118-126. Proceedings of 16th Workshop on Algebraic Development Techniques, held in Frauenchiemsee, Germany 24-27 September 2002. A cantata on the history of the philosophy of computer science and mathematics, written for the conference banquet. A short essay, Zero, Connected, Empty: An essay after a cantata, describing its background appears in the same volume, pages 127-128.
   
• Pelican, Fish, Button Suite, selections from an opera in progress, music by Ryoko Amadee Goguen and words by Joseph Goguen, were performed 10 August 2002, in the Geisel Library at UCSD. The website includes the libretto, some explanations, and some photos taken at the performance by Minoru Harada.
   
• Perception, poem by Joseph Goguen, in Journal of Consciousness Studies 9, 2002, page 42.
   
• Lyrics for songs to music by Ryoko Goguen, Information Highway Blues, Yes or No, and Aqua, 2000-2002.

• [New] Ontology, Ontotheology, and Society, submitted for publication; a postscript version is also available. This paper marshalls ideas from philosophy, cognitive science, and sociology, in an attempt to discern some limitations of ontologies in the computer science technical sense. It is a much expanded and revised version of Ontology, Society, and Ontotheology, in Formal Ontology in Information Systems, edited by Achille Varzi and Laure Vieu, IOS Press, pages 95-103, 2004, which is proceedings of Conference on Formal Ontology in Information Systems (FOIS'04); a postscript version is also available, as is the abstract, see also Workshop on Potential of Cognitive Semantics for Ontologies.
   
• Groundlessness, Compassion and Ethics in Management and Design, in Managing as Designing, edited by Richard Boland and Fred Callopy, Stanford University Press, 2004, pages 129-136. Papers from the Managing as Design Workshop, 14-15 June 2002 at the Weatherhead School of Management of Case Western Reserve University. Many interesting papers can be found on the workshop website, including those by Richard Boland (the organizer), Geoffrey Bowker, Yjro Engestrom, Frank Gehry (architect of the building where it was held), Leigh Star, Lucy Suchman, and Ina Wagner.
   
• Review of Intellectual Impostures, by Alan Sokal and Jean Bricmont (second edition), in (London) Times Higher Education Supplement, No. 1, 365, 9 April 2004, page 26.
   
• Semiotics, Compassion and Value-Centered Design, by Joseph Goguen. Keynote lecture, in Proceedings of the Organizational Semiotics Workshop, University of Reading, UK, 11 - 12 July 2003. Slides for the talk and the original abstract are also available.
   
• Signs and Representations: Semiotics for User Interface Design, by Grant Malcolm and Joseph Goguen, in Visual Representations and Interpretations, edited by Ray Paton and Irene Nielson, Springer Wrokshops in Computing, 1998 (proceedings of a workshop held in Liverpool), pages 163-172. An informal introduction to algebraic semiotics with some easy examples, including aspects of operating systems interfaces.
   
• Towards a Social, Ethical Theory of Information, in Social Science Research, Technical Systems and Cooperative Work, edited by Geoffrey Bowker, Les Gasser, Leigh Star and William Turner (Erlbaum, 1997) pages 27-56. A theory of information based on social interaction; this provides the social foundations for algebraic semiotics. A postscript version is also available.
   
• Consciousness Studies, in Encyclopedia of Science and Religion, vol 1, ed. J. Wentzel Vrede van Huyssteen, Macmillan Reference, 2003, pp. 158-164. A postscript version is also available. A brief survey of the emerging field of consciousness studies.
   
• Four Pieces on Error, Truth and Reality, in Software Development and Reality Construction, Christiane Floyd, Heinz Zullighoven, Reinhard Budde and Reinhard Keil-Slawik, editors, Springer Verlag, 1992. Also, Technical Monograph PRG-89, October 1990, Oxford University Computing Lab.

• Homepage of Ryoko Amadee Goguen.
   
• The Qualia Project Homepage.
   
• Website for December 2003 visit to Tokyo.
   
• Website of CSE 87C, undergraduate seminar on Computational Narratology.
   
• Journal of Consciousness Studies.
   
• The Algebraic Semiotics homepage.
   
• Visit the "world-famous" UC San Diego Semiotic Zoo for an astonishing collection of exotic semiotic morphisms, each an example of bad design arising through failure to preserve some relevant structure.
   
• CSE 271: User Interface Design: Social and Technical Issues. A course introducing user interface design, algebraic semiotics, blending, information visualization, and more. See also CSE 171 for an undergraduate version of this material.
   
• CSE 175: Social and Ethical Issues in Information Technology. An exploration of how social and technical issues interact in information technology, with an emphasis on ethical issues. (This is an undergraduate version of CSE 275: Social Aspects of Technology and Science, with less on science and more on ethics.)
   
• Science and Consciousness Review.
   
• Website on blending, with applications to metaphor; work of Gilles Fauconnier, Mark Turner and others, in the area of cognitive linguistics.