Search Results for: GlovePie

Magick Systems in Theory and Practice, Installment 2: Word and Gesture as Input Methods in Gaming History

Gestural input is to some extent inherent in the language of magic, as seen in the phrases to "cast a spell" and to "weave an enchantment." The fantasy of weaving magic can be vividly seen on the cover of LucasArt's Loom (1990), in which two hands weave a glowing cat's cradle out of multi-colored light. (While Loom lacked any kind of gestural interface, its unique mode of musical spellcasting and melodic feedback will figure heavily into a later blog entry on multimodal feedback and audio magic.) Gesture is also an integral part of occultist approaches to magic, ranging from the pentagrams and hexagrams traced in the rituals of the Golden Dawn and Thelemic magick, the sigils drawn by Austin Osman Spare and Buddhist kuji-in mudras later adapted in the ninja-themed anime series Naruto.


Closely related to the idea of gestural magic is the verbal component of spell-casting, which appears in colloquial speech as a magic word. From David Copperfield to Harry Potter and the 2010 Sorcerer's Apprentice remake, the image of a wizard waving a wand and intoning a word in order to release a powerful magic spell pervades public consciousness of enchantment. Magic words are a direct extension of the arcane grammars that govern ritual and the combinatorial systems of runic languages discussed in the first installment of this blog series. Voice recognition software, now a standard part of Windows and readily available in more precise programs such as Dragon NaturallySpeaking, could heighten the immersive possibilities of incantation as a spellcasting method.

abracadabra.gifGestural input, in which players use a variety of input devices to trace symbols or fashion other secret signs with hands and body, is also especially relevant from a technological perspective after the 2010 E3 unveiling of Microsoft's Kinect (formerly project Natal) and the Playstation Move. These devices offer new levels of motion sensing technology, in addition to existing alternative input methods in the Wiimote and Wiimotion Plus, the Playstation Eye, and the force-feedback controls offered by the Novint Falcon. Each technology could be leveraged for new methods of casting spells, provided that designers can break out of the prevailing tray-of-icons approach to magic represented in many popular RPG's.

Envisioning the most creative use of new gestural and verbal technologies requires, paradoxically, an enterprise of game archeology, looking back into the history of games with magic in a search for hidden gems of unusual interfaces and input methods. Retro gaming and scholarship of retro games can offer a perspective on magic systems before they hardened into a single mold and became homogenized by marketing and ease of use or implementation.

Magic systems in modern gaming begin with early tabletop role-playing. Gary Gygax, in the "The Dungeons and Dragons Magic System," explains that there are four components to spells in his system: somatic, verbal, material, and psychological (which he reduces to mnemonic). In this article and another entitled "Jack Vance and the D&D Game," Gygax also refers to this system as "Vancian" because of Jack Vance's "Dying Earth" fantasy book series, in which magicians memorize a limited number of spells and trigger them through a gesture and word, after which the spells are promptly forgotten and must be re-memorized. The verbal component takes predominance in D & D because tabletop role-playing games are played verbally, through conversational exchange between players and DM. Other elements seem to be thought of by Gygax as present for the purpose of game balance, as when he implies that the gestural system ensures that a magician couldn't cast a spell if he were wrapped in webs or that a magic mouth couldn't be used to cast spells by proxy.

dungeonmaster.jpgThe verbal component of magic is a powerful fantasy and a metaphor for the way that language can shape the human understanding of reality. When a stage magician speaks "abracadabra" and waves a wand in order to conjure a rabbit from a hat, the magician is tapping into a primal fantasy of ultimate power: we have only to speak, and our words will have an immediate physical effect. This belief in the mystical power of language is also the impulse behind the elaborate meditations on letter and word that constitute the esoteric system of the kabbalah.

The problem with the verbal component of magic as enacted within tabletop role-playing is that this component is not performative, or rather it is performative only one step removed from gameplay. The player says "I am casting a spell," and it is understood that the player-character is reciting a complex incantation that was memorized from a spellbook. However, the player never utters the incantation (or makes the gesture or handles the ingredients). He only declares that he is going to do so: a speech act that is accepted or rejected by the Dungeon Master and other players if it conforms to the game's rules. (A later tabletop role-playing game, Ars Magica (1987), actually does require players to master a Latinate grammar in order to cast spells, though this magical grammar appears in tabletop games only after similar systems appear in computer RPG's like Dungeon Master).

Missing from tabletop RPG's is the element of simulation provided by computers, the feeling of performing magic within a multimedia environment designed to reinforce that fantasy rather than merely announcing that one is casting a spell and relying on the shared imagination of one's comrades. Early attempts at simulating magic in computer games relied heavily on a verbal component, but of a different kind derived from player interaction with a text parser.

256px-Enchanter_game_box_cover.jpgBy introducing the text parser with its underlying grammar, game designers begin to address another problem with the Vancian system, in which magic is rote: a litany, a pre-memorized recitation or a single word. If magicians study for years, and if their magic is an arcane art known only by a few, then where is the skill or art of memorizing a pre-defined speech? Those who have mastered an art or a science understand its underlying principles well enough to be able to apply them spontaneously. Fluency in a language entails a mastery of its vocabulary and underlying grammar such that the speaker can produce new utterances rather than merely copying those heard before. Indeed, the generative nature of grammar allows speakers to express ideas never envisioned by those who originally developed and codified the language. If magic is a grammar, then mastery of that grammar is displayed through the ability to adapt its structures to novel situations. The text parsers of interactive fiction were in some ways well adapted toward inviting such grammatical interactions; indeed, an interactive fiction is in part an object-oriented simulation explorable through exchanges governed by the rules of grammar. The text parser of Colossal Cave Adventure accepts the famed magic word XYZZY, thereby allowing players to experience the verbal component of magic as a simulation, albeit a simple one.

 Infocom's Spellbreaker trilogy, consisting of Enchanter, Sorcerer, and Spellbreaker, entails a magical grammar, in which spells are verbs that take direct objects, allowing players to type "frotz stone" to make a stone glow or "blorb chest" to open this locked container. Frotz and Blorb are names for, respectively, an interactive fiction interpreter and a wrapper for multimedia elements. While amusing, this application of the names of in-game spells to the programming and technology outside of and supporting the game also suggests a powerful relationship between programming and the verbal grammars of magic. Simply put, programmers and magicians both master a grammar in order to make things happen. Both hackers and wizards achieve this alteration of reality, whether simulated or real, through an arcane set of words and phrases known as programs or spells. When properly configured, a program causes amazing events to occur (calculates our taxes, launches an anti-missile defense system, summons a longed-for package from to our doorstep), just as magicians can throw fireballs and (when very powerful) grant wishes. However, when the programmer makes the slightest error in the placement of a semicolon or case sensitivity, the program won't compile, much as a spell fizzles.

In the case of the Spellbreaker trilogy, the games' designers consciously drew upon these parallels between magic and programming As Wikipedia explains "There are references scattered throughout Enchanter's documentation and gameplay comparing the use of spells by mages to the use of command line interfaces by programmers, and comparing mages to hackers in general. Many of the spell names, such as FROTZ and GNUSTO, are taken from MIT hacker slang of the time" (Wikipedia "Enchanter" ). There is a strong element of meta-magic and self-referentiality in this spell system, since the magic used to attain supernatural result within the game is patterned on the very methods used to create the game itself. Other text-based magic systems include the early Ultima games, such as Ultima IV , in which players type the names of spells into text parsers. Players also control a text-based inventory of spell elements, called reagents, which they mix in the correction proportion in order to alchemically prepare a spell.

Though these text-based magic systems are fascinating, they leave out a sense of visual interaction and movement.  When we imagine a magician casting a spell, we see him waving his hands in complex patterns while bolts of electricity arc from his hands. It is here that the intersection of grammar and gesture occurs. While Black and White (2001) may be the first gestural interface used for magic, the designers of The Summoning (1993) attempted to simulate gestural spellcasting through a set of hand gestures that could be combined to store spells. These hand gestures resemble the finger alphabet of American Sign Language, as well as the magical gestures made by Aleister Crowley or the kuji-in.

aleister-crowleygestures.jpg This form of spell-casting involves an implicit pun on the two meanings of "spell" as in "incantation with magical force" and "to form a word out of letters." If a grimoire is etymologically and conceptually linked to a magical grammar, then it makes sense that spells themselves consist of an alphabet, rendered gesturally to emphasize its performativity and multi-modality. Players of The Summoning arrange graphical representations of hand gestures onto a tray, much as players of Ultima Underworld concatenate runes. Indeed, The Summoning combines a system of hand gestures with a set of collectable rune stones, partially in acknowledgement that the possibility of actual physical hand-gestures on the part of the user was technologically out of reach in 1993 (in part due to the imprecision of alternative controllers like Nintendo's 1989 Powerglove).

summoninggestures2.jpg summoninggestures.jpgThe first true gestural interfaces for spell-casting are mouse-driven and operate around the metaphors of painting and drawing. Such elements are common to occultist practice, as in the rituals of the pentagram and hexagram in the Golden Dawn and Thelemic magic. In these rituals, magicians use ritual implements like wands and daggers to trace five and six-pointed stars whose points have elemental or planetary correspondences. The starting and ending points of the geometrical figures determine whether the sign banishes or invokes, as well as what elements are specifically called up or driven away.

pentagramritual.gifSimilarly, players trace such geometric forms, including pentagrams, using the hand that constitutes the HUD-less interface of Black and White (2001), in order to perform miracles. Black and White featured a patch allowing use of the P5 Virtual Reality glove, which can be used to control the computer's mouse as well many games through GlovePie, freeware created by Carl Kenner. The use of a hand to control a hand-shaped cursor in a game without a HUD added to the sense of immersion in spell-casting by removing any barrier between player and game.

blackandwhitepentagram.jpgDrawing as a spellcasting mechanic can also potentially be used in any game with sigils, although this element is often removed from gameplay and used as mere decoration. Sigils, illustrated in grimoires such as The Lesser Key of Solomon the King, are elaborate signs or seals, often inscribed with cryptic geometric designs and the names of angels and demons. Grimoires teach aspiring magicians to draw sigils on the ground in order to ward off or contain spirits. Conjurers could also inscribe sigils on amulets in order to create talismans consecrated to spirits and elemental forces.

solomonsigil.jpgSigils and the grimoires containing them have played a role in the story and art design of many magic systems, including Vagrant Story (2000) and World of Warcraft: Wrath of the Lich King. Common artistic practice involves arcane symbols that glow and spin beneath the caster during spell-casting, as seen in Neverwinter Nights and World of Warcraft. Voices chanting ominous symbols often appear during this casting phase, but players are rarely able to interact with them. Chanting and sigil-drawing are cosmetic features designed to reinforce an enchantment mood but divorced from player interaction; in all too many RPG's, voice and drawing are neither input methods affecting the spell that is cast nor feedback mechanisms to reinforce how it is cast. The removal of sigils from input or feedback squanders their potential as gameplay mechanicisms and runs directly contrary to their role in magical lore, in which magicians learn to draw sigils for direct practical ends.

For example, the process of "sigilization" formulated by visual artist and magician Austin Osman Spare entailed an "alphabet of desire" designed to encode and give magical force to the magician's deepest longings. Spare's dual identity as a painter and a magician highlights a potential relationship between magic and the visual arts that could be capitalized on with any PC or console that has drawing capabilities, including tablet PC's, the Nintendo DS or 3DS, and the Wii. For example, drawing and painting become a game mechanic and visual trope in the magnificent Okami, in which the player uses a magical calligraphy brush to alter reality within a world that constitutes a living Japanese painting. okamipen.jpgUsing one's magic pen to fill in the gaps in a bridge can mend the wood to allow passage, just as painting the barren branches of a tree can cause it to blossom with fruit. Dawn of Sorrow, an iteration of Castlevania for the Nintendo DS, also requires players to inscribe seals using the DS stylus in order to defeat bosses, which otherwise regain strength and resurrect themselves. dawnofsorrowseal.jpg

Magic as a hybrid of writing and painting opens many possibilities of multimodal input and feedback with cosmological significance, seen most vividly in the use of symbolic color to represent schools and varieties of magic. These subjects and others will be discussed in the third installment of this blog series next Wednesday.

Posted in Guest Bloggers | Tagged , , , , , , , , , , , , , , , , , | 13 Comments