Image: Detail of sliced visualization of thirty video samples of Downfall remixes. See actual visualization below.

As part of my post doctoral research for The Department of Information Science and Media Studies at the University of Bergen, Norway, I am using cultural analytics techniques to analyze YouTube video remixes.  My research is done in collaboration with the Software Studies Lab at the University of California, San Diego. A big thank you to CRCA at Calit2 for providing a space for daily work during my stays in San Diego.

The following is an excerpt from an upcoming paper titled, “Modular Complexity and Remix: The Collapse of Time and Space into Search,” to be published in the peer review journal AnthroVision, Vol 1.1. A note will posted here, on Remix Theory, announcing when the complete paper is officially published.

The excerpt below is rather extensive for a blog post, but I find it necessary to share it in order to bring together elements discussed in previous posts on Remix and Cultural Analytics (see part 1 on the Charleston Mix, part 2 on Radiohead’s Lotus Flower, and part 3 on the Downfall parodies). The excerpt has been slightly edited to make direct reference to the previous postings, and therefore reads different from the version in the actual text, which makes reference to sections of the research paper where more extensive analysis is introduced. Consequently, in order for this post to make more sense, the previous three entries mentioned above should also be read.

The following excerpt references sliced visualizations of the three cases studies in order to analyze the patterns of remixing videos on YouTube. The reason for sharing part of my publication now is to bring together the observations made in previous postings, and to make evident how cultural analytics enables researchers invested in the digital humanities to examine cultural objects in new ways that were not possible prior to the digitalization process we have been experiencing for the last decades.

———–

To understand how a meme evolves based on the first remixes that a user may find can be evaluated by developing visualizations of the three cases studies that show the editing of the video footage over time.  To accomplish this, I took the frames of thirty videos of each meme and sliced them in order to examine the types of pattern the editing actually takes.  What we find is that with the Charleston Remixes the video footage stays practically the same except for a few remixes in which the footage of Leon and James dancing was used selectively as part of bigger projects.  “Mr. Scruff – Get a Move on | Charleston videoclip” is one of these exceptions, in which the video is re-edited to match the sound (see slice detail below).  Another is “Charleston & Lindy Hop Dance ReMix – iLLiFieD video.mix (Version),” (also see below).

Image: A two column slice visualization of the 29 of 30 remixes (one remix was omitted because the footage is not the same performance.  That video is not relevant to evaluate how the video footage of this meme is left intact).  For a full list of this visualization visit: https://remixtheory.net/remixAnalytics/ and select “Charleston Video Slices.” View large version of this image.

Image: this is a slice visualization of “The Charleston and Lindy Hop Dance Remix.”  When comparing this sliced image to other slices in the two-column visualization above, one can notice the selective process with which footage from the Charleston Style was used.   This video is much longer than the original footage, and has been compacted in order to show how the video was selectively edited.  To view this remix, visit http://www.youtube.com/watch?v=POupa2sW1UI&feature=player_embedded. This video was uploaded to YouTube on May2, 2009. View large version of this image.

Image: this is a slice visualization of “Mr. Scruff remix.”  When comparing the sliced image to the other slices in the two columns visualization above, one can notice how the same footage was edited repeatedly to match the beat and sections of the song. This video is much longer than the original footage, and has been compacted in order to show how the video was selectively edited.   Visit http://www.youtube.com/watch?feature=player_embedded&v=Bx5-itIA0pQ.   This video was uploaded to YouTube on January 10, 2008. View large version of this image.

Image: A two-column visualization of Lotus Flower Remixes.  The original video by Radiohead is on the top-left.  Most of the videos sliced in this sample were uploaded within the first two weeks after the original video was uploaded by Radiohead on February 16, 2011. For a full list of this visualization visit: https://remixtheory.net/remixAnalytics/ and select “Lotus Flower Video Slices.” View large version of this image.

In the Lotus Flower Remixes (See image above) we can note that the editing of the videos is quite diverse; the footage is remixed (heavily edited) to match the beat and the overall feel of the selected songs, with the very first videos.

The Downfall remixes (see figure below) consists of video footage that for the most part has been left intact. What is remixed is the fake translation of Hitler’s rant.  The subtitles for Hitler are sometimes in the middle of the screen, in others at the bottom; buy zyban in china sometimes the typeface is small, and at times large.  But in the end the video footage is left intact and the translations very much obey the rhythm of the original editing.

Image: A two-column visualization of The Downfall Parody remixes.  The original video with no subtitles is on the top-left.  Videos sliced in this sample were uploaded between 2007 and 2011.  At the moment it is not certain whether the 2007 upload was the first because many remixes have been taken down by YouTube.  For a full list of this visualization visit: https://remixtheory.net/remixAnalytics/ and select “Downfall Video Slices.” View large version of this image.

Image: Visualization of Downfall video, with proper English subtitles.  The thin horizontal white bars near the bottom of the frame are the subtitles.  To view this video visit: http://www.youtube.com/watch?v=4bmkUlXp5sk&feature=related.   Some of the remixes present the subtitles in yellow. View large version of this image.

Image: visualization of “Hitler’s Reaction to the new Kiss album,” a video remix in which Hitler rants about the album’s title “Sonic Boom.”  The subtitles (the thin horizontal white bars) in this case move all over the frame.  To view this video visit: http://www.youtube.com/watch?v=nwOLfppXhsk&feature=youtu.be. View large version of this image.

We can note in the three case studies that the approach of remixing is in part defined by the way the original remix or footage was produced.  With the Charleston Remixes, most contributions leave the video footage intact.  No major editing took place until September 2007, that is a year and four months after the first upload.  With the Lotus Flower Remixes, editing of the footage is done from the very beginning, while with the Downfall parodies, it does not place at all.  Why would this be?

Based on the diagrams (see the link “visualization of links” for each case study on the page remixAnalytics) and patterns of editing that I present, we can note that the later videos are in fact responses to previous productions.  In the Charleston Remixes, the video footage is left intact because it is intact in the first remix.  With Lotus Flower, the original footage by Radiohead is heavily edited, which gives remixers the license to immediately manipulate the footage in selective fashion—by omitting some parts of the footage while repeating others to match the selected songs.  With the Downfall remixes, the result is similar to the Charleston Remix: the footage is practically left alone because the meme demands that the basis of the meme be that only the text be remixed; therefore, the only major shift takes place with the placement of translations on the screen: sometimes on the middle, but for the most part at the bottom.  The only other shift we can notice with the subtitles is that they may crossover from one shot to the next based on the emphasis of the content that the remixer wants to make.  But none of the Charleston and Downfall videos are as heavily edited as the Lotus Flower remixes.  It is also worth noting that these are all selective remixes, which means that they all are dependent on a clear reference to the original source.[1]   If such reference is lost, then, the remix withers, and would become either a badly concocted reference, or simply a product on the verge of plagiarism.

One last element that needs to be considered, which apparently affects the production of the memes, as is also argued by a study on YouTube funded by Telefonica [2], and also supported by the research of Jean Burgess and Joshua Green [3] is that due to the viral emphasis on YouTube, online users are most likely to find an already remixed version of a video, and not the original if the remix has enjoyed more views.  The exception to this is Lotus Flower, for which YouTube apparently always offers the original video as part of possible selections, on the first page of all results.  This is likely because given Radiohead’s popularity, their YouTube channel has a large number of views.  For the Charleston, this is not always the case, as the original footage sometimes will not come up with certain video remixes.  For the Downfall meme, it is even more difficult to speculate how videos produced before 2007 affect users who currently search for the meme, because they are likely to find videos that are popular, but not necessarily the newest nor the oldest—but rather the most relevant based on the terms used for the search in relation to the number of views.

[1] For the full definition of the selective remix see “Selective and Reflexive Mashups.”

[2] Meeyoung Cha, Haewoon Kwak, Pablo Rodriguez, Yong-Yeol Ahn, and Sue Moon, “I Tube, You Tube, Everybody Tubes: Analyzing the World’s Largest User Generated Content Video System,” http://an.kaist.ac.kr/traces/papers/imc131-cha.pdf

[3] For Burgess and Green this is evident based on their assessment of the emphasis of presenting popular videos first, and the fact that YouTube members deliberately find ways to promote their videos to become as popular as possible. See Jean Burgess & Joshua Green, YouTube: Online Video and Participatory Culture (Cambridge: Polity, 2010), 74.

Everything is a Remix Part 4 from Kirby Ferguson on Vimeo.

Part 4 of the Series “Everything is a Remix” (above) has been released on line by Kirby Ferguson. In this last segment, Ferguson retells in large part Lessig’s argument on copyright and free culture (later renamed read/write culture). Kirby points to a “System Failure” in the near future. I don’t have much to add in terms of criticism about the series, given that Ferguson very much hops back and forth between cultural citations and material samplings, not acknowledging the complexity of intertextuality as I already discussed in a previous criticism I wrote about his series.

Another video was recently released by Creative Mornings, in which Ferguson goes over his views on remix as a “metaphor” (below). I wonder why he does not make metaphor a key issue in his videos. One would not have to worry about the watering down of “remix” as a term with a specific meaning in networked culture. But perhaps in the end Ferguson may sense that everything is not a remix. As I previously explained, in the end he is discussing intertextuality.

Well produced videos, worth watching. I think people will change their minds about creativity when viewing them, and this is a real contribution by Ferguson.

2011/08 Kirby Ferguson from CreativeMornings on Vimeo.

Image: Preliminary cover design and logo for upcoming book by Ludmil Trenkov.

I am very happy to announce that my book Remix Theory: The Aesthetics of Sampling is scheduled to be published later on this year, by Springer Wien New York Press.  If all goes according to schedule, it should be available no later than this Fall.  The book offers an in-depth analysis on Remix as a form of discourse.  To get a sense of what to expect, you can read my previously published text, “Regressive and Reflexive Mashups in Sampling Culture,” also available through Springer: http://www.springerlink.com/content/r7r28443320k6012/. You can read my online version as well, though I encourage you to support the publishing company by downloading the official version.

I will offer more information about the book in the near future, such as the table of content, and excerpts from the text. For now I wanted to share the promotional abstract:

Remix Theory: The Aesthetics of Sampling is an analysis of Remix in art, music, and new media. Navas argues that Remix, as a form of discourse, affects culture in ways that go beyond the basic recombination of material. His investigation locates the roots of Remix in early forms of mechanical reproduction, in seven stages, beginning in the nineteenth century with the development of the photo camera and the phonograph, leading to contemporary remix culture. This book places particular emphasis on the rise of Remix in music during the 1970s and ‘80s in relation to art and media at the beginning of the twenty-first Century. Navas argues that Remix is a type of binder, a cultural glue—a virus—that informs and supports contemporary culture.

I will be presenting my research on Remix and cultural analytics at the University of Lumiére in Lyon, France on November 24.  Program and other information availlable.

A brief note on my presentation:

I will discuss the evolution of remixing in a three case study, with particular emphasis on when and how the video remixes were produced.  This is done in order to reflect on the initial uploads of material and subsequent remixes as important vehicles of communication and creative practice.

What cultural analytics can bring to anthropology, and other fields that adopt it, is the ability to attain a balanced approach based on quantitative and qualitative analysis.

Posts about my research:

Charleston Style

Lotus Flower Parodies

Downfall Parodies

— Eduardo Navas

I contributed an essay on my project Traceblog to the book publication Net Works: Case Studies in Web Art and Design, edited by Xtine Burrough.  I want to thank Xtine for the opportunity to share my ideas.  Below are excerpts from my chapter contribution, which is titled after the actual online project as “Traceblog.”  After the excerpts you will find the table of contents, which, in my view, includes an impressive list of contemporary new media artists. Excerpts from my chapter contribution:

[…] Traceblog was developed in reaction to one of my previous projects titled Diary of a Star (2004-07), a blog that appropriated entries from The Andy Warhol Diaries.   As exciting as Diary of a Star was for me to produce, it consumed more time than I expected because entries had to be carefully written and took much longer to compose than average blog posts. Soon after I finished the Warhol project I began to think about the changes that had taken place with the shift to Web 2.0, and how blogging had changed since 2004. I realized that keeping track of people’s surfing activity had become an important element for private, public, and state organizations to data-mine patterns of communication and consumption online.   The term “social media” began to be used more often when discussing the growth of early networks such as Orkut, and Friendster around 2004, the period when I began to develop Diary of a Star.

I evaluated the changes in online activity since 2004 and decided to develop Traceblog to reflect on the new stage that global culture was entering in 2008, during which millions of people around the world willingly shared information about themselves online, via social networks such as Facebook, Flickr, and Myspace, as well as YouTube, not to mention thousands of blogs, which by such time were conventional tools of communication for average Internet users. The result of the social media frenzy is an attitude of sharing that is ubiquitous in 2010, the time of this writing.

[…] Traceblog is a direct result of my ongoing practice as artist and media researcher.  It makes the most of the default state of works of art in new media practice as informational forms, not defined by physical presentation. Traceblog and similar online works function in a state of flux defined by the growing archive and its relation to the ever-present: the now.

(more…)

Image: Jeremy Douglass (front) analyzes manga comic pages.

The Software Studies lab has had a busy week.  Three publications are currently available, as listed below.

Article:Jeremy Douglass, William Huber, Lev Manovich. “Understanding scanlation: how to read one million fan-translated manga pages.” Forthcoming in Image and Narrative, Spring 2011. [pdf 3 MB].

An article on Cultural Analytics, titled “Graphing Culture” by James Williford, appears in the March/April 2011 issue of Humanities, the official magazine of the National Endowment for the Humanities (NEH).

And Tara Zepel published her essay “Cultural Analytics at Work: The 2008 U.S. Presidential Online Video Ads” in the edited book Video Vortex Reader II: moving images beyond YouTube – new INC publication.

Image source: Alianzo

I recently wrote about the use of social media for real change in Egypt.  I explained in that entry that it is up to people to use social media critically–to appropriate it for issues that go beyond entertainment.  As I also explained in that entry as well as a text I released online previously, titled After the Blogger as Producer, the problem with micro-blogging (and Twitter) is that it encourages its users to write in a way that is not viable for critical thinking.

Surely enough, the New York Times on February 20, 2011 published the story, Blogs Wane as the Young Drift to Sites Like Twitter, in which Verne Kopytoff explains that the new generation is no longer using blogs as much, but mainly Twitter and Facebook to communicate and share things of interest buy augmentin online with their friends.  Some of these users don’t event write, but simply share photos or brief statements, casually.

It appears that we have entered a stage in which people are quite aware of the different ways in which social media can be used. Evidence of this is Tweet4Action, an artwork by Les Liens Invisibles, recently released and supported by Turbulence.org. The art project was developed as critical commentary on the use of social media in revolutions.  Art usually fuels and spearheads change, but this artwork, unfortunately, lags.  It may be due to a certain degree of sarcasm that one may sense, which in this case can be read as a weakness of the work.  Tweet4Action does not make one question the role of social media.  It makes me say, “so, and…”

COMPLETE TEXT

“The Ethics of Modular Complexity in Sustainability” was published in the CSPA Quarterly, Spring 2010 Issue.  My text is available online according to a Creative Commons License adopted by the CSPA Journal. The content may be copied, distributed, and displayed as long as proper credit is given to the CSPA and the individual author(s), and as long as these contents are used by others for noncommercial purposes only.  Any derivative works that result from these contents must also be shared alike.

The journal is the print publication for The Center for Sustainable Practice in the Arts, a non-profit that supports artists and organizations in the process of becoming ecologically and economically sustainable while maintaining artistic excellence.

Editor statement for Spring 2010 issue:

In this issue, we’re working against the stereotypes of the form, and attempting to broaden its term. As always, we’re exploring our chosen theme across disciplines and were delighted to include sculpture, visual art, theater, public art, and media art in the following pages. Instead of asking for work based on waste materials, we asked for work built from objects that already exist.

———-

Abstract: “Remix: The Ethics of Modular Complexity in Sustainability” evaluates sustainability in networked culture.  It considers how the flow of information in terms of immaterial production and its relation to knowledge play a role in a fourth economic layer supported by the growing ubiquity of globalization.  It revisits and expands, yet again, on my interest in Jacques Attali’s concepts of noise and music to propose a critical position fully embedded in pervasive connectivity.

IMPORTANT NOTE: This text was written as a testing ground for my growing interest in the concepts of volume and module, as explored in vodule.com.  Consequently, this text uses the term modular complexity, but does not define it.  I consider this text as part of my process to develop a precise definition of modular complexity in social and cultural terms.  The interests that inform this text are also relevant to my current research on Remix and Cultural Analytics.  Future writings will make clear the interrelation of all these ongoing projects.

This online version contains minor edits made in order to clarify the argument.

———–

At the beginning of the twenty-first century, sustainability can be read with a double meaning: to be self-supportive while socially conscious. This is because specialized fields (and individuals who work in these fields) need to be aware of their interconnectivity if they are to subsist in global culture. Sustainability is relevant in the arts and media according to the interrelation of material and intellectual production, given that such relation supports specialized fields. Sustainability, when linked to social consciousness, modifies how the recycling of material becomes relevant in culture at large. One could promote a philosophy of sustainability, which embodies critical awareness of the politics of intellectual and material property with real consequences in daily life. This is relevant in all areas of culture, even when one may produce strictly in the realm of aesthetics, and other specialized spaces that appear distanced from politics and economy.

The double signification of sustainability also shares principles of recycling with Remix as a form of discourse.  This is because Remix expands across culture from music to ecology: from immaterial pleasure to material responsibility.  The act of remixing has become common due to the rise of information exchange dependent on cut/copy and paste, which is an act of sampling data in all forms.  It enables individuals to apply the attitude of recombining in the realms of aesthetics and material reality, albeit with different results.  To be able to critically understand how such attitude functions in the symbolic and the material is the very challenge of sustainability.

(more…)

Image source: Inhabitat

Note: What better way to begin the new year than to point out the ongoing development of convergence.  The NYTimes survey by David Carr revisits developments I noted two years ago: On Content and Form: 2009 Forecast and Further Reflections on Content and Form; both posts are comments on articles also published on the NYTimes.  It looks like the multipurpose tablet (iPad and its growing competitors) may well become the new fetish through which information will be accessed in mashup form, as Carr proposes.

For years, those of us who toiled in the backwater of media reporting — covering people who cover other people — were left to trace the slow-motion decline of mainstream media and the inconsequential pratfalls of nascent digital efforts.

Click through a few years and suddenly the media landscape looks profoundly altered and punished, like a place where a serious earthquake was followed by a tsunami. News about the news business, once a rare commodity, now comes out of a fire hose, with many days bringing yet another shift in old paradigms.

Two-year-old Web sites are worth more than 50-year-old magazines, storied newspapers are now owned by their lenders, cable news has been upended by partisan shouters, social media now preoccupies attention that used to be owned by mainstream producers, and that television screen in the family den is just one of the numerous screens people are staring at.

So let’s stipulate that the sky is falling and will continue to do so. Rather than look back at the creative destruction that has taken place, I thought it would be worthwhile to click on the future. Here, in no particular order — because the way forward is paved with chaos — are some of the developments you and I will be talking about in the coming year.

Read the complete text at NYTimes

The following are videos from a performance that took place on November 11, 2010 at the Cultural Center of Spain in El Salvador, for the Exhibition, A Modular Framework.

Brian Mackern performs his remix of the film, the Stalker by Tarkovsky

Arcangel Constantini remixes noises and video games live for the audience

Antonio Mendoza remixes pop media image and sound