The interest in beatesthesia has been surprising to say the least, thanks mainly to http://createdigitalmotion.com/ for there post. The software at this stage is still in a developmental phase and as a few of you have found out contains a few bugs, it WILL crash unless you set your java heap memory to at least a gig. For all features please use the source code version. The plan is to release a stable commented version of beatesthesia very soon.


Thanks olly gore

 


Beatesthesia is a highly customizable WYSIWYG music visualizer. Inspired in motive and design by synesthesia. Synesthesia from the Ancient Greek (syn), meaning "with," and (aisthēsis), meaning "sensation" is the phenomenon in which stimulation of one sensory or cognitive pathway leads to automatic, involuntary experiences in a second sensory or cognitive pathway.

Synesthesia has inspired many works of art. Art that is meant to evoke synesthetic associations in a non-synesthetic audience is dubbed synesthetic. Most artists synced sound and light performances to achieve this goal. Their efforts were deemed arbitrary because the all relied upon one set schema for an entire audience. If it is at all possible to evoke synesthetic reactions each experience should be fine tuned to a single person.

Beatesthesia allows the user to design their own music visualization. The WYSIWYG editor allows you to easily add audio reactive graphics to either Kick Snare or Hat beats. When a beat is detected the graphical event programmed is then fired.

The interface its self is audio reactive. This increases the speed of the feedback loop. You know exactly what beat you are adding to because you can see it flashing. Beatesthesia allows anyone to create their own music visualization. There is no prior knowledge of audio manipulation video software needed.

Beatesthesia is equally capable of competing with live visual software, the VJ version features a dual display set up for live performance. You can share you creations with others, using the copy paste code system.

Beatesthesia
DESIGN, EXPERIENCE, SHARE


Features
Kick Hat and Snare beat detection. With one click graphic attachment.
Create audio reactive templates using circles, squares, graphics, and text.
With full control over color, opacity, decline rate, explode radius, size and position.
Photomix allows for a sequence of photos to be animated to the beats.
Background featuring color mixer.
Animation, either noise or tween.
All saveable using the sequencer library.
Online Version.
Code system for sharing templates.
Live VJ version with 2nd screen display system.


Instructions
Emphasis is heavily placed on customization so I have included a few songs, backgrounds and graphics but to make the most please download and fill her up yourself full guides for loading personal data can be seen here....

Audio
Pre load your music into the ‘data’ folder please ensure the files are named’audio1.mp3’ through to ‘audio9.mp3’. Pressing the live input button will switch the focus of the application from mp3 to live in input. Additional songs can be loaded using the ‘the song’ text box, please ensure you enter the correct name and the song is placed in the data directory or the program will crash. The Online applet has three songs built in and these cannot be changed.

Beatesthesia works by layering up combinations of audio reactive graphics with different settings and mixing these combinations with background effects and photos.

Create/Edit
The Create Edit screen allows you create such templates. After choosing Kick, Snare or Hat from the drop down menu you will be offered 10 free slots for each. If the slot has data then it will flash white. Upon clicking for example Snare > Snare1 you will be offered a choice of ‘circle’, ‘text’, ‘square’ and ‘graphics’.  If you wanted to add a circle then you would click ‘circle’ and choose ‘submit’. This would insert a circle with the default settings into slot ‘Snare 1’ You can edit the following options for each tool

Circle; X, Y, Width, Height, Rotation, Rotation Speed, Explode Rate, Decline Rate Red, Blue, Green Alpha, Stroke.
Square; X, Y, Width, Height, Rotation, Rotation Speed, Explode Rate, Decline Rate Red, Blue, Green Alpha, Stroke.
Text; X, Y, Width, Height, Explode Rate, Decline Rate Red, Blue, Green Alpha, Text.
Photo; X, Y, Width, Height, Rotation, Rotation Speed, Explode Rate, Decline Rate, Alpha & graphic selection.

The idea is to build up intricate interweaving collections of circles, squares, text and graphics, and
then save them as template.

The Gallery
Click the load button beneath the thumbnails to load a large preview. And then click the top ‘load button’ to load the template onto the stage. Saving is accomplished in a similar manner. First click a free slot thumbnail and then choose ‘save’ from the top of the menu. The preview window should update in real time (this only works with .pde version). The gallery is also responsible for turning on ‘manual controls’. Changing the kick hat and snare settings in the top right hand side of the gallery enable the hot keys ‘z’,’x’ and ‘c’ to be used to manually trigger the beats.

Once you have created and saved your template you are now ready add the following optional extras, from their respective tabs. Animation, Photomix and Background.

Animation
Animation allows you to assign either a shapetween xy animation or a once based on perlin noise. To apply either simply click the ‘snare’ ‘hat’ and ‘kick’ button within animation, and one of the a set of sliders will be highlighted black. This is the animation that is currently set click again to turn off and choose the other one.  It is best just to have a play with the sliders.

Photomix
Allows you to VJ sets of up to 5 photos. The download includes 45 backgrounds but you are encouraged to add your own. Beatesthesia is all about customization. The following options are available for use with photo mix; Zoom, Decline, Number of Pictures, Red, Blue, Green, and Alpha. Which beat the mix is attached to and which set of pictures to use.

Background

If Photomix is turned on background will not show. Changing the colour of the background results in an overall change to the UI.

Sequencer
The sequencer allows you to link a template alongside, Photomix, animation and Background settings. The idea is to build up lots of sequences and then change them on the fly, during a live performance.

Live performance
The Live performance mode comes complete with a dual display. Please set your resolution to 800x600 and extend your monitor to a extra display. When the application is centred it will exactly cover both screens.