Throughout the process, various movements were tested and catalogued to ensure a wide range of sequences. Ideas such as "lifting," "pushing," "shaking," and "stretching" were also considered but could not be implemented due to time constraints. Simultaneously, efforts were made to keep the number of objects manageable with which users interact in the installation. The participant flexes its creative muscles. The participant flexes its creative muscles. To get InShape.
The installation targets primarily graphic designers, encouraging them to challenge conventional practices and explore self-designed tools and innovative approaches that diverge from industry norms. It also critiques the growing demands for productivity and self-optimization. Consequently, individuals who spend significant time in front of computers and seek physical activity are invited to participate in redefining their work experience.
1.talk
The installation commences with a prompt to enter the text via voice input. A compact Bluetooth microphone is mounted at head height on a stand, ensuring that the spoken text is transmitted to the computer.
The installation begins with a prompt to enter text via voice input. A compact Bluetooth microphone is mounted at head height on a stand to ensure that spoken text is transmitted to the computer. The microphone is configured as the default microphone in Windows, enabling vvvv to recognize it as the input source. Here, Microsoft Azure's AI Speech-To-Text function ensures timely and accurate transcription of the audio to text. A universal language model, trained using data held by Microsoft and representing frequently spoken languages (Eric Urban, n.d.), serves as the foundation for voice recognition.
The recognized words are randomly inserted onto the page. Given more time and coding experience, these could have been aligned precisely on a grid and wrapped at specific lengths.
Additionally, the volume of the voice determines the font size, adding an interactive element that tests the variability of one's voice. Users are encouraged to speak into the microphone consciously. A quiet or whispered voice results in small, nearly illegible font sizes, while a louder voice causes letters to extend beyond the frame.
2.rotate
The ring activates the entire upper body and both arms to rotate in different directions. It can be used both horizontally and vertically. However, due to technical limitations, it cannot spin like a hula hoop and must be slowed down and controlled at specific angles.
The object is designed to adjust the font family and font style of previously inserted text. Instead of navigating through a drop-down menu of fonts, the font settings are adjusted by rotating the ring. During this process, five marbles are rolled either left or right, activating two standard pushbuttons.
Creating a large, internally hollow circle that maintains its shape posed a challenge. Although suction spiral hoses made of polyurethane or aluminium flexible hoses are hollow, a round circular shape without kinks is not possible due to its previous winding. Another challenge was finding suitable hoses that met the requirements, as many commercially available hoses in hardware stores were too narrow in diameter to accommodate the pushbuttons and microcontroller. This also applies to pool noodles.
Using pipe insulation made from closed-cell polyethylene foam was considered a suitable solution. Four one-meter-long pieces were glued together, with one component housing the hardware and pushbuttons attached using foam remnants. At the core of the structure is an ESP32 accessible through a small slot for easy modifications or battery connection. Inside are five marbles used to trigger the pushbuttons.
However, it should be noted that considerable weight is required to coordinate the rotational movement and the marbles to actuate the buttons. Even with five marbles, insufficient activation of the buttons may occur, resulting in slow rotation at specific angles. This is because the impact energy of the marbles may not be enough to close the circuit and send a signal.
In addition, the bonding points had to disappear and an aesthetically and haptically pleasing surface had to be created.
Initial tests were conducted with plaster, which proved too fragile. Subsequently, a remnant of SMOOTH-CAST semi-rigid urethane resin 60D was applied. These resins are not intended for external use and are normally used for rotational moulding applications. However, it does give an interesting tactile effect and keeps the ring resilient and lightweight. Unfortunately, a new set of castings reacted very differently to the rest used in the first trial as they were several months old. The result was a stronger and harder drop formation that could not be removed. In addition, the paint was no longer opaque but transparent, requiring a final spray application.
3.punch
Images are inserted into the software by actively hitting a punching bag. These images appear randomly on the page in a dynamic animation. The sensor used is an accelerometer that detects changes in its X and/or Y axis when hit. At certain tresholds, the software application is triggered to insert a new image.
The shape of the punching bag is not simply a cylinder, as this would resemble a standard punching bag too closely. A different shape was necessary to harmonize with other objects, so a diamond shape was chosen. The form was sewn from reflective fabric and filled with beanbag beads. The fabric was chosen to create an interesting spatial effect, highlighting the different edges of the form and forcing visitors to adopt different perspectives and move around the space. Wadding was used as the filling material because the initial concept was to create a soft and light object landscape. In retrospect, a heavier infill would have made more sense, as the light weight encourages being thrown around and the sensor can quickly be triggered twice if hit too hard. Since the fabric tears easily and no other material can reinforce it due to the cut, this was a lesson learned in working with different materials.
4.squeeze
This cylindrical shape invites bending and squeezing, which affects the pixel state, or resolution, of the images. When inserted, the images appear highly pixelated; squeezing and bending makes them sharper and clearer.
The original concept was to achieve this computer feedback by punching a bag. This is a common practice among graphic designers, who are often referred to as "pixel pushers" due to the repetitive and detail-oriented nature of their work. This idea of releasing stress and anger is still evident in the “punsh” shape above. Here, it emphasises a strong embrace, highlighting the tactile aspect through hugging and bending. Ultimately, the concept of the "Pixel Pu(n)sher" station has been divided into two interacting shapes while preserving the original idea.
The cylinder is crafted from a vibrant fabric and filled with beanbag beads. A selfmadee bend sensor is incorporated into the design. This sensor operates on the principle of resistance, and provides a range of values based on the variations in resistance.
A series of homemade bend sensors, also known as flex sensors, were subjected to testing. An initial prototype was constructed from paper, flexible cardboard, a pencil, aluminium foil, wires and hot silicon. However, this did not work properly. Subsequently, a bend sensor was constructed following instructions from KOBAKANT.
While the viability of this approach on a larger scale remained uncertain, the result of the analogue values are sufficiently clear. In this instance, the value is 1,98 kOhm when the sensor is in a straight position and 0,6 kOhm when it is squeezed hardest. A treshold is employed in vvvv to initiate a bang, thereby triggering the pixelation value. The program is configured to further reduce the value and start the process from a specified default value, ensuring continuous motion in a loop.
The sensor consists of two neoprene strips, each sewn with conductive thread diagonally every two centimeters. When these strips overlap, the slanted threads form a cross pattern. Between the neoprene layers, a layer of Velostat is placed. Velostat is a type of packaging material composed of polymeric foil that has been partially electrically conductive by impregnating it with carbon black. Due to its piezoresistive properties, Velostat exhibits a change in resistance in response to external stimuli, such as pressure or flexing (How to get what you want, n.d.-e).
The ends of the thread are sewn to small pieces of conductive fabric, to which the cables to the microcontroller are connected. One side is connected to 3V3, the other to ground and an analog pin.
5.jump
The octagonal shape, created through the cutting of foam, is a pushbutton of considerable size. It can be released only with a certain amount of force. The dimensions and configuration of the button evoke those of a trampoline, which prompts a jumping movement. Each impact results in a reorganization of text and image on screen, thereby creating a new layout hierarchy.
The structure is comprised of a thick layer of foam, which is characterized by its high elasticity and prevents the user from becoming soaked in the material. The button is constructed using conductive fabric from the company Shieldex. Two large circles were cut out, with a small piece connected around the electronics. The conductive fabric is attached to a piece of fabric using iron-on adhesive. The conductive fabric pressure sensor was manufactured in accordance with KOBAKANT's instructions, but on a larger scale.
6.balance
Ultimately, it all comes down to balance. Once the layout is finalized, the poster can be printed. Printing begins when the balance can be maintained for a specified duration. Upon completion of printing, the overall design process can be restarted.
A simple and inexpensive balance board was attached to a larger wooden board using screws. Conductive copper tape was then applied to the top of the board, followed by the addition of a thin foam board with larger holes. This was fixed in place using glue. Fabric was then attached, with conductive cloth tape running parallel to the lower copper strips. This setup mirrors the principle used in the homemade pushbutton sensor with conductive fabric in the "Jump" mechanism.
Finally, a thick memory foam is employed to provide a soaking soft experience. As long as the contact is made and the sensor switches from 0 to 1, the process is initiated. Additionally, the board's position is measured using an accelerometer. If the board tilts too far on the X or Y axis, exceeding certain thresholds, it indicates that balance has been lost. The sensors thus serve to idenitify whether an individual is in contact with the board and to determine whether the balance is being maintained. In the event of a fall, the process must be repeated.
At the end the user is able to print out the designed poster created by their performance and take it back home. It serves as a testimony to the interactive installation. For simplicity’s sake, the final result is designed as a poster. The design of a multi-page print product, such as a magazine or book, was too elaborate for an interactive installation. It is reduced to a few important design principles: Image, text, and their layout are explored.
Since the development of the software application was self-coded, which took some learning and testing, the screen outcome is familiar to a two dimensional poster and the print is equal to the ‚what-you-see-is-what-you-get’-principle.