The book explores the technical as well as cultural imaginaries of programming from its insides. It follows the principle that the growing importance of software requires a new kind of cultural thinking — and curriculum — that can account for, and with which to better understand the politics and aesthetics of algorithmic procedures, data processing and abstraction. It takes a particular interest in power relations that are relatively under-acknowledged in technical subjects, concerning class and capitalism, gender and sexuality, as well as race and the legacies of colonialism. This is not only related to the politics of representation but also nonrepresentation: how power differentials are implicit in code in terms of binary logic, hierarchies, naming of the attributes, and how particular worldviews are reinforced and perpetuated through computation. Using p5.js, it introduces and demonstrates the reflexive practice of aesthetic programming, engaging with learning to program as a way to understand and question existing technological objects and paradigms, and to explore the potential for reprogramming wider eco-socio-technical systems. The book itself follows this approach, and is offered as a computational object open to modification and reversioning.
Visions of Chaos is a professional high end software application for Windows. It is simple enough for people who do not understand the mathematics behind it, but advanced enough for enthusiasts to tweak and customise to their needs. It is the most complete all in one application dealing with Chaos Theory and Machine Learning available. Every mode is written to give the best possible quality output. There are thousands of sample files included to give you an idea of what Visions of Chaos is capable of.
Ofelia is a Pd external which allows you to use openFrameworks and Lua within a real-time visual programming environment for creating audiovisual artwork or multimedia applications such as games.
openFrameworks is an open source C++ toolkit for creative coding.
Lua is a powerful, efficient, lightweight, easy-to-learn scripting language.
Pure Data(Pd) is a real-time visual programming language for multimedia.
Thanks to Lua scripting feature, you can do text coding directly on a Pd patch or through a text editor which makes it easier to solve problems that are complicated to express in visual programming languages like Pd. And unlike compiled languages like C/C++, you can see the result immediately as you change code which enables faster workflow. Moreover, you can use openFrameworks functions and classes within a Lua script.
Using Ofelia, you can flexibly choose between patching and coding style based on your preference.
The external is available to be used under macOS, Windows, Linux and Raspberry Pi.
A free educational site that progressively introduces you to the world of computer graphics.
Our application programming approach guides you through small, easy-to-compile programs.
We’ve dispensed with unnecessary technical jargon in favor of everyday language.
Tooll 3 is an open source software to create realtime motion graphics. We are targeting the sweet spot between real-time rendering, graph-based procedural content generation and linear keyframe animation and editing. This combination allows…
artists to build audio reactive vj content
use advanced interfaces for exploring parameters
or to combine keyframe animation with automation
Technical artists can also dive deeper and use tool for advanced development of fragment or compute shaders or to add input from midi controllers and sensors or sources like OSC or Spout.
We strongly believe in usability and intuitive and beautiful interface design. That's why we experiment with different approaches before striking the right balance between usability and powerful flexibility. Currently tool version 3 is an ongoing development. It's stable enough to produce high-end visuals create motion graphics use many industry standard features like color correction, scopes and tone mapping, and export small standalone executables.
Excentro is a simple but advanced tool that can create guilloche designs like backgrounds, borders or rosettes.
The guilloches are vintage design elements that were frequently used for anti-counterfeiting security purposes on banknotes, passports, checks and certificates during the past two hundred years. As the times changed and digital copy and printing technologies perfected, guilloches no longer presented sufficient security measures that could prevent forging and counterfeiting of valuable papers. Today the main part of security technology lies in the special paper or tricky inks the designs are printed upon or with.
Still, it is too early to say that the days of guilloche designs are over. They can still be used to prevent the counterfeiting of products that do not require the highest level of security (i.e. theater tickets, diplomas or gift certificates). Or, they can just be used to decorate and add some aesthetic value to a product giving the ‘money-like’ look and value.
What BirdNET-Pi Does
24/7 recording from any USB sound card/microphone
24/7 local BirdNET-Lite analysis
Automatically extracts the detected songs, chirps, and peeps from recordings
Creates spectrograms of each recorded bird sound
Enters each detection into a local SQlite database for storage and data visualization
Hosts its own Caddy web server so that the data can be accessed from any web browser or device (can be configured to be local only or can easily be made public to share with the world — check out the public installations below!)
Offers local Streamlit database analysis to visualize daily and long-term presence data
Live audio stream
BirdWeather.com integration
https://github.com/grame-cncm/faust
Faust (Functional Audio Stream) is a functional programming language for sound synthesis and audio processing with a strong focus on the design of synthesizers, musical instruments, audio effects, etc. Faust targets high-performance signal processing applications and audio plug-ins for a variety of platforms and standards. It is used on stage for concerts and artistic productions, in education and research, in open source projects as well as in commercial applications.
The core component of Faust is its compiler. It allows us to "translate" any Faust digital signal processing (DSP) specification to a wide range of non-domain specific languages such as C++, C, JAVA, JavaScript, LLVM IR, WebAssembly, etc. In this regard, Faust can be seen as an alternative to C++ but is much simpler and intuitive to learn.
Thanks to a wrapping system called "architectures," codes generated by Faust can be easily compiled into a wide variety of objects ranging from audio plug-ins to standalone applications or smartphone and web apps, etc.
Kid Pix just became pubic domain, so the remade (but pretty much exactly the same) version is now available here.
Spacelapser is a tool for exploring the three-dimensional volumes created by loading an entire video into memory. Depending on the motion of the camera, this volume can resemble a lightfield, a slit-scan camera, or a special relativity simulator.
https://github.com/loganwilliams/spacelapser/releases/download/v0.1.2/spacelapser.dmg
Hydra is a platform for live coding visuals, in which each connected browser window can be used as a node of a modular and distributed video synthesizer.
Built using WebRTC (peer-to-peer web streaming) and WebGL, hydra allows each connected browser/device/person to output a video signal or stream, and receive and modify streams from other browsers/devices/people. The API is inspired by analog modular synthesis, in which multiple visual sources (oscillators, cameras, application windows, other connected windows) can be transformed, modulated, and composited via combining sequences of functions.
Features:
Written in javascript and compatible with other javascript libraries
Available as a platform as well as a set of standalone modules
Cross-platform and requires no installation (runs in the browser)
Also available as a package for live coding from within atom text editor
Experimental and forever evolving !!
Cables is your model kit for creating beautiful interactive content. With an easy to navigate interface and results in real time, it allows for fast prototyping and prompt adjustments.
Working with cables is just as easy as creating cable spaghetti:
You are provided with a given set of operators such as mathematical functions, shapes and materials.
Connect these to each other using virtual cables to create the scene you have in mind.
Easily export your piece of work at any time. Embed it into your website or use it for any kind of creative installation.
Welcome to Exploring Technology, a wishful remedy to the increasing knowledge gap between machine builders and machine users.
Learn about :
A-Frame
Arduino
AxiDraw
Bitsy
Cables
Cinema 4D
Circuit
GitHub
Colab
Glitch
Hubs
Hydra
Laser Cutting
Lightform
Lights
Machine Learning
Makey Makey
NFT
Node
Photogrammetry
Processing
Projectors
Raspberry Pi
Resolume
Tone
Spark
Web
Drawing Bot is a free, open source software for converting images to line drawings for Plotters / Drawing Machines / 3D printers. It also serves as an application for visual artists to create stylised line drawings from images / video.
It is available for Windows, Mac and Linux.
If you want to support the development of DrawingBotV3 you can donate here or contribute to the Drawing Bot Collection!
Features
15 Path Finding Algorithms - all highly configurable to create unique drawing styles
Automatic Path Optimisation for Faster Plots - Line Simplifying, Merging, Filtering, Sorting
Pen Settings: configurable colour / stroke width / distribution weight / blend modes - perfect for multi-layered plots.
Image Sequences: You can export image sequences animations of your creations!
Version Control: Save your favourite versions as you go and reload them.
Project Saving & Loading
60+ Image Filters for pre processing the imported image
Automated CMYK separation
Advanced User Interface with live drawing preview
User configurable Drawing Area, with Padding / Scaling Modes
Special pens for Original Colour/Grayscale Sampling
Presets: can be saved/imported/exported for sharing different styles with other users
Exports can be exported per/pen or per/drawing in multiple file types
Batch Processing: Convert entire folders of images automatically.
GCode - configurable Drawing Area, XYZ Offsets / Auto Homing.
vpype Integration
Path Finding Modules
Sketch Lines PFM
Sketch Curves PFM
Sketch Squares PFM
Sketch Quad Beziers PFM
Sketch Cubic Beziers PFM
Sketch Catmull-Roms PFM
Sketch Shapes PFM
Sketch Sobel Edges PFM
Spiral PFM
Voronoi Circles
Voronoi Triangulation
Voronoi Stippling
Voronoi Diagram
Mosaic Rectangles
Mosaic Voronoi
More info here
Supported File Types
Import Formats:
Images: [.tif, .tga, .png, .jpg, .gif, .bmp, .jpeg]
Export Formats:
Vectors: [.svg, .pdf],
Images/Image Sequences: [.tif, .tga, .png, .jpg, .jpeg]
GCode: [.gcode, .txt],
Carefully curated list of awesome creative coding resources primarily for beginners/intermediates :
To the extent possible under law, Terkel Gjervig has waived all copyright and related or neighboring rights to this work.
Rutt-Etra-Izer is a WebGL emulation of the classic Rutt-Etra video synthesizer. This demo replicates the Z-displacement, scanned-line look of the original, but does not attempt to replicate it’s full feature set.
The demo allows you to drag and drop your own images, manipulate them and save the output. Images are generated by scanning the pixels of the input image from top to bottom, with scan-line separated by the ‘Line Separation’ amount. For each line generated, the z-position of the vertices is dependent on the brightness of the pixels.
20 alternative interfaces for creating and editing images and text
https://github.com/constraint-systems
Flow
An experimental image editor that lets you set and direct pixel-flows.
Fracture
Shatter and recombine images using a grid of viewports.
Tri
Tri is an experimental image distorter. You can choose an image to render using a WebGL quad, adjust the texture and position coordinates to create different distortions, and save the result.
Tile
Layout images using a tiling tree layout. Move, split, and resize images using keyboard controls.
Sift
Slice an image into multiple layers. You can offset the slices to create interference patterns and pseudo-3D effects.
Automadraw
Draw and evolve your drawing using cellular automata on a pixel grid with two keyboard-controlled cursors.
Span
Lay out and rearrange text, line by line, using keyboard controls.
Stamp
Image-paint from a source image palette using keyboard controls.
Collapse
Collapse an image into itself using ranked superpixels.
Res
Selectively pixelate an image using a compression algorithm.
Rgb
Pixel-paint using keyboard controls.
Face
Edit both the text and the font it is rendered in.
Pal
Apply an eight-color terminal color scheme to an image. Use the keyboard controls to choose a theme, set thresholds, and cycle hues.
Bix
Draw on binary to glitch text.
Diptych
Pixel-reflow an image to match the dimensions of your text. Save the result as a diptych.
Slide
Divide and slide-stretch an image using keyboard controls.
Freeconfig
Push around image pixels in blocks.
Moire
Generate angular skyscapes using Asteroids-like ship controls.
Hex
A keyboard-driven, grid-based drawing tool.
Etch
A keyboard-based pixel drawing tool.
About
Constraint Systems is a collection of experimental web-based creative tools. They are an ongoing attempt to explore alternative ways of interacting with pixels and text on a computer screen. I hope to someday build these ideas into something larger, but the plan for now is to keep the scopes small and the releases quick.
This timeline is the result of researching the origins of digital paint and draw software, and the tools that were developed to allow for hand manipulation (versus plotter drawn) drawing and painting - the mouse, light pen & drawing tablet. If we look at the software that has become commonplace today (such as adobe photoshop), which allows for painting, animation and photo manipulation in one, we can trace the roots of this software to the University and Corporate Labs that housed large computers with advanced capabilities for their time - MIT Lincoln Labs & Radiation Labs, DARPA & the Augmented Research Centre (ARC), Bell Labs, NYIT’s Computer Graphics Lab, Xerox Palo Alto Research Centre (Xerox PARC), NASA’s Jet Propulsion Labs (JPL). The artistic collaborations that grew out of these labs fueled the advent of Computer Graphics, Computer Art and Video Art from the 1960's to the 1990's.
This visual timeline starts by tracing the paint systems, frame buffers, and graphic user interfaces created out of these labs, with a focus on the first paint/draw software and the various drawing tools. I am interested in how the larger corporate, and often Military Funded laboratories, effected the dawn of the personal computer and the introduction of the personal computer to the home. This timeline continues through the 1980’s, with a focus on the software and hardware that was developed for the home market from late 1970's to the 1990's.
OPENRNDR is a tool to create tools. It is an open source framework for creative coding, written in Kotlin for the Java VM that simplifies writing real-time interactive software. It fully embraces its existing infrastructure of (open source) libraries, editors, debuggers and build tools. It is designed and developed for prototyping as well as the development of robust performant visual and interactive applications. It is not an application, it is a collection of software components that aid the creation of applications.
Key features
a light weight application framework to quickly get you started
a fast OpenGL 3.3 backed drawer written using the LWJGL OpenGL bindings
a set of minimal and clean APIs that welcome programming in a modern style
an extensive shape drawing and manipulation API
asynchronous image loading
runs on Windows, MacOS and Linux
Ecosystem
Applications written in OPENRNDR can communicate with third-party tools and services, either using OPENRNDR’s functionality or via third-party Java libraries.
Existing use cases involve connectivity with devices such as Arduino, Philips Kinet, Microsoft Kinect 2.0, RealSense, DMX, ARTNet and Midi devices; applications that communicate through OpenSoundControl; services such as weather reports and Twitter. If you want to experiment with Machine Learning, try RunwayML that comes with an OPENRNDR integration.
A platform for interactive spaces, interactive environments, interactive objects and prototyping.
tramontana leverages the capabilities of the object that we have all come to carry with us anywhere, all the time, our smartphones. With libraries for Processing, Javascript and openFrameworks you can access the inputs and outputs of one or more smartphones to easily and quickly prototype interactive spaces, connected products or just something you’d like to be wireless. What used to involve complex tasks like networking, native app development, etc. can now be created with a single sketch on your computer.
Hello my dear friend,
I found a strange game on my computer a few days ago. I have tried to find out how it works but have failed in all my attempts. I hope you have more luck than I have. Please tell me if you can figure it out, because I think it's driving me C̷̖̆͊R̸̢̮̍Å̵̘̪̚Z̴͔̲̈́Ỳ̸̒ͅ. I'm sure the guide holds the key to solving it, but if not, you can always have some fun with the sinuous movements of the strange creatures that live in this game. I hope you enjoy it.
With love,
@beleitax
Download :https://github.com/Tw1ddle/geometrize/releases
Features
Recreate images as geometric primitives.
Start with hundreds of images with preset settings.
Export geometrized images to SVG, PNG, JPG, GIF and more.
Export geometrized images as HTML5 canvas or WebGL webpages.
Export shape data as JSON for use in custom projects and creations.
Control the algorithm at the core of Geometrize with ChaiScript scripts.
A showcase with creative machine learning experiments
Orca is an esoteric programming language designed by @hundredrabbits to create procedural sequencers.
This playground lets you use Orca and its companion app Pilot directly in the browser and allows you to publish your creations by sharing their URL.
Table of Contents
Creative Coding History
Modern Creative Coding Uses
Graphics Concepts
Creative Coding Environments and Libraries
Communication Protocols
Multimedia Tools
Unique Displays and Touchscreens
Hardware
Other output options
More resources
Shrub is a tool for painting-and-traveling, and even for painting while moving your own body (for example to use the color of your own pants).
If you touch with two fingers, you can immediately send your drawing as an SMS message. Shrub is designed as a mobile communication tool as much as a mobile drawing tool.
More pro tips: For the best drawings, pinch with your fingers to change the brush size. Twist with your fingers to change the brush softness. And of course, tap with one finger to show and hide the viewfinder.
The TX Modular System is open source audio-visual software for modular synthesis and video generation, built with SuperCollider (https://supercollider.github.io) and openFrameworks (https://openFrameworks.cc).
It can be used to build interactive audio-visual systems such as: digital musical instruments, interactive generative compositions with real-time visuals, sound design tools, & live audio-visual processing tools.
This version has been tested on MacOS (0.10.11) and Windows (10). The audio engine should also work on Linux.
The visual engine, TXV, has only been built so far for MacOS and Windows - it is untested on Linux.
The current TXV MacOS build will only work with Mojave (10.14) or earlier (10.11, 10.12 & 10.13) - but NOT Catalina (10.15) or later.
You don't need to know how to program to use this system. But if you can program in SuperCollider, some modules allow you to edit the SuperCollider code inside - to generate or process audio, add modulation, create animations, or run SuperCollider Patterns.
This database* is an ongoing project to aggregate tools and resources for artists, engineers, curators & researchers interested in incorporating machine learning (ML) and other forms of artificial intelligence (AI) into their practice. Resources in the database come from our partners and network; tools cover a broad spectrum of possibilities presented by the current advances in ML like enabling users to generate images from their own data, create interactive artworks, draft texts or recognise objects. Most of the tools require some coding skills, however, we’ve noted ones that don’t. Beginners are encouraged to turn to RunwayML or entries tagged as courses.
*This database isn’t comprehensive—it's a growing collection of research commissioned & collected by the Creative AI Lab. The latest tools were selected by Luba Elliott. Check back for new entries.
Via : https://docs.google.com/document/d/1TkusCE5mS4tuTYoBwaTV4aJKdSVsf9jFKsGJCx8M05c/edit
This is a list of smaller tools that might be useful in building your game/website/interactive project. Although I’ve mostly also included ‘standards’, this list has a focus on artful tools & toys that are as fun to use as they are functional.
The goal of this list is to enable making entirely outside of closed production ecosystems or walled software gardens.
Paint and Animate Live!
Tagtool transforms your iPad into a visual live instrument. Paint with light, create animated graffiti or tell improvised stories.
https://www.tagtool.org/
https://bibliogram.art/u/tagtoolcrew
Strike is a web-based, 1-bit paint tool, primarily for quick sketching or line-drawing.
Features
brush / eraser / fill tools with different brush shapes and sizes
16-'color' palette via dither patterns. Each pattern is treated as a separate color for fill tool
~50 step undo / redo (it's fragile, so don't rely on it too much)
import PNG and JPG files, which will be converted to 1 bit form
zoom via mouse scroll or two-finger pinch
basic image transform tools (flip / mirror / resize canvas)
save images as a 16-color greyscale (which will import back into Strike with all patterns intact), or as 1-bit black and white image
autosave (see notes)
Animation playground
We’d like to show you a new way to create hand-drawn animation. So playful you’ll think it’s a toy, but it's secretly a robust app with a reimagined UI for animators and creators.
Wonderfully musical
Taking inspiration from music creation tools, using Looom feels more like playing an instrument than operating software - exploring lines, shapes and colors through loopable time and rhythm.
Everyone in the loop
Looom is all about looping animation with a smile. It was designed for professionals and beginners of any age, and is already being used by some influential indie animators.
Libre and modular OSC / MIDI controller :
https://github.com/jean-emmanuel/open-stage-control/releases
"MindCandy Volume 1: PC Demos." The movie explores the definition and roots of an artistic computer sub-culture known as the demoscene, a community that's given me endless inspiration since the 1980s.
WATCHOUT multi-display software is your fast track to creating spectacular shows. Use WATCHOUT to compose and manage all the different media elements in your show – video, still images, animations, graphics, live feeds, sound – and then play it back on multiple displays. Perfectly synchronized, high resolution and right-on-cue.
WATCHOUT is easily integrated and controls external units or devices. It has no limitations on displays, channels or resolutions. With over 15 years of unrivalled performance and reliability, WATCHOUT is the choice of professional show creators worldwide.
WATCHOUT is used in live events, 3D mapping, broadcast, digital signage, museums, planetariums, show rooms, visitor attractions and experience centers. In other words – virtually any market or application where you want multiple display devices and maximum impact.
Uncompressed playback
We understand that image quality is all-important. WATCHOUT supports playback of uncompressed video or images at full resolution and framerate!
Unlimited Display Devices
There are no limits on the number of display devices you can add to your WATCHOUT show. That means no limits on your creativity!
UNLIMITED RESOLUTION
With WATCHOUT you can create any kind of resolution in any kind of aspect ratio. If you want to move beyond 4K, 8K or 16K – no problem.
Virtual Displays
The virtual display feature is a flexible way to map pixels on 3D geometry or your LED walls through a wall processor. It can contain any kind of media, such as video, stills, tweens and dynamic content.
Unlimited timelines
WATCHOUT is a user-friendly, timeline-based show creation tool. Drag and drop media onto an infinite number of timelines, auxiliary timelines or layers.
3D Mapping / Facade projection
With WATCHOUT you can create projection mapping shows on any shape, structure or building. Import your 3D model and use the 3D projection feature to visualize your show!
Capture content
With WATCHOUT you can capture multiple content streams through low latency capture cards, USB cards, network streams, VNC or live IP workflow using NDI® (Network Device Interface).
NDI / Live IP production workflow
WATCHOUT supports NDI® which allows multiple video streams on a shared connection, enabling high quality, low latency, frame-accurate video over local area networks and reducing costs plus deployment time.
Utility library to easily connect to RunwayML from Processing
Feel free to replace this paragraph with a description of the Library.
Contributed Libraries are developed, documented, and maintained by members of the Processing community. Further directions are included with each Library. For feedback and support, please post to the Discourse. We strongly encourage all Libraries to be open source, but not all of them are.
https://github.com/runwayml/processing-library
Installation
Download https://github.com/runwayml/processing-library/releases/download/latest/RunwayML.zip
Unzip into Documents > Processing > libraries
Restart Processing (if it was already running)
A light Rust API for Multiresolution Stochastic Texture Synthesis [1], a non-parametric example-based algorithm for image generation.
Pixel-art scaling algorithms are graphical filters that are often used in video game emulators to enhance hand-drawn 2D pixel art graphics. The re-scaling of pixel art is a specialist sub-field of image rescaling.
As pixel-art graphics are usually in very low resolutions, they rely on careful placing of individual pixels, often with a limited palette of colors. This results in graphics that rely on a high amount of stylized visual cues to define complex shapes with very little resolution, down to individual pixels. This makes image scaling of pixel art a particularly difficult problem.
A number of specialized algorithms[1] have been developed to handle pixel-art graphics, as the traditional scaling algorithms do not take such perceptual cues into account.
Since a typical application of this technology is improving the appearance of fourth-generation and earlier video games on arcade and console emulators, many are designed to run in real time for sufficiently small input images at 60 frames per second. This places constraints on the type of programming techniques that can be used for this sort of real-time processing. Many work only on specific scale factors: 2× is the most common, with 3×, 4×, 5× and 6× also present.
Plugin for GIMP : https://github.com/bbbbbr/gimp-plugin-pixel-art-scalers
Waifu2x
https://en.wikipedia.org/wiki/Waifu2x
https://github.com/lltcggie/waifu2x-caffe/releases
https://github.com/imPRAGMA/W2XKit
https://old.reddit.com/r/WaifuUpscales/new/
https://github.com/BlueCocoa/waifu2x-ncnn-vulkan-macos/releases
https://old.reddit.com/r/Dandere2x/
https://old.reddit.com/r/waifu2x
https://github.com/AaronFeng753/Waifu2x-Extension
https://github.com/K4YT3X/video2x
https://old.reddit.com/r/AnimeResearch
Quote from a reddit comment :
A short list, ordered after output quality and setup time:
SRGAN, Super-resolution generative adversarial network : https://github.com/topics/srgan,
Other implementations: https://github.com/tensorlayer/srgan
https://github.com/brade31919/SRGAN-tensorflow
https://github.com/titu1994/Super-Resolution-using-Generative-Adversarial-Networks
Neural Enhance: https://github.com/alexjc/neural-enhance/
Photoshop: The newest PS version (19.x, since October 2017 release) also has a new upscaling method, called "Preserve Details 2.0 Upscale" but compared to SRGAN the results clearly lack sharp and fine details. You have asked for an App and PS is easy to use and can be automated.
Overview of the most popular algorithms:
https://github.com/IvoryCandy/super-resolution
(VDSR, EDSR, DCRN, SubPixelCNN, SRCNN, FSRCNN, SRGAN)
Not in the list above:
LapSRN: https://github.com/phoenix104104/LapSRN
SelfExSR: https://github.com/jbhuang0604/SelfExSR
RAISR, developed by Google:
https://github.com/MKFMIKU/RAISR
https://github.com/movehand/raisr
Evoboxx is a synthesizer based on the cellular automaton Game of Life, created by mathematician John Horton Conway in 1970. The game is a zero-player game, meaning that its evolution is determined by its initial state, requiring no further input. One interacts with the Game of Life by creating an initial configuration and observing how it evolves, or, for advanced players, by creating patterns with particular properties.
Demonstration tutorial of retraining OpenAI’s GPT-2-small (a text-generating Transformer neural network) on a large public domain Project Gutenberg poetry corpus to generate high-quality English verse.
https://jalammar.github.io/illustrated-gpt2/
Other tutorial : https://medium.com/@ngwaifoong92/beginners-guide-to-retrain-gpt-2-117m-to-generate-custom-text-content-8bb5363d8b7f
https://github.com/minimaxir/gpt-2-simple
Example : http://textsynth.org/
Datasets :
https://www.kaggle.com/datasets
https://github.com/awesomedata/awesome-public-datasets
Scrap webpage with python :
https://www.crummy.com/software/BeautifulSoup/
https://github.com/EugenHotaj/beatles/blob/master/scraper.py
A collection of specifications and tools for 360° video and spatial audio, including:
Spatial Audio metadata specification
Spherical Video metadata specification
Spherical Video V2 metadata specification
VR180 Video Format VR180 video format
Spatial Media tools for injecting spatial media metadata in media files
https://github.com/google/spatial-media/releases/download/v2.1/360.Video.Metadata.Tool.mac.zip
https://github.com/google/spatial-media/releases/download/v2.1/360.Video.Metadata.Tool.win.zip
A standalone timeline app that can be controlled by and sends out its values via OSC.
A Posh based timeline that can be controlled by and sends out its values via OSC.
Brought to you by vvvv.
Requires Internet Explorer >= 10 to be installed on your system.
Looking for a binary download? Get it here.
A free and open-source intermedia sequencer
Enables precise and flexible scripting of interactive scenarios.
Control and score any OSC-compliant software or hardware:
Max/MSP, PureData, openFrameworks, Processing…
Mosaic is an open source multi-platform (osx, linux, windows) live coding and visual programming application, based on openFrameworks.
This project deals with the idea of integrate/amplify human-machine communication, offering a real-time flowchart based visual interface for high level creative coding. As live-coding scripting languages offer a high level coding environment, ofxVisualProgramming and the Mosaic Project as his parent layer container, aim at a high level visual-programming environment, with embedded multi scripting languages availability (Lua, GLSL, Python and BASH(macOS & linux) ).
As this project is based on openFrameworks, one of the goals is to offer as more objects as possible, using the pre-defined OF classes for trans-media manipulation (audio, text, image, video, electronics, computer vision), plus all the gigantic ofxaddons ecosystem actually available (machine learning, protocols, web, hardware interface, among a lot more).
While the described characteristics could potentially offer an extremely high complex result (OF and OFXADDONS ecosystem is really huge, and the possibility of multiple scripting languages could lead every unexperienced user to confusion), the idea behind the interface design aim at avoiding the "high complex" situation, embodying a direct and natural drag&drop connect/disconnet interface (mouse/trackpad) on the most basic level of interaction, adding text editing (keyboard) on a intermediate level of interaction (script editing), following most advanced level of interaction for experienced users (external devices communication, automated interaction, etc...)
Beats is a command-line drum machine. Feed it a song notated in YAML, and it will produce a precision-milled Wave file of impeccable timing and feel.
http://beatsdrummachine.com/tutorial/
http://tropone.de/2019/02/21/ungewoehnliche-wege-rhythmen-zu-programmieren-teil-2-beats-cl/
Open-source virtual modular synthesizer
https://vcvrack.com/manual/index.html
https://patchstorage.com/platform/vcv-rack/
https://community.vcvrack.com/
VCV was founded by Andrew Belt in 2016 and is based in Tennessee, USA. Its flagship product VCV Rack was released on September 10, 2017 at Knobcon after two years of development. It was based on an unreleased C++ modular audio engine written by Andrew in 2012.
Each letter of the alphabet is an operation, lowercase letters operate on bang, uppercase letters operate each frame. Orca is designed to control other applications, create procedural sequencers, and to experiment with livecoding. See the documentation and installation instructions here, or have a look at a tutorial video.
A
add: Outputs the sum of inputs.B
bool: Bangs if input is not empty, or 0.C
clock: Outputs a constant value based on the runtime frame.D
delay: Bangs on a fraction of the runtime frame.E
east: Moves eastward, or bangs.F
if: Bangs if both inputs are equal.G
generator: Writes distant operators with offset.H
halt: Stops southward operators from operating.I
increment: Increments southward operator.J
jumper: Outputs the northward operator.K
konkat: Outputs multiple variables.L
loop: Loops a number of eastward operators.M
modulo: Outputs the modulo of input.N
north: Moves Northward, or bangs.O
offset: Reads a distant operator with offset.P
push: Writes an eastward operator with offset.Q
query: Reads distant operators with offset.R
random: Outputs a random value.S
south: Moves southward, or bangs.T
track: Reads an eastward operator with offset.U
uturn: Reverses movement of inputs.V
variable: Reads and write globally available variables.W
west: Moves westward, or bangs.X
teleport: Writes a distant operator with offset.Y
jymper: Outputs the westward operator.Z
zoom: Moves eastwardly, respawns west on collision.*
bang: Bangs neighboring operators.#
comment: Comments a line, or characters until the next hash.:
midi: Sends a MIDI note.^
cc: Sends a MIDI CC value.;
udp: Sends a UDP message.=
osc: Sends a OSC message.enter
bang selected operator.shift+enter
toggle insert/write.space
toggle play/pause.>
increase BPM.<
decrease BPM.shift+arrowKey
Expand cursor.ctrl+arrowKey
Leap cursor.alt+arrowKey
Move selection.ctrl+c
copy selection.ctrl+x
cut selection.ctrl+v
paste selection.ctrl+z
undo.ctrl+shift+z
redo.]
increase grid size vertically.[
decrease grid size vertically.}
increase grid size horizontally.{
decrease grid size horizontally.ctrl/meta+]
increase program size vertically.ctrl/meta+[
decrease program size vertically.ctrl/meta+}
increase program size horizontally.ctrl/meta+{
decrease program size horizontally.ctrl+=
Zoom In.ctrl+-
Zoom Out.ctrl+0
Zoom Reset.tab
Toggle interface.backquote
Toggle background.Download the app here : https://hundredrabbits.itch.io/orca
Source code : https://github.com/hundredrabbits/Orca
Video tutorial : https://www.youtube.com/watch?v=RaI_TuISSJE
To test midi on Macosx : http://notahat.com/simplesynth
Activate the virtual Midi input on Macosx : https://help.ableton.com/hc/en-us/articles/209774225-Using-virtual-MIDI-buses
Pilot (another way to create music with orca from the same creators) :
Download the app here : https://hundredrabbits.itch.io/pilot
Source code : https://github.com/hundredrabbits/Pilot
A good explanation of the software in German : http://tropone.de/2019/03/13/orca-ein-sequenzer-der-kryptischer-nicht-aussehen-kann-und-ein-versuch-einer-anleitung/
Tapioca Toys Cardboard
Real-world interfaces built to play music, mold landscapes, draw… for kids & grown-ups.
The Cardboard Edition is the latest-born of our tapioca interfaces. We're introducing this compact, low-cost and low-tech version that's easy for us to mail and easy for you to build. All it does require is an iPhone, and not necessarily the latest kind: versions 5 to X are compatible. To learn more about the why and the how, visit our lab article.
ArchiveBox takes a list of website URLs you want to archive, and creates a local, static, browsable HTML clone of the content from those websites (it saves HTML, JS, media files, PDFs, images and more).
You can use it to preserve access to websites you care about by storing them locally offline. ArchiveBox imports lists of URLs, renders the pages in a headless, autheticated, user-scriptable browser, and then saves archive of the content in multiple redundant common formats (HTML, PDF, PNG, WARC) that will last long after the originals disappear off the internet. It automatically extracts assets and media from pages and saves them in easily-accessible folders, with out-of-the-box support for git repositories, audio, video, subtitles, images, PDFs, and more.
You don't need to write any code to create a simple story with Twine, but you can extend your stories with variables, conditional logic, images, CSS, and JavaScript when you're ready.
Twine publishes directly to HTML, so you can post your work nearly anywhere. Anything you create with it is completely free to use any way you like, including for commercial purposes.
Twine was originally created by Chris Klimas in 2009 and is now maintained by a whole bunch of people at several different repositories.
REXPaint is a powerful and user-friendly ASCII art editor. Use a wide variety of tools to create ANSI block/line art, roguelike mockups and maps, UI layouts, and for other game development needs. Originally an in-house dev tool used by Grid Sage Games for traditional roguelike development, this software has been made available to other developers and artists free of charge. While core functionality and tons of features already exist, occasional updates are known to happen.
With Multipaint, you can draw pictures with the color limitations of some typical 8-bit computer platforms. The screen formats supported are Commodore 64 high resolution, Commodore 64 multicolor, Commodore Plus/4 Hires, Commodore Plus/4 multicolor, ZX Spectrum, MSX 1 and Amstrad CPC0.
Multipaint features common drawing tools, color clash emulation, cut brushes, dither patterns, grid / snap, 20-step undo, spare page, magnify modes, direct executable export, export as source, import/export in native formats and much more.
Vuo is a kit for making a million different projects — apps, videos, prototypes, plugins, exhibits, live performance effects, and more. Even if you don't have programming experience, Vuo lets you build your own stuff for Mac.
Vuo is the Finnish word for flow, and that's what Vuo is about — supporting your creative flow. When you're creating, you want to focus on your ideas. You don't want to be distracted or frustrated trying to figure out how your tools work. Vuo helps you stay in the groove by making it easy to find the building blocks you want, put them together, and tweak your creation until it's just the way you want it.
Polycode is a C++ and Lua framework for building interactive applications. It is free, open source and cross-platform.
Field is a development environment for experimental code and digital art in the broadest of possible senses. While there are a great many development environments and digital art tools out there today, this one has been constructed with two key principles in mind:
Embrace and extend — rather than make a personal, private and pristine code utopia, Field tries to bridge to as many libraries, programming languages, and ways of doing things as possible. The world doesn't necessarily need another programming language or serial port library, nor do we have to pick and choose between data-flow systems, graphical user interfaces or purely textual programming — we can have it all in the right environment and we can both leverage the work of others and take control of our own tools and methods.
Live code makes anything possible — Field tries to replace as many "features" with editable code as it can. Its programming language of choice is Python — a world class, highly respected and incredibly flexible language. As such, Field is intensely customizable, with the glue between interface objects and data modifiable inside Field itself. Field takes seriously the idea that its user — you — are a programmer / artist doing serious work and that you should be able to reconfigure your tools to suit your domain and style as closely as possible.
Ezgif.com is simple online GIF maker and toolset for basic animated GIF editing. Here you can create, resize, crop, reverse, optimize, and apply some effects to gifs.
We call them "seeds". Each seed is a machine learning example you can start playing with. Explore, learn and grow them into whatever you like.
This channel was created for anyone that is curious about audio programming, digital signal processing (dsp) and creative coding- from the very basic concepts with no previous programming knowledge all the way up to building your own software instruments and applications in C++ with frameworks like Juce and openFrameworks.
PraxisLIVE
hybrid visual live programming
for creatives, for programmers, for students, for tinkerers
Imagine combining the best of Java or Processing with the best of visual node-based systems like Isadora, Quartz Composer or Node-RED;
imagine components defined like Processing sketches, so you're never constrained by what comes built-in; imagine forking components or creating new ones all while your project is running.
It's all a game of construction — some with a brush, some with a shovel, some choose a pen.
Jackson Pollock
…and some, including myself, choose neural networks. I’m an artist, and I've also been building commercial software for a long while. But art and software used to be two parallel tracks in my life; save for the occasional foray into generative art with Processing and computational photography, all my art was analog… until I discovered GANs (Generative Adversarial Networks).
Since the invention of GANs in 2014, the machine learning community has produced a number of deep, technical pieces about the technique (such as this one). This is not one of those pieces. Instead, I want to share in broad strokes some reasons why GANs are excellent artistic tools and the methods I have developed for creating my GAN-augmented art.
https://github.com/junyanz/pytorch-CycleGAN-and-pix2pix
https://people.eecs.berkeley.edu/~taesung_park/CycleGAN/datasets/
https://github.com/eriklindernoren/PyTorch-GAN
https://heartbeat.fritz.ai/introduction-to-generative-adversarial-networks-gans-35ef44f21193
https://github.com/nightrome/really-awesome-gan
https://github.com/zhangqianhui/AdversarialNetsPapers
https://github.com/io99/Resources
https://github.com/yunjey/pytorch-tutorial
https://github.com/bharathgs/Awesome-pytorch-list
https://old.reddit.com/r/MachineLearning
http://www.codingwoman.com/generative-adversarial-networks-entertaining-intro/
https://medium.com/@jonathan_hui/gan-gan-series-2d279f906e7b
https://www.youtube.com/channel/UC9OeZkIwhzfv-_Cb7fCikLQ/videos
https://www.youtube.com/watch?list=PLZHQObOWTQDNU6R1_67000Dx_ZCJB-3pi&v=aircAruvnKk
https://www.youtube.com/watch?list=PLxt59R_fWVzT9bDxA76AHm3ig0Gg9S3So&v=ZzWaow1Rvho
Repaint your picture in the style of your favorite artist.
About
Our mission is to provide a novel artistic painting tool that allows everyone to create and share artistic pictures with just a few clicks. All you need to do is upload a photo and choose your favorite style. Our servers will then render your artwork for you. We apply an algorithm developed by Leon Gatys, Alexander Ecker and Matthias Bethge. The website was originally created by Łukasz Kidziński and Michał Warchoł. We have now joined forces to provide you with the latest technology in even more accessible way.
Our Team
Five researchers from the Bethge lab at University of Tübingen (Germany), CHILI Lab at École polytechnique fédérale de Lausanne (Switzerland) and Université catholique de Louvain (Belgium).
processing_cheat_sheet_english.pdf
An anatomical case study of the Amazon echo as a artificial intelligence system made of human labor
Thoroughly updated, this fourth edition focuses on modern techniques used to generate synthetic three-dimensional images in a fraction of a second. With the advent of programmable shaders, a wide variety of new algorithms have arisen and evolved over the past few years. This edition discusses current, practical rendering methods used in games and other applications. It also presents a solid theoretical framework and relevant mathematics for the field of interactive computer graphics, all in an approachable style. New to this edition: new chapter on VR and AR as well
An open source machine embroidery design platform based on Inkscape.
Ink/Stitch aims to be a full-fledged embroidery digitizing platform based entirely on free, open source software. Our goal is to be approachable for hobbyists while also providing the power needed by professional digitizers.
RACHEL is a portable plug-and-play server which stores educational websites and makes that content available over any local (offline) wireless connection. RACHEL makes deploying a library of digital content as easy as pushing a button.
Then simply turn it on. While RACHEL is on, take your device and connect to "RACHEL" as you would any wifi network. Then open a web browser and type the web address (a number listed on the front sticker of your RACHEL).
Once you're connected to RACHEL, you can instantly access offline versions of the world's best free educational websites including Wikipedia, Khan Academy, and over 100 more.
Demo :
http://rachelfriends.org/previews/rachelpi_64EN_4.0/
http://rachelfriends.org/previews/rachelpi_64FR_3.0/
http://rachelfriends.org/previews/rachelpi_64ES_3.0/
Build your own here : http://rachelfriends.org/rachel-pi-howto.html
Use the idle time on your computer (Windows, Mac, Linux, or Android) to cure diseases, study global warming, discover pulsars, and do many other types of scientific research.
You can choose to support projects such as Einstein@Home, IBM World Community Grid, and SETI@home, among many others. If you run several projects, try an account manager such as GridRepublic or BAM! .
Copying an element from a photo and pasting it into a painting is a challenging task. Applying photo compositing techniques in this context yields subpar results that look like a collage --- and existing painterly stylization algorithms, which are global, perform poorly when applied locally. We address these issues with a dedicated algorithm that carefully determines the local statistics to be transferred. We ensure both spatial and inter-scale statistical consistency and demonstrate that both aspects are key to generating quality results. To cope with the diversity of abstraction levels and types of paintings, we introduce a technique to adjust the parameters of the transfer depending on the painting. We show that our algorithm produces significantly better results than photo compositing or global stylization techniques and that it enables creative painterly edits that would be otherwise difficult to achieve.
The Aziz! Light Crew Freeliner is a live geometric animation software built with Processing. The documentation is a little sparse and the ux is rough but powerfull.
Also known as a!LcFreeliner. This software is feature-full geometric animation software built for live projection mapping. Development started in fall 2013.
It is made with Processing. It is licensed as GNU Lesser General Public License. A official release will occur once I have solidified the new architecture developed during this semester.
Using a computer mouse cursor the user can create geometric forms composed of line segments. These can be created in groups, also known as segmentGroup. To facilitate this task the software has features such as centering, snapping, nudging, fixed length segments, fixed angles, grids, and mouse sensitivity adjustment.
Chataigne is made with one goal in mind : create a common tool for artists, technicians and developers who wish to use technology and synchronize softwares for shows, interactive installations or prototyping. It aims to be as simple as possible for basic interactions, but can be easily extended to create complex interactions
Modular Video Plugins for Ableton Live
VIZZable is developed with love and released free to the community in the hopes of advancing the art of live audio-visual performance. If you get something out of VIZZable, please give something back to support its development.
All the bandcamp album made with Pure Data.
MoviePy is a Python module for video editing, which can be used for basic operations (like cuts, concatenations, title insertions), video compositing (a.k.a. non-linear editing), video processing, or to create advanced effects. It can read and write the most common video formats, including GIF.
Wildfire is a free and user-friendly image-processing software, mostly known for its sophisticated flame-fractal-generator. It is Java-based, open-source and runs on any major computer-plattform. There is also a special Android-version for mobile devices.
Spek (IPA: /spɛk/, ‘bacon’ in Dutch) helps to analyse your audio files by showing their spectrogram. Spek is free software available for Unix, Windows and Mac OS X.
Features
Supports all popular lossy and lossless audio file formats thanks to the FFmpeg libraries.
Ultra-fast signal processing, uses multiple threads to further speed up the analysis.
Shows the codec name and the audio signal parameters.
Allows to save the spectrogram as an image file.
Drag-and-drop support; associates with common audio file formats.
Auto-fitting time, frequency and spectral density rulers.
Adjustable spectral density range.
An extensive and extendable painting application with an extensive range of features, including: both bitmap and vector graphics; multiple layers; five kinds of color picker; patterns, textures, and gradients; dashed lines and arrowheads; a spirograph generator; and even a cellular automaton tool (pictured below).
Gifski converts video frames to GIF animations using pngquant's fancy features for efficient cross-frame palettes and temporal dithering. It produces animated GIFs that use thousands of colors per frame.
Release : https://github.com/ImageOptim/gifski/releases
Usage
I haven't finished implementing proper video import yet, so for now you need ffmpeg to convert video to PNG frames first:
ffmpeg -i video.mp4 frame%04d.png
and then make the GIF from the frames:
gifski -o file.gif frame*.png
See gifski -h for more options. The conversion might be a bit slow, because it takes a lot of effort to nicely massage these pixels. Also, you should suffer waiting like the poor users who will be downloading these huge files.
Fractorium and its associated command line tools can render fractal flames using the CPU, or OpenCL. In order to use OpenCL, you must have an nVidia card that has the Fermi architecture or later, or a recent AMD card. If you attempt to use an unsupported card, you will receive an error message and the CPU renderer will be used instead.
Chaotica is a next-generation fractal art application, designed for both novices and professional artists.
Novice users can enjoy editing randomised fractals to produce stunning HD wallpapers and animations.
Professional users will particularly value the fast, modern rendering engine. High quality animations and huge images for print are easily produced, with real-time imaging controls that will dramatically accelerate your workflow.
What is fractal art?
Fractal art is a digital art medium with a very rich creative space, based on geometry and recursion.
Chaotica's user interface abstracts much of the maths away to provide a fluid artistic process.
Since its invention in 1981, IFS fractals have been popularised by Flam3 and Apophysis. Chaotica extends the creative possibilities of these programs in a powerful, production-oriented environment.
Some example here : https://www.tfmstyle.com/fractality-project
SpaceEngine is a realistic virtual Universe you can explore on your computer. You can travel from star to star, from galaxy to galaxy, landing on any planet, moon, or asteroid with the ability to explore its alien landscape. You can alter the speed of time and observe any celestial phenomena you please. All transitions are completely seamless, and this virtual universe has a size of billions of light-years across and contains trillions upon trillions of planetary systems. The procedural generation is based on real scientific knowledge, so SpaceEngine depicts the universe the way it is thought to be by modern science. Real celestial objects are also present if you want to visit them, including the planets and moons of our Solar system, thousands of nearby stars with newly discovered exoplanets, and thousands of galaxies that are currently known.
This is the official on-line repository for the code from the Graphics Gems series of books (from Academic Press). This series focusses on short to medium length pieces of code which perform a wide variety of computer graphics related tasks. All code here can be used without restrictions. The code distributions here contain all known bug fixes and enhancements.
Embroidermodder is a free machine embroidery software program which allows editing, scaling, and translating sewing machine embroidery files to a variety of formats. It allows the user to add custom modifications to their embroidery designs.
The user interface has been written from scratch using C++. It harnesses the powerful Qt framework to achieve platform independence. The 3 major desktop operating systems (Windows, Mac and Linux) will be targeted.
In addition to the desktop, it already works with the Raspberry Pi and we have a working demo of our code running on an Arduino. This will pave the way for low cost open source embroidery machines. We would also like to collaborate with the creators of the Smoothieboard so anyone who has one of those boards could also benefit from our work.
Very few other embroidery applications are cross-platform, with most only able to natively run on Windows. Our interface is very consistent across all platforms we support so there is no need to re-learn the interface when using it on a different operating system.
The interface itself is a CAD/CAM software but tailored for embroidery. This is intentional since both CAD and embroidery use vector formats and the embroidery machines are really just specialized CNC equipment (I.E. 3D Printers, CNC Laser Cutters, CNC Routers, CNC Lathes). So if you are interested in or familiar with CAD/CAM, then it will be possible to use it in that fashion also.
The interface is very similar to existing CAD applications so existing CAD users should be able to start using it immediately with little or no learning curve. It also incorporates additional features which are typically present in less precise graphics applications, such as the auto-adjusting ruler and an easily accessible undo history.
The first commercially available brainwave to synthesizer (both CV and MIDI) interface on the worldwide market.
By using the Neurosky Mindwave headset you can coax your brain activity to change every parameter of sound, light and video devices in your performance or studio.
PatterNodes is a procedural design to for creating graphical patterns, animations or illustrations based on repetitions. This is done by defining a sequence of steps that describes the design, using nodes and connections between them. PatterNodes is designed from the start to make it easy to tweak things to see how they turn out. Therefore the resulting design output is always shown in the bottom preview view, repeated for patterns and updating in real time with any changes, giving you instant feedback of what the end result will be.
While the software can be used to create many types of illustrations and animations it's primarily aimed at pattern creation. To make pattern creation easier PatterNodes also includes a lot of nodes that automatically perform common tedious tasks like repeating elements at the tile edges to make the pattern seamless, or randomizing different aspects (like color, position, rotation..) of the elements in a pattern to give it a little more life.
https://creativepro.com/review-patternodes/
https://www.behance.net/lostminds
Lumen is a Mac App that makes it easy for you to create engaging visuals in real time. Use the same process with Lumen as you would with a hardware video synth, but with modern features only software can provide. With a semi-modular design that is both playable and deep, Lumen is the perfect way to get into video synthesis.
A free and open-source intermedia sequencer
Enables precise and flexible scripting of interactive scenarios. Control and score any OSC-compliant software or hardware : Max/MSP, PureData, OpenFrameworks, Processing...
An open source collection of 20+ computational design tools for Clojure & Clojurescript by Karsten Schmidt.
In active development since 2012, and totalling almost 39,000 lines of code, the libraries address concepts related to many displines, from animation, generative design, data analysis / validation / visualization with SVG and WebGL, interactive installations, 2d / 3d geometry, digital fabrication, voxel modeling, rendering, linked data graphs & querying, encryption, OpenCL computing etc.
Many of the thi.ng projects (especially the larger ones) are written in a literate programming style and include extensive documentation, diagrams and tests, directly in the source code on GitHub. Each library can be used individually. All projects are licensed under the Apache Software License 2.0.
Open Stage Control is a libre desktop OSC bi-directionnal control surface application. It's built with HTML, JavaScript & CSS on top of Electron framework
Download here : https://github.com/jean-emmanuel/open-stage-control/releases
PabloDraw is an Ansi/Ascii text and RIPscrip vector graphic art editor/viewer with multi-user capabilities.
Artificial Neural Networks have spurred remarkable recent progress in image classification and speech recognition. But even though these are very useful tools based on well-known mathematical methods, we actually understand surprisingly little of why certain models work and others don’t. So let’s take a look at some simple techniques for peeking inside these networks.
We train an artificial neural network by showing it millions of training examples and gradually adjusting the network parameters until it gives the classifications we want. The network typically consists of 10-30 stacked layers of artificial neurons. Each image is fed into the input layer, which then talks to the next layer, until eventually the “output” layer is reached. The network’s “answer” comes from this final output layer.
One of the challenges of neural networks is understanding what exactly goes on at each layer. We know that after training, each layer progressively extracts higher and higher-level features of the image, until the final layer essentially makes a decision on what the image shows. For example, the first layer maybe looks for edges or corners. Intermediate layers interpret the basic features to look for overall shapes or components, like a door or a leaf. The final few layers assemble those into complete interpretations—these neurons activate in response to very complex things such as entire buildings or trees.
One way to visualize what goes on is to turn the network upside down and ask it to enhance an input image in such a way as to elicit a particular interpretation. Say you want to know what sort of image would result in “Banana.” Start with an image full of random noise, then gradually tweak the image towards what the neural net considers a banana (see related work in [1], [2], [3], [4]). By itself, that doesn’t work very well, but it does if we impose a prior constraint that the image should have similar statistics to natural images, such as neighboring pixels needing to be correlated.
Automatic Cinema aims at an artistic audience. The software can be used for exhibitions or installations, where a variety of media are served on various screens and channels – syncronized or not. Since all media assets are stored in a database, Automatic Cinema is also useful for documentarists and researchers with a structural approach to their material. And last but not least, Automatic Cinema is open source and can be developed by anybody. Instead of cutting a bunch of videoclips the hard way, Automatic Cinema generates countless versions based upon predefined styles. Probably, you'll end up seeing a movie you've never been thinking of — serendipity in it's best way.
Playscii is an open source ASCII art program, the successor to EDSCII. It runs on Windows and Linux, and will run on Mac OSX soon after a bit more work.
More info: http://vectorpoem.com/playscii/
Please note that Playscii is open source, still in early development, and is offered as a pay-what-you-want download here on itch. Testing and bug reports are appreciated!
Echo Nest Remix is the Internet Synthesizer. Make amazing things from music, automatically.
Turn any music or video into Python or JavaScript code.
Echo Nest Remix lets you remix, re-edit, and reimagine any piece of music and video, automatically and algorithmically.
Remix has done the following: played a song forever, walkenized and cowbellized hundreds of thousands of songs in a week, reversed basically everything, beat matched two songs, split apart DJ mixes by their individual tracks, made new kinds of video mashups, corrected sloppy drumming, synced video to a song, transitioned between multiple covers of the same song, made a cat play piano, and taught dogs to play dubstep. Check out all the examples here.
Remix is available as an open source SDK for you to use, for Mac, Linux, and Windows:
Install for Python: sudo pip install remix
. Full installation details, packages for Mac and Windows, and complete Python documentation are here.
Try JavaScript: Test out remix.js here.
Download JavaScript: remix.js. Full JavaScript install details and documentation are here.
Fragmentarium is an open source, cross-platform IDE for exploring pixel based graphics on the GPU. It is inspired by Adobe's Pixel Bender, but uses GLSL, and is created specifically with fractals and generative systems in mind.
We describe a novel algorithm for extracting a resolution-independent vector representation from pixel art images, which enables magnifying the results by an arbitrary amount without image degradation. Our algorithm resolves pixel-scale features in the input and converts them into regions with smoothly varying shading that are crisply separated by piecewise-smooth contour curves. In the original image, pixels are represented on a square pixel lattice, where diagonal neighbors are only connected through a single point. This causes thin features to become visually disconnected under magnification by conventional means, and it causes connectedness and separation of diagonal neighbors to be ambiguous. The key to our algorithm is in resolving these ambiguities. This enables us to reshape the pixel cells so that neighboring pixels belonging to the same feature are connected through edges, thereby preserving the feature connectivity under magnification. We reduce pixel aliasing artifacts and improve smoothness by fitting spline curves to contours in the image and optimizing their control points.
Spacebrew is an open, dynamically re-routable software toolkit for choreographing interactive spaces. Or, in other words, a simple way to connect interactive things to one another. Every element you hook up to the system is identified as either a subscriber (reading data in) or a publisher (pushing data out). Data is in one of three standardized formats: a boolean (true/false), a number range (0-1023) or a string (text); it can also be sent as a custom format you specify. Once these elements are set up, you can use a web based visual switchboard to connect or disconnect publishers and subscribers to each other.
Rekall est un logiciel destiné à l’ensemble des arts de la scène (théâtre, danse, musique, cirque, marionnettes, performance…) et aux installations interactives.
Rekall permet de :
Rekall est conçu pour :
Rekall documente un spectacle à plusieurs moments de sa vie :