Abstract

The purpose of this page is to begin identifying common audio/video tasks and develop workflows for those tasks.

Not only will this improve and qualify the quality of application selection set included in Ubuntu Studio, but it will also help develop documentation framework for users to understand how to accomplish these tasks.

Please feel free to use whatever form you wish to add ideas. This page is purely for development work.

To view how the workflows effect package selection please see the Package Selection Development page. Please do not edit the Package Selection page unless you are a Ubuntu Studio Developer!

Audio Tasks

Recording and Editing

Simple recording of concert, conversation etc

Explanation - Simple recording of incoming signals (analog or digital) down to disk. Typical application would be recording of a concert. No low-latency is needed here, so Jack might be overkill (unless a FW card is used).

Applications Used - Audacity (as an alternative, qarecord?)

Workflow

• start Audacity
• setup Audacity to use the right inputs and the right filename
• click "record"

Recording Live Instruments with Software Drum Machine

Explanation - Typically this workflow would be used to record common instruments such as electric guitars, basses, and vocals with drum accompaniment provided by Hydrogen.

Requirements - All instruments would require a way to bring their signal to line level (e.g. effects pedal for guitar, pre-amp for vocals) and any effects would need to be provided by dedicated hardware (e.g. effects pedal) for this example.

Applications Used - JACK, qjackctl, Ardour, Hydrogen

Workflow

• start JACK with qjackctl
• start Ardour
• start Hydrogen
• using qjackctl route line level signal from computer input to Ardour
• using qjackctl route Hydrogen drums to Ardour
• record live instrument and Hydrogen with Ardour

Further Information - http://www.ardour.org http://www.hydrogen-music.org

Record Live Instruments with Effects

Explanation - Users can record live instruments with effects. There are several possible workflows.

Requirements - All instruments would require a way to bring their signal to line level (e.g. effects pedal for guitar, pre-amp for vocals) and any effects would need to be provided by dedicated hardware (e.g. effects pedal) for this example.

Applications Used - JACK, qjackctl, Ardour, Rakarrack, Guitarix, LADSPA, LV2, CALF, CALF plugin rack, JackRack, LV2rack

Workflow
Workflow #1 - plugins in Ardour

• start JACK with qjackctl
• start Ardour
• using qjackctl route line level signal from computer input to Ardour
• add LADSPA/LV2 effect in the mixer pre-channel or post-channel plugin regions in Ardour
• record live instrument with applied effects in Ardour

Workflow #2 - plugins in JackRack/LV2Rack/CALF plugin rack

• start JACK with qjackctl
• start Ardour

• start JackRack or LV2rack or CALF plugin rack

• using qjackctl route line level signal from computer input to JackRack or LV2rack or CALF plugin rack

• using qjackctl route signal from JackRack or LV2rack or CALF plugin rack to Ardour

• record live instrument with applied effects in Ardour

Mix a Song

Explanation - Users can prepare a song mix by adjusting levels, panning, and adding effects before exporting the song with this workflow.

Requirements - N/A

Applications Used - JACK, qjackctl, Ardour, Rakarrack, Guitarix, LADSPA, LV2, CALF, JackRack, LV2rack

Workflow

• start JACK with qjackctl
• start Ardour
• load song to be mixed in Ardour
• open mixer in Ardour
• adjust stereo panning and levels while song is playing back (automation is available for both)
• effects can be added into Ardour's mixer pre-channel or post-channel effects region

• effects can be added by routing out of Ardour to JackRack, LV2rack or CALF plugin rack and back into Ardour

• export song as stereo file

Master a Album

Explanation - Users can master an album using EQ, limiters, compression and adjusting levels with this workflow.

Requirements - CD burner

Applications Used - JACK, qjackctl, Ardour, JAMin, GCDMaster

Workflow

• start JACK with qjackctl
• start Ardour
• start JAMin
• create a new project in Ardour
• load pre-mixed songs (separate songs should go sequentially on different tracks)
• route Ardour out to JAMin and back into Ardour
• play all songs through Ardour and JAMin adjusting EQ, limiting, and compression as necessary on a per song basis
• levels can also be adjusted for an inter-song consistency on a per song basis
• create two "final master" tracks in Ardour
• play all songs through JAMin and record on "final master" tracks
• add CD markers
• export "final master" tracks to stereo file with CD markers
• start GCDMaster
• load "final master" export stereo file
• burn CD master

Song Creation & Synthesis

Create a Song with Hydrogen Drums

Explanation - Users can program drums for a song with this workflow. This might be a subset of recording live instruments with hydrogen drums.

Requirements - N/A

Applications Used - JACK, qjackctl, Hydrogen

Workflow

• start JACK with qjackctl
• start Hydrogen (Hydrogen L/R outputs should automatically connect to system outs)
• select preferred drum kit using drumkit manager
• create first drum pattern in drum pattern editor
• create additional drum patterns as necessary
• create song structure in song editor by selecting drum patterns in the song editor matrix

Sequencing music using MIDI

Explanation - This workflow is used to produce music using MIDI sequencing, using either software synths, or external MIDI hardware. MIDI sequencing is used in a wide range of music styles.

Requirements - For a software-only setup, the only requirement is a JACK-compatible sound card. With external MIDI equipment, a compatible MIDI interface is required, unless using USB-based MIDI equipment. MIDI input devices, such as keyboards, are not required, but may be very useful for recording MIDI parts live.

Applications Used - JACK, qjackctl, Qtractor, Ardour (optional), software synths (ie: FluidSynth/Qsynth, LinuxSampler, XSynth, WhySynth, PHASEX, ZynAddSubFX/Yoshimi, Specimen, Hydrogen)

Workflow

• start JACK with qjackctl
• start any external JACK synths used
• start Qtractor
• if using an external MIDI input device, connect it to Qtractor's MIDI input using either Qtractor's internal UI, or qjackctl
• within Qtractor, create MIDI buses for any external synths (JACK or harware MIDI) used, and connect each to the relevant synth
• within Qtractor, create new MIDI tracks and either set their outputs to your various MIDI buses, or add DSSI instrument plugins to them
• record/create/edit MIDI parts, using external MIDI input device and the Qtractor piano-roll editor
• (optionally) bounce the completed parts in to an Ardour session for mixing

Audio Programming & Notation

Notating a Simple Composition

Explanation - Users can write notes onto virtual paper (then print them to real paper) to have musicians play their work. This workflow is best suited to simple or traditional compositions.

Requirements - N/A

Applications Used - MScore

Workflow

• Open MScore
• Select New Score
• Fill in all info needed
• Begin Writing Music
• Save often
• Print when finished

Further Information - http://musescore.org/

Notating a Complex Composition

Explanation - Users can write notes onto virtual paper (then print them to real paper) to have musicians play their work. This workflow is best suited to complex or contemporary compositions.

Requirements - N/A

Applications Used - Lilypond, Frescobaldi

Workflow

• Open Frescobaldi
• Write Lilypond code into the editor pane, checking its layout in the presentation pane
• Save often
• When finished, export the song to PDF for printing

Further Information - http://frescobaldi.org/ http://lilypond.org

Coding and Live use of Pure Data for Audio

NOTE:** Pd is a very powerful application, it allows to accomplish very different tasks, from realtime audio to realtime video interactivity, from OSC communication to physical computing interactivity. Whit this in mind, it is very difficult to create a Workflow that can really exemplify Pd capabilities. User "research" is advised :D**

Explanation - Pure Data (also known as Pd) is a graphical programming environment for audio and graphics processing. Pd's audio functions are built-in whereas its graphical computations require separate packages such as gem (Graphics Environment for Multimedia) or pd-pdp (Pd Packet). With Pd you can create you own effect, arpeggiator, algorithm music, interface with hardware like arduino, use OSC and MIDI or even TCP/IP as communications interface. Pd its a powerful tool for everyone wanting to "dig" into the ins and outs of digital audio. Video example: http://www.youtube.com/watch?v=Pq0vSBT-fbc

Requirements - Depending on what you want to do, you will need a powerful set of hardware if you want to do live effects in concert if you use intensive CPU on Pd. It can run on any machine "almost".

Applications Used - Pd aka Pure Data (or Pd Extended from puredata.info), JACK (not mandatory, but preferred), QJackctl/patchage

Workflow - Open Pd, open a new canvas, lay objects on the blank canvas and connect them together correctly, if using audio signals or effects, check the compute audio checkbox and listen to the result. If using control programming only (for instance MIDI, OSC, etc) no need to do anything more besides connecting the midi out to the Synth/application desired.

*pd can run in RT

Further Information - http://puredata.info

Experimental Synthesis Composition

Explanation - Users can work on both low level and experimental models of synthesis in both live and pre-composed forms.

Requirements - N/A

Applications Used - CSound, jack (optional), celia (optional)

Workflow

• Start Jack
• Open text editor (or celia, an editor designed specifically for CSound)
• Write CSound score and orchestra files
• Execute code

Further Information - http://www.csounds.org

Live Coding

Explanation - Users can perform live by writing and running code on the fly.

Requirements - A modern processor.

Applications Used - ChucK, Jack (optional)

Workflow

• Optionally (but recommended) practice, practice, practice
• Optionally (but recommended) show your screen to the audience by way of projector
• Start Jack (optional)
• Open two terminals
• Start ChucK looping in one terminal
• Edit code and chuck it to the currently running VM in the other terminal

Further Information - http://chuck.cs.princeton.edu/

Professional Playback

DJ a set with a Software-Only setup

Explanation - Users can DJ a professional mixed set using their computer and a collection of digital music files (or CDs if their computer has an optical drive).

Requirements - A music collection

Applications Used - Mixxx, Jack (optional)

Workflow

• Optionally start Jack
• Open Mixxx
• Start deck 1 playing
• Mix deck 2's song in and deck 1's song out
• Repeat last step, swapping deck order each time

More Information - http://mixxx.org

DJ with Turntables or CDDJs linked to a digital music library

Explanation - Users can use their turntables or CDDJs with special timecoded vinyl or CDs to control playback of their digital music collection.

Requirements - At least a 4-in & 4-out soundcard, timecoded vinyl that works with xwax (check their website for more info), phono preamps to bring your turntables up to line-level before the soundcard (not needed for CDDJ setup)

Applications Used - Xwax, Jack (optional)

Workflow

• start Jack (optional)
• start xwax with proper parameters (read the xwax website for full explanation before starting)
• connect the inputs and outputs of xwax to the ins/outs of your soundcard via jack
• check that the timecodes are working for all of your turntables/CDDJs
• begin mixing

Further Information - http://www.xwax.co.uk

Run a professional radio station

Explanation - Users can run an entire professional broadcast on their computer.

Requirements - N/A

Applications Used - Rivendell (needs packaging)

Worflow

• Research Rivendell to fully understand what the program is/does

• If it fits for you, try the Ubuntu Rivendell Live CD at http://rivendell.tryphon.org/wiki/Ubuntu_Live_Demo_and_Installer_CD

• Install & Run Rivendell

Further Information - http://rivendellaudio.org

Run an internet radio station

Video Tasks

Create Video for Web

Explanation - Users can import, trim, arrange video clip, add music, and add transitions to make a video to be hosted on the web (including YouTube, Vimeo, et al).

Requirements - Hardware to import video to computer from camcorder/video recorder

Applications Used - Blender, ffmpeg (might need Kino to import DV video?)

Workflow

• import video to computer (many camcorders can be accessed as mass storage devices and files can simply be copied to computer)
• Kino might be needed to import DV video (this needs qualifying)
• start Blender
• select Sequence layout from layout menu
• make sure frames per second is set to match your camcorder/video recorder
• add video clip and anchor it in desired track
• add additional video clips and anchor as required to other tracks
• trim tracks as required
• add music track (if desired)
• add other sound effects (if desired)
• reposition tracks as required
• add transitions
• playback video and make any revision as needed
• select export format
• moderate export settings
• select video and audio codecs
• moderate video and audio settings
• select "Do Sequence"
• change export name (unless you like the default)
• adjust "start" and "end" frame range
• pick the "Animate" button to export (render) the movie

Create DVD of Home Movies

Explanation - Users can import, trim, arrange video clips, and add transitions to make a home video. The video can then be authored and burned to a DVD

Requirements - Hardware to import video to computer from camcorder/video recorder

Applications Used - Openshot, QDVDAuthor, K3b

Workflow

• import video to computer (many camcorders can be accessed as mass storage devices and files can simply be copied to computer)

• start OpenShot

• add clips
• trim clips
• position clips
• add transitions
• render video
• start QDVDAuthor
• add menu image
• create menu buttons (text or images)
• bring video clips into QDVDAuthor
• associate video clips with menu buttons
• add transition effects
• export DVD file structure
• start K3b
• burn DVD from exported file structure

Create Audio Clips and Sound Effects for Videos

Explanation - Trim existing audio files to create sound effects or audio clips for videos

Requirements - Existing audio files from which to trim sound effects or audio clips

Applications Used - Audacity

Workflow

• start Audacity
• open audio file
• locate desired clip
• highlight and trim the preceding, undesired audio
• highlight and trim the following, undesired audio
• save new audio clip

Create Green Screen Video

Explanation -

Requirements -

Applications Used - Blender

Workflow

• to do

Create Picture in Picture Video

Explanation -

Requirements -

Applications Used - Blender

Workflow

• to do

Creating a Soundtrack for an existing Video (Post-Production)

Explanation - Users can import a video clip, add music, sound-effects and voices, master the soundtrack and integrate it in a new video-file.

Requirements - Hardware and Software capable to playback and manipulate audio and video with less then 10 Milliseconds latency

Applications Used - Avidemux, OpenMovieEditor, Qtractor, Ardour, plug-ins in LADSPA, DSSI and LV2 as desired.

Workflow

• import the videofile to Avidemux and export its given sound track to a wav-file
• start jackd with qjackctl
• start Open Movie Editor and load the video, mute its original soundtrack
• start Qtractor to compose music in MIDI-tracks(audio-outputs may be samplers like Specimen or Fluidsynth and/or softwaresynths like CALF). It is also possible to import MIDI-files made by other project-members to be integrated in the movie-soundtrack. OME and Qtractor are synchronized via jack-transport, the user can move the cursor in one app and the cursor in the other will follow. Thus the MIDI-music can be composed exactly as desired for the scenes in the video.
• start Ardour and import the soundtrack exported with Avidemux. Select "Jack" as clock-source.
• OME, Qtractor and Ardour will run in sync now(share their timelines). The user can record the MIDI-Tracks from Qtractor and more sounds and music from internal software in Jack or via microphones or instruments from the soundcard in Ardour. Voices can be recorded and arranged in several tracks, all in sync with the video-timeline in OME.
• Using the automation in Ardour the user can apply dynamic stereo-effects, room-modelling and transitions according to movements in the video.
• Mixing the soundtrack may or may not be done with the video still open. The mastering, whatsoever can be done after closing Qtractor and Open Movie Editor to get the most of the available hardware-performance available. Mastering can even be done in a professional studio rented exluselively for that purpose.
• after the soundtrack is mastered, it can be exported to a wav-file. This file can be imported to Open Movieeditor to replace the original soundtrack.
• the completed movie may be exported as a video-file from Open Movie Editor.

Remark: Soundtracks with more then just 2 channels are perfectly possible with Ardour. Ardours master-track can have up to 8 outputs. There are no authoring-applications though for muxing video with mulitichannel-soundtracks certified as 5.1, Dolby Surround and the like available for Linux. If more than stereo is demanded, the user can deliver 5 or more MONO-WAV-files to be put together in a certified authoring-system.

Graphics Tasks

Sketching Images

Explanation - To make art through use of a graphics tablet.

Requirements - Graphics Tablet

Applications Used - Inkscape or Gimp

Workflow

• Open Inkscape
• Enable presure sensitivity
• Zoom in to acceptable level
• Select the caligraphy tool
• Select your desired preset option (i.e. brush)
• Draw using your graphics tablet
• Select the document properties and resize to fit to your art's size.
• Save the svg of your finished drawing.
• Export as a png for upload into online galleries.

Make a Flyer

Explanation -

Requirements -

Applications Used - Inkscape

Workflow

• to do

Resize/Trim Image

Explanation -

Requirements -

Applications Used - GIMP

Workflow

• to do

Miscellaneous Tasks

Podcasting

Record an Interview

Explanation -

Requirements -

Applications Used - mumble (?)

Workflow

• to do

Stream a Podcast

Explanation -

Requirements -

Applications Used - JACK, DarkIce

Workflow

• to do

Edit Audio

Explanation -

Requirements -

Applications Used - Audacity

Workflow

• to do

Live Music/Video

Live Video

Explanation -

Requirements -

Applications Used - possible applications: LiVES and freemix

Workflow

• to do

Live Music

Explanation -

Requirements -

Applications Used - possible applications: seq24, mixxx, terminatorx, xwax, sooperlooper

Workflow

• to do

Effects Box

Explanation -

Requirements -

Applications Used - JACK, qjackctl, Rakarrack

Workflow

• to do

User workflows

holstein

i have a presonus firepod. i like this device because it has 8 preamps and can be used easily with a desktop box, or in the field with a laptop. firewire support is key for my workflow. ALSO, in the field sometimes i use the firepod with JACK and ardour running in OSX on a macbook. i think its important to mention here how convenient it is to my workflow that i can pull the files created on OSX over to my linux desktop when i get back to the studio. i do mostly analog recording, although i have a USB MIDI keyboard and dabble a bit. i usually track in ardour using JACK for the routing, and mix with whatever plugins i need from the ones in the ubuntustudio meta-package or these http://www.linuxdsp.co.uk/download/index.html . i usually add a final mastering step using JAMin that i can undo if i want to have the tracks professionally mastered by someone else (not that JAMin is not up to the task, i just like to have someone else master when possible). when WIFI allows, i like to stream live shows. i have an icecast server. i have it running on a separate ubuntuserver box, but you can run the server and client on the same machine. there are several client options. darkice is a good one, and has JACK support now. i find http://butt.sourceforge.net/ to be easy ( see http://www.deadbeatguitarist.com/cgi-bin/blosxom.cgi/2010/04/10 ). i had a little trouble getting darkice JACK support using my firewire interface for some reason, so i started using netjack and jacktrip: i use 2 boxes, one with my firepod running jacktrip, and the other with just the dummy driver selected in JACK, also running jacktrip and darkice. i can imagine slaving plugins or softsynths off to a 2nd machine with the setup, and tests to this effect have been promising. there have been some other applications i have been fiddling with such as sooperlooper for a loop station rig, and something like rakarrack for a live effects processing rig.