Please familiarise yourself with the forum rules & guidelines

Sample waveform visualization

31
JscottkJscottk Seattle

I've thought for a while that it would be really neat to be able to use the pad grid to visualize sample waveforms for editing on the fly.

It seems fairly straightforward to down-sample a waveform to the resolution of the Deluge's grid at a given zoom level and display it on the pads:

(Edit: simplified image.)

The above shows a waveform at four different zoom levels and the corresponding Deluge output with selection markers. I was thinking an accent color (orange in this case) could be useful for highlighting peaks.

Selection markers mapped to knobs could allow users to crop samples, and a highly granular zoom would allow people to identify zero crossings to avoid "click" sounds when playing back looped samples. Selection markers along with zooming and scrolling would also be useful for honing in on specific subsets of long samples that you want to play with further.

Does anyone else think this would be useful?

Post edited by Jscottk on

Comments

  • 2
    KelvinTKelvinT Hong Kong

    +1!

  • 0

    Thats could be awesome... visually, with this concept in mind there are lots of potential abilities :open_mouth:

  • 0
    muleskinnermuleskinner Bath, UK

    Nice idea!

    Noise, Noodles and Doodles: http://bit.ly/mrjonesthebutcher

  • 1
    VondragonnogginVondragonnoggin California, USA

    This would be cool.

    +1

    To be honest though, I don’t mind using numbers and my ears. Reminds me of my first start with samplers. Visual indicators would be great for slicing loops though. Much faster than numbers and ears.

  • 0
    OnoSendaiOnoSendai Berlin

    +1
    Wow, that would be amazing!

  • 1
    amiga909amiga909 Switzerland

    very nice visuals, thanks. would love to try out. it would look amazing for sure.
    yet it is hard to imagine it would be easy to navigate a 10s sample and look for zero crossings in fractions of a 1ms. just too many screens to scroll, too many zooming gestures. there is only so much you can do with a 128 pixel display.

    maybe it would be better if sample start & end would simply snap to zero crossings if desired. many audio editors offer a snap-to-zero-crossing (Logic, Cubase, ..)
    for example: turn param for normal operation in start and end edit. turn param and hold shift to snap to the nearest zero crossing.

  • -1
    JscottkJscottk Seattle
    edited June 6

    Good points, it could be really tricky to hone in on a specific zero crossing in a long sample. Agreed that snapping would be helpful. I really like the idea of enabling the snap if the user is holding a button while moving the selection markers.

    A few ideas for making navigation in this view a bit easier:

    • Tap on pads within two columns simultaneously to zoom in on the content within those two columns, or tap on a single pad to zoom into that column (so users can jump to 1/16 the zoom level of the current view with a single action). Tap "back" to go to the previous zoom/scroll level. [edit: every action in waveform view should be undo-able with the back button]

    • A progress marker could be used to show where in the sample it's at as it's playing back. A setting could allow for following the progress marker as it moves along the track, and if that were combined with a feature to make the progress bar persist after hitting stop it'd be useful for "riding" the sample to a specific spot, stopping it, and making more fine selections/edits.

    • The two selection markers (for setting start/end of sample) should be independently controllable and "jumpable" (IE at any given scroll/zoom I can jump either marker to the left/right of the screen and adjust it to wherever I want) so that it's always easy to make selections of the content that is visible on the grid at any given time. It'd be fun to control them together as well to scrub through samples.

    • Pressing and turning the <> knob could allow for continuous zooming in/out (with each tick of the knob perhaps corresponding to 2x higher zoom) of the leftmost content within the frame.

    • Turning <> could allow for scrolling left/right through the waveform at the current zoom level

    • Shift + turning <> knob could control position of leftmost selection marker, Shift + turning ^v knob could control position of rightmost selection marker. Shift + clicking down <> could "jump" the leftmost selection marker to the left of whatever view you're on, shift + clicking down ^v could jump the rightmost selection marker to the right edge of the view.

    Edit: I'm also thinking the visualization functionality wouldn't replace the "ears-first" way of doing things now, it'd simply exist as an alternative to the current scheme. So anyone who likes the current way of doing things shouldn't be hampered by this new functionality.

    Post edited by Jscottk on
  • 0
    JscottkJscottk Seattle
    edited June 12

    I was thinking today that it would be really cool to be able to edit amplitude values from waveform view. That would allow for drawing arbitrary waveforms and using those as the basis for new synth patches.

    Perhaps this could be implemented by holding shift and tapping on a pad within a column to change the amplitude of the audio within that column.

    Edit: I'm realizing for the above to work we'd need the ability to select an interpolation algorithm for generating the points between columns that are hidden by the low-res display. Ideally we'd be able to choose from step, linear, or quadratic interpolation for each column (although it'd suffice to have one algorithm across all columns).

    Post edited by Jscottk on
  • 0
    beakerbeaker Adelaide

    OMG .. yep !

  • 0

    Damn, would eat my hat if this ever got implemented. But goes to show how cool having this many pads is.

  • 0
    IcoustikIcoustik Norway

    Yeeeaahhh

  • 1

    maybe this method can also be used to display sample names - I really struggle with them on current display, although USB editor could also be a solution for sample file management

  • 0

    How does this make sound editing easier? The Resolution is awful so that everyone still needs the number display anyway while the feature itself is very complex.

    I'm strictly against introducing such huge new features. Remember that the Synthstrom guys need to maintain all this code. Don't make this device a feature creep.

  • 0
    JscottkJscottk Seattle
    edited June 15

    @Klaustrophil said:
    How does this make sound editing easier?

    Imagine you have a sample 10 seconds long and within it somewhere you've got a solo that you really like and some other junk that you want to discard (this is the situation I outlined in which you want to hone in on a subset of long sample for further tweaking). Currently your only option for trimming the sample is to listen to it play after you adjust the "start" value of the sample. It's kind of a "guess and check" process; you set the knob to a value, hope that the start value is where you want it to be, hit play, listen, determine that its wrong, adjust start value again, etc.

    For me, this process gets tedious real fast. One of the reasons is that I'll often perform more than one take in a single recording, so it can sound like I have the correct start when I really have just selected the start of a take that I want to discard.

    With a waveform visualization, I'd be able to immediately see where the full take begins because it'd be the longest segment of continuous audio in the sample. Instead of guessing and checking the start marker value over and over again, I could get my selection marker roughly where the correct take starts, and finely adjust it from there using the value knob or zooming + selecting.

    The point is that the ability to use your eyes to navigate this data allows for an "overview first, zoom/filter, details-on-demand" way of working (known as "Schneiderman's mantra") and fills a gap that makes other samplers attractive.

    The Resolution is awful so that everyone still needs the number display anyway while the feature itself is very complex.

    I wasn't imagining that the number display would be replaced/deprecated, just that it'd be augmented by the visualization. Honestly I don't think the basic functionality would be that complex to implement. If they can read waveform values directly, it should be straightforward to simply reduce the resolution of the data to the Deluge grid resolution. That could be performed with a single matrix transformation. The other features I brought up (such as zooming, drawing waveforms, etc) are just "nice to have" features that may not be worth the effort but are interesting to think about.

    I'm strictly against introducing such huge new features. Remember that the Synthstrom guys need to maintain all this code. Don't make this device a feature creep.

    The firmware is still in beta and my understanding is that they want this device to be the best it can be with the hardware they've released. I think that entails exploring some creative ways to utilize the pad grid to fill holes in functionality that other samplers have filled long ago.

    Edit:

    maybe this method can also be used to display sample names - I really struggle with them on current display, although USB editor could also be a solution for sample file management

    Absolutely, I was inspired a bit by this thread recently:
    http://forums.synthstrom.com/discussion/13/alphanumeric-kbd/p1

    Post edited by Jscottk on
  • 2
    darenagerdarenager Between a rack and a hardware place

    I like the idea, it would make fast coarse editing easier, it would be great to have a zero crossing LED in a bright contrasting colour, and a snap to zero crossing.

  • 4
    darenagerdarenager Between a rack and a hardware place

    Woohoo!

  • 2
    uliuli marseille

    Wow, so, this is really gonna be incredible and so much more intuitive when it comes to sample editing. I love it! Many thanks to Rohan and the team for always listening to the users wishes, expanding upon and even exceeding them in the most wonderful ways!

    Oh, and, while I'm at it, just my two cents on the visualization of the wave form:
    Since following this discussion from the beginning, I asked myself if the sample view should really show the whole amplitude or just the top half of it. If we take away the bottom half, the "baseline" would sit right at the bottom of the grid (instead of in the middle, as it is now). This would allow us to have 50% more vertical resolution - which will make it easier to visually differentiate volume levels.

    If you have a look at Soundclouds track visualization, it's a bit similar - they have opted for a vertically compressed bottom half (covered with avatar images), so the waveform effectively only shows the top half.

    Do you think this would be an improvement for the waveform visualization in the Deluge? Or do people generally need to see the whole amplitude to clearly identify their sampling zones? And would it be different for stereo and mono samples?

  • 3
    minigoatminigoat cincinnati ohio usa

    @robleighton22 said:
    Damn, would eat my hat if this ever got implemented. But goes to show how cool having this many pads is.

    **clears throat...slides the salt

  • 1

    Ask and ye shall receive! :D

    Noise, Noodles and Doodles: http://bit.ly/mrjonesthebutcher

  • 2
    darenagerdarenager Between a rack and a hardware place

    ^ I hope that we can have the option, also for stereo waves either/both channels, and the option to zoom amplitude as well as time, snap to zero, and waveform scrolling for long waves, finally I’d like to be able to save selected area as new sample.

    Don’t want much do I? :p

  • 0

    will this feature include ability to make slices from a loop and quickly assign the slices to a kit?

  • 0
    JscottkJscottk Seattle
    edited August 19

    This is amazing! The implementation looks great, and I really love the modifications they made to the design. Particularly tapping a marker and then tapping a column to move the marker is brilliant.

    I'm blown away that this is becoming a reality and can't wait to play with it =D

    Edit: @rean1mator: you can slice a sample to a kit and modify each slice with this view I believe

    Edit2: I'm super excited to use looping regions too, this next update is going to be fun.

    Post edited by Jscottk on
Sign In or Register to comment.