Reply to this topicStart new topic
> Guitar Related Software / Website Project
sevenfx
post Oct 8 2011, 09:56 AM
Post #1


Learning Roadie
*

Group: Members
Posts: 16
Joined: 6-July 10
Member No.: 10.777



Hey guys,

Since this is my favorite guitar community online, I thought I'd ask you guys for ideas concerning a project. I'm a computer science graduate student getting ready to start a big project, and I'm hoping to find a good topic having to with audio processing or visualization of some kind.

I was thinking about making a realtime visualization of pitch, so you can see which notes you are hitting, when you are hitting them, and how they fit in the scales. If possible, I would make this 3D, so you could get more information out of it, dynamics, attack, decay, etc. Also, I would be trying to do this so it would work from the browser and you wouldn't have to download anything to use it. (In the future, maybe android phones would be supported).

I think a program like this would be helpful for beginnings and experienced players alike. What do you guys think? Any other ideas?
Go to the top of the page
 
+Quote Post
Ivan Milenkovic
post Oct 8 2011, 10:31 AM
Post #2


Instructor
Group Icon

Group: GMC Instructor
Posts: 25.396
Joined: 20-November 07
From: Belgrade, Serbia
Member No.: 3.341



That sounds interesting. What kind of visual representation did you have in mind? How should that look?


--------------------
- Ivan's Video Chat Lesson Notes HERE
- Check out my GMC Profile and Lessons
- (Please subscribe to my) YouTube Official Channel
- Let's be connected through ! Facebook! :)
Go to the top of the page
 
+Quote Post
thefireball
post Oct 8 2011, 11:11 AM
Post #3


Learning Roadie
*

Group: Members
Posts: 4.485
Joined: 9-March 10
From: United States, Arkansas
Member No.: 9.801



Wow - I wonder how that would work? Sounds interesting! And fun!


--------------------
Go to the top of the page
 
+Quote Post
Cosmin Lupu
post Oct 8 2011, 12:31 PM
Post #4


Instructor
Group Icon

Group: GMC Instructor
Posts: 22.808
Joined: 14-June 10
From: Bucharest
Member No.: 10.636



What is your work process on this project? I'm curious to know more details!


--------------------
Go to the top of the page
 
+Quote Post
Daniel Realpe
post Oct 8 2011, 04:23 PM
Post #5


Instructor
Group Icon

Group: GMC Instructor
Posts: 5.655
Joined: 11-October 09
From: Bogota
Member No.: 7.694



Here's a very basic version of what you want to do if I'm not mistaken



definitely you will involve MIDI to trigger every note, I think once you ensemble the template for the 12 chromatic notes then all you have to do is let MIDI trigger each note...maybe I'm oversimplifying it, but 3D! that should great! and helpful even to teach music


--------------------
Visit my:
INSTRUCTOR PROFILE

"If a composer could say what he had to say in words he would not bother trying to say it in music."
Gustav Mahler


Subscribe to my Youtube Channel here
Go to the top of the page
 
+Quote Post
Gabriel Leopardi
post Oct 8 2011, 08:26 PM
Post #6


Instructor
Group Icon

Group: GMC Instructor
Posts: 28.069
Joined: 3-March 07
From: Argentina
Member No.: 1.289



It's a very good idea. I would like to know more about it!


--------------------
My lessons

Do you need a Guitar Plan?
Join Gab's Army

Check my band:Cirse
Check my soundcloud:Soundcloud

Please subscribe to my:Youtube Channel
Go to the top of the page
 
+Quote Post
sevenfx
post Oct 8 2011, 10:41 PM
Post #7


Learning Roadie
*

Group: Members
Posts: 16
Joined: 6-July 10
Member No.: 10.777



Alright, I'll try to give you guys a little more in depth explanation of what I'm thinking smile.gif

Daniel - yes, that is similar to what I'm trying to achieve, but real time, and I'm not as focused on the midi output at this point. Basically, it would process the raw guitar input (as it comes in from a Line6 box, or microphone, or whatever). There is a program out there that does what I am trying to achieve already.. it's located here:

http://miracle.otago.ac.nz/tartini/

Like the video daniel posted, it shows the pitch that is being played while you are playing it, only its not broken into 12 notes. For example, you could see that you are bending a note from C up to D, and could analyze your vibrato. If you download that program you will see what I'm talking about. I find it very interesting to use while I practice.

Note for teachers: if you use this program, notice how it creates a "picture" of what you played. You could save this image, and students could strive to create a similar image to yours. Notes that were not bent to the correct pitch, or vibratos that were the wrong speed would be easy to see visually, and specific areas could be identified for practice.

As for the 3D aspect (my potential contribution to this project), think of Rockband or Guitar hero. You can see the sound as a time continuum, say moving from right to left. You will see the pitches as they move up and down (and possibly change color for different key parts of the scale, if you decide to select a specific key). In addition to pitches, you would be able to see the envelope in sound based on the amplitude of a frequency.

So if you're playing loud chords, you will see large notes appear, and playing softly would display a thin line. I would love to experiment with visualizing the attack, sustain, and decay of individual notes different ways.

When it comes to chords, and assuming it was possible, I'd love to be able to visualize the individual notes that make up the chord. Doing this based on the raw sound input is difficult, but could be a challenging enough problem to constitute my masters thesis smile.gif.

In addition (for those of you still reading), I'd like to add in beat detection, and rhythm analysis. Still not sure exactly how this would tie in.

For an example of how I'd deploy this sort of project on a website look at:
http://www.tree-axis.com/Ess/_examples/inputFFT/

This is just showing frequency information of a microphone, but if you have java run-times installed on your computer, you should see it react to microphone data without having to install anything else.


Does any of this make sense? I'm kind of rushed for explanations right now, but if you have any more specific questions or ideas let me know!

-john

Go to the top of the page
 
+Quote Post
Adrian Figallo
post Oct 9 2011, 04:15 AM
Post #8


Instructor
Group Icon

Group: GMC Instructor
Posts: 3.466
Joined: 24-October 09
From: lima peru
Member No.: 7.730



that looks great and all, but you know what is missing online?, a chromatic tuner, if you can somehow measure the pitch and dynamic of a note and put it into a graphical interface, you can have a tuner smile.gif.


--------------------


Check my Instructor Profile Rockers!
Got a Blog too!, www.adriantracks.com


Follow me on facebook and youtube!
-Facebook
-Youtube




Go to the top of the page
 
+Quote Post
sevenfx
post Oct 9 2011, 05:54 AM
Post #9


Learning Roadie
*

Group: Members
Posts: 16
Joined: 6-July 10
Member No.: 10.777



maybe i'll do that this week as an experiment!

i always use the one that comes with line6 gearbox software, but you have a good point smile.gif
Go to the top of the page
 
+Quote Post
Ivan Milenkovic
post Oct 9 2011, 03:46 PM
Post #10


Instructor
Group Icon

Group: GMC Instructor
Posts: 25.396
Joined: 20-November 07
From: Belgrade, Serbia
Member No.: 3.341



It makes great sense man, keep us updated about the project! smile.gif


--------------------
- Ivan's Video Chat Lesson Notes HERE
- Check out my GMC Profile and Lessons
- (Please subscribe to my) YouTube Official Channel
- Let's be connected through ! Facebook! :)
Go to the top of the page
 
+Quote Post
Sinisa Cekic
post Oct 9 2011, 09:47 PM
Post #11


Instructor
Group Icon

Group: GMC Instructor
Posts: 4.649
Joined: 15-October 08
From: Belgrade,Serbia
Member No.: 6.085



It looks promising man, just keep working smile.gif


--------------------
Go to the top of the page
 
+Quote Post
Cosmin Lupu
post Oct 9 2011, 09:56 PM
Post #12


Instructor
Group Icon

Group: GMC Instructor
Posts: 22.808
Joined: 14-June 10
From: Bucharest
Member No.: 10.636



QUOTE (sevenfx @ Oct 8 2011, 09:41 PM) *
Alright, I'll try to give you guys a little more in depth explanation of what I'm thinking smile.gif

Daniel - yes, that is similar to what I'm trying to achieve, but real time, and I'm not as focused on the midi output at this point. Basically, it would process the raw guitar input (as it comes in from a Line6 box, or microphone, or whatever). There is a program out there that does what I am trying to achieve already.. it's located here:

http://miracle.otago.ac.nz/tartini/

Like the video daniel posted, it shows the pitch that is being played while you are playing it, only its not broken into 12 notes. For example, you could see that you are bending a note from C up to D, and could analyze your vibrato. If you download that program you will see what I'm talking about. I find it very interesting to use while I practice.

Note for teachers: if you use this program, notice how it creates a "picture" of what you played. You could save this image, and students could strive to create a similar image to yours. Notes that were not bent to the correct pitch, or vibratos that were the wrong speed would be easy to see visually, and specific areas could be identified for practice.

As for the 3D aspect (my potential contribution to this project), think of Rockband or Guitar hero. You can see the sound as a time continuum, say moving from right to left. You will see the pitches as they move up and down (and possibly change color for different key parts of the scale, if you decide to select a specific key). In addition to pitches, you would be able to see the envelope in sound based on the amplitude of a frequency.

So if you're playing loud chords, you will see large notes appear, and playing softly would display a thin line. I would love to experiment with visualizing the attack, sustain, and decay of individual notes different ways.

When it comes to chords, and assuming it was possible, I'd love to be able to visualize the individual notes that make up the chord. Doing this based on the raw sound input is difficult, but could be a challenging enough problem to constitute my masters thesis smile.gif.

In addition (for those of you still reading), I'd like to add in beat detection, and rhythm analysis. Still not sure exactly how this would tie in.

For an example of how I'd deploy this sort of project on a website look at:
http://www.tree-axis.com/Ess/_examples/inputFFT/

This is just showing frequency information of a microphone, but if you have java run-times installed on your computer, you should see it react to microphone data without having to install anything else.


Does any of this make sense? I'm kind of rushed for explanations right now, but if you have any more specific questions or ideas let me know!

-john


There's a tuner from TC Electronics if I am not mistaken who can read a whole chord from a standard tuned guitar wink.gif Polytune - I think? Maybe you can use some stuff it has, in the conceptual way of course wink.gif


--------------------
Go to the top of the page
 
+Quote Post
sevenfx
post Oct 9 2011, 11:21 PM
Post #13


Learning Roadie
*

Group: Members
Posts: 16
Joined: 6-July 10
Member No.: 10.777



QUOTE (Adrian Figallo @ Oct 9 2011, 03:15 AM) *
that looks great and all, but you know what is missing online?, a chromatic tuner, if you can somehow measure the pitch and dynamic of a note and put it into a graphical interface, you can have a tuner smile.gif.


How about something like this: http://www.seventhstring.com/tuner/tuner.html

I'm working on getting one to work myself with a nicer graphical interface.. but this one will do the trick in the mean time
Go to the top of the page
 
+Quote Post

Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 


RSS Lo-Fi Version Time is now: 19th January 2017 - 03:25 AM