Want to make an 'interactive story'

I've always loved games, and I remember when I was young the only form of 'games' we had were choose your own adventure games.

I'd like to make one, but not in book form. I'm just wondering what the best way would be to make one that runs on a computer... and I'm sure it's super basic 'programming' if any at all, but I have little experience with computer so does anyone know how I could go about doing this?

edit: I know I can make one just using folders and stuff, but I'd like one that's an executable file... that you click to run and has button and stuff.

Adobe Flash may be your best bet. For the interactivity, you would ideally be using either ActionScript 2.0 or 3.0. It's a pretty basic programming language, I guess, but to tell you the truth, it still confuses the hell out of me. AS2 is easier to use than AS3, IMO, but it seems to produce much buggier results.

JAVA programming is fairly simple and is free. Adobe Flash costs money, but might provide options that are more suited for what you want.