The best book that I can reccomend for beginning folk music is Dave Mallinson's "Easy Peasy Tunes", which you can get from the Music Room, Hobgoblin and many other Folk orientated music shops.
Practically all the tunes that have been reccomended above are in this book, and if you prefer to at least part learn by ear, there is a CD with all the tunes on it to go with the book.
I have been teaching beginners and improvers from this book for the last ten years. The book centres on just 14 core notes, starting (surprise surprise) with "Twinkle Twinkle", and progresses to many all time favourite tunes including "Fanny Power", "Keep yer feet still Geordy hinny", "Three around three", "Salmon tails up the water", "Jimmy Allen", "Dingle Regatta", and "Jenny Lind"; which have been played in just about every gathering of folk musicians that I have attended over the last 50 years.
Inventor.