How I built an audio book reader for my nearly blind grandfather

audio-book-reader.md

#How I built an audio book reader for my nearly blind grandfather

Tweet this - Follow me

Last year, when visiting my family back home in Holland, I also stopped by my grand-parents. My grand-father, now 93 years old, had always been a very active man. However, during the presceding couple of months, he'd gone almost completely blind and now spent his days sitting in a chair. Trying to think of something for him to do, I suggested he try out audio books. After finally convincing him -- he said audio books were for sad old people -- that listening to a well performed recording is actually a wonderful experience, I realized the problem of this idea.

####The problem with audio devices and the newly blind. After my first impulse to jump up and go buy him an iPod Touch, I soon realized that, to use an iPod, or any audio device for that matter, one needs to be able to see the tiny controls. So I started looking at existing audio book solutions for the blind. A couple of things exist, but this market seems to be mainly targeted at people that still have a whole life of being blind ahead of them and are willing to invest time into learning very specific technologies. However, this was not my grand-father's situation. I worried that he would lose his motivation (of which he didn't have much left anyway at that point), so I needed to come up with something better. And since I hadn't found anything suitable that I could go out and buy, I would need to build it myself.

####Requirements

First of all, of course, whatever I was going to build needed to have an interface that didn't require (much) vision. Second, the controls needed to be intuitive and not require learning any completely new concepts. And last, if my grandfather paused a book, for however long, it would need to continue where he left off, even if the player had been without power.

I will describe in more detail below, but I ended up building a player that used my grandfathers very limited vision. However, it could easily be adapted for someone able to read braille. The player is built using a box the size of a 3 or 4 DVD boxes stacked on top of each other. Each audio book that is stored on the reader has a corresponding DVD box with the title of the book printed in very large letters on the front. When a "book" is placed on top of the reader, the reader starts playing the book. The reader has four large, bright colored buttons on the front with the following functions: pause, rewind 20 seconds, and two buttons that control volume.

###The used technologies

####Raspberry Pi At the heart of the player is a Raspberry Pi running Debian Wheezy. Getting Linux to play audio is very easy, so getting to audio books to play wasn't that much of a challenge. For playing audio, I used mpd, which is a daemon that runs a server that plays audio and that is controlled by sending it commands over TCP, a very reliable and easy to use network protocol.

What makes the Raspberry Pi interesting is not only that it's a tiny computer that runs Linux, but also that it has lots of I/O pins let you connect anything you can imagine (buttons, LEDs, but also serial communication devices). When writing a program for the Raspberry Pi, you'll be able to read from these pins and change the behaviour of your program accordingly. The small program I wrote to control the audio book player (available here) uses these pins to know when one of the buttons is pressed, and to know which book is placed on the reader. Based on these inputs, it communicates with the mpd server to start, stop, change book etc. etc.

####RFID Each of the DVD boxes that corresponds to one book, contains an RFID card (I used these). To read these cards, I connected an RFID card reader (I used this one but any reader will do) to one of the I/O pins that is able to do serial communication so my program knows which book to play. Each RFID card has its own unique ID, and each audio book is a series of MP3 files that have names starting with this ID.

####Getting the books on the reader I built the reader when I was back in Montreal (which is where I moved from Holland). When I finished the reader, I loaded it with ten books and sent it to my brother who lives a 10 minute walk from my grandparents. My brother took it to my grandfather and explained how it worked. Every time my grandfather finishes his books, my brother takes the reader home with him to connect it to his router. The reader, when powered up, will check for an internet connection, and if it finds one, it sends a message to my phone using Pushover containing my brother's IP address. I then connect to the reader from my laptop over SSH and copy new books to it.

####One year later

I spoke to my grandmother today because it's her birthday, and almost one year after having finished the reader, my grandfather still uses it daily, and proudly shows it to anyone who's visiting. He started requesting for music on it too, and whenever the reader is at my brother's, he's having a hard time not being able to use it. I'm so happy that this little project was able to give some pleasure to a person that's been so enormously important in my life. It's harsh to say it with these words, but when I saw him last year, I was afraid he was close to being bored to death, literally.

EDIT : I got a lot of requests for more technicals details on how I built it. I started writing everything down on my blog

@lucascaton thanks, updated!

Very cool. You might want to check out if you can get a membership for your grandfather for Bookshare (www.bookshare.org), which has a very large selection of audio books (mp3) that are free with a membership. Bookshare has an API that you could integrate your project with:
http://developer.bookshare.org

The API doesn't yet support mp3 download, but you could download the text and convert it to audio using a TTS library on the RPI.

This is amazing.

I, too, have a grandfather with very little vision -- his macular degeneration started degrading his sight about 10 years ago. Here in the United States, the Library of Congress, a central federal library system, has a fantastic program that provides free audiobook readers and audiobooks to blind people. I think he's read more since he went blind than he did before 😄

Your grandfather is very lucky to have your care and attention. Your design is great for an older person -- the physical manipulation of objects is, I think, a good metaphor for reading a book for someone who didn't grow up with computers, and a great interface for someone with very little vision.

Full Respects and Honours

An excellent example where our community based technology is put to good use. I congratulate you Sir (and your Grandfather) on a project well executed.

I may be a bit biest as a 32 year old blind man. On an academic level, this project looks awsome. On a practical level, it really works and helps some one. Like most things built to help the blind though, it's a bit overkill. For example, the IPod touch would have wirked very well for this purpose. Every single feature of the IPod touch speaks and the touch screen is fully accessible. You can put the audiobook player in a prominant place on the screen, such as one of the corners. A double tap on the player and up it comes. flick to or move a finger around on the screen to find a new book, then double tap to start. To pause or resume, do a two finger double tap. Alternatively, choose a new book by long pressing the home button, waiting for the double beep, and saying play title by author. Again, two finger double tap to pause or resume.

My Grandma likes audiobooks. She got herself a CD player that plays mp3's and I ocasionally drop off a new stack of CD's for her. Sometimes two or three books fit on one CD, and she's in her element.

I do training for seniors who lose their vision, and I understand how it goes. I just think their are simpler solutions than building a player from scratch, though I definitely enjoyed reading up on how you did it.

Have fun,

Hi Willem:
I really like your approach on the file selection procedure. My complements on your development!
I wanted to build an audioplayer which makes the file selection out of a larger archive fast and reliable for the blind user. So I looked into text to speech controlled navigation using a IR command and came up with a solution I explained on http://knoever.github.io/audioplayer-for-blind-people/ .
Klaus

@knoever excellent job! It's so good to see people using technology to help other people.

Amazing story Willem! Very good job and most important, you improved someone else life!
Best.

👍

This is a truly inspiring story. Thanks for all these tips with the end goal of helping impaired loved ones. I'm keeping this article in my back pocket. Thanks! -Brian K Friesen - https://goo.gl/nwMCcS

Truly inspiring. Good work

Very nice project !!
Which changes would be necessary to use a USB RFID reader instead? Mine behaves like a keyboard..it writes the ID of the swiped card and presses enter.