Language-learning for deaf autodidacts: Tell Me More (tool review)

March 30, 2011 – 10:26 am

I’m deaf. I love learning foreign languages, ailment but group classes tend not to work so well for me – the rest of the students can hear, so that’s how classes are built. No problem, I thought in high school when I started struggling in Japanese immersion class. I’ll just become an autodidact. This sort of worked; I found out that I could teach myself how to read text quickly in almost any foreign language by piling through books (I didn’t really try writing; I didn’t have anyone to write to), but listening and speaking remained complete blanks. I couldn’t get much out of the books, either. Most self-teaching language learning resources also assume (for good reason) that their users can hear.

Well, shoot. If I’m deaf (or a non-auditory learner for some other reason) and teaching myself foreign languages, what can I use? I asked around to the best folks I could think of. Jen, a French major alumni from Gallaudet with a hearing profile similar to mine, informed me that the prestigious university for the deaf just skips the auditory part of language learning completely, and that I could ask for special allowances if I needed to take fluency exams. Becky, a childhood friend of mine who learned ASL when I had an interpreter and is now studying French language education out in Monterey, did a literature search on my behalf and came up with just two articles on language-learning for the deaf; the breathless conclusion was that oh my gosh, deaf children are actually capable of learning foreign languages.

Well, duh. Of course we are.

This was starting to drive me nuts, so I decided I’d just start working on it.   As an engineer, the first thing I want to look at are the tools and materials I’m using – just like in cooking or woodworking or anything else, my theory is that good tools will make hard work get good results, and poor tools are a waste of everybody’s time and money. And if I hadn’t found the right study plan and tools to sit down and learn something every morning, then I should spend that morning time trying out different tools until I find things I do like. If you’re blocked, then fix the blocker. Simple.

For consistency and sanity, I’ll stick with one language at a time. Right now it’s German. I concede that Spanish would have been an easier choice to find a broader range of study materials for in the US, that Mandarin is the foreign language I’m closest to fluent in, and that ASL presents the fewest barriers to learning it as a deaf person. However, my boyfriend is from Germany, and we agreed that if I learned enough to pass a basic exam, then he would learn some ASL, so there you go. German Also, I do have some residual low-frequency hearing, so I want to learn to deal with audio somehow; the trick is that my auditory input is extremely limited compared to most people, so I need to learn how to rewire the coping strategies I use for English (lipreading, a very good predictive model, and so forth) for languages I don’t yet know. So I will be dealing with audio here, just drastically adjusted.

This morning I worked through a full beginner’s lesson of the demo version of Tell Me More ($530 for full 10-level set), based on this review and others like it. It sounded like a good resource for the hardcore. I found that there’s a ton of material in here and a lot of great exercises; if I could take advantage of the audio components, this might make a nice tool for practice and intensive study. However, nearly 70% of the exercises (as measured by the program’s final count of which lessons I completed and which I skipped) are audio-dependent with no “hooks” that I can use for compensation.

Exercises deaf folks can’t use

There are plenty of exercises that depend on audio. Audio crosswords, audio word search, “listen and repeat this pronunciation,” audio questions to which you must select answers… not so accessible for deaf people. Similarly, “listen to this word, then find it in the puzzle” is not so useful for learning if you can’t listen to the word.

I’ll note that if the same word had been spoken in context in several sentences in unsubtitled video, I could probably build my lipreading and predictive models from that, figure out which word they meant, then find it in the puzzle – but there was no context and no visuals, just the standalone word. I have the same problem on one hearing test, which asks you to repeat random words uttered in isolation with no lipreading; imagine a disembodied voice speaking nonsense to you (“Baseball. Hotdog. Cheesecake. Pumpkin.”) and having to echo it, and that’s basically the test.

Without the context and the visuals, I fail miserably; I don’t remember my exact results, but with wild guessing – they always use the same limited word set, so I can guess decently – I think I get way less than 50% correct. Add in lipreading – still the same isolated, random words (the only reason I know the contents of the word set is that they do it both without and with lipreading, by the way) – and my score suddenly jumps to 90-something percent. Change that to conversational sentences, and most people have no idea I’m deaf at all. I understand the program is trying to isolate vocabulary words for learners. But what do you hear in real life when you’re trying to communicate with people? You hear sentences in context, and you can lipread. I need something that’s going to help me navigate the messiness, because I need that mess for context.

Actual usefulness

There are some nice exercises that don’t depend on audio. In particular, I enjoyed synonym-matching – a number of words in the target language are piled on the left, and synonyms from the target language are piled on the right, and you have to pair the two. “Photo” and “picture” go together, “Nice to meet you!” and “pleased to meet you!” go together. They also do this for related words – match “Fall” with “Spring,” “Parents” with “Grandparents,” and “Mountain” with “Mountain range.”

Also good: the word-transformation exercise, which lines up a bunch of unconjugated verbs along the left side of the screen and makes you type the conjugated versions on the right. It’s not that I couldn’t do this myself, but the software lining up the material for me is something that makes me go through a lot more material, a lot more words and vocabulary, and more difficult vocabulary at a faster pace than I would if I had to make all these materials myself.

Useful resources I can find elsewhere

I also appreciated the “phonetics exercise,” which gave text descriptions of the physical motions used to produce various sounds (“place the tip of your tongue behind your teeth… the vocal cords do not vibrate…” As someone who can’t simply “hear and imitate,” I do need a resource that will help me figure out where my tongue and teeth and throat go; I wonder if an international phonetics book would be a good resource. There’s got to be something out there that will painstakingly describe, and draw in detailed cross-section, the physical movements needed to produce most sounds in most languages around the world.

There’s also tooltip translation – you can choose between “word” and “sentence” translation, and if you right-click on a word (or sentence) a mini-dictionary will pop up. That’s wonderful for learning; hidden, but easy to access. I loved that and would like to find software that does that for my whole computer – there must be something like this that draws from an online dictionary database. I know StarDict exists and I’ve used it (semi-successfully) for Chinese – I need to try that out for German, and to see if something else out there is better. It’s easy enough to get this one in standalone software.

There are transcripted short videos, which is a great idea – real-word content, at real-world speed, with text. I should find short video clips that are subtitled or transcribed in German, with the subtitles and/or transcripts in a format that easily lets me deploy tooltip translation on it. Listening to audio while reading the corresponding text works well for me, because I think of language primarily in text format, and audio as “stuff I mentally translate into text I can visualize in my brain” – and when I see the words in my head, then I understand it. (Yes, I do this for English, which is my native language.) So I do need something that will play audio over text. Maybe podcasts with transcripts, or subtitled YouTube videos – not sure yet.

If I could just buy those parts alone, I’d go for it. However, for the high price (over $500, gah!) I need something that has more non-auditory material.

My end recommendation: Nice if you’re hearing and looking for tons of interactive material for hardcore practice, not worth it if you’re deaf – you need to hear too much of that material.

What else should I try?

Know someone who'd appreciate this post?
  • Print
  • Facebook
  • Twitter
  • Google Bookmarks
  • email
  • Identi.ca
  1. 2 Responses to “Language-learning for deaf autodidacts: Tell Me More (tool review)”

  2. Ich finde den Artikel sehr interessant, vielen Dank – die Überlegungen sind geradlinig. Ich schicke mal auch ihn einer tauben Freundin nach Taiwan – sie lernt gerade Japanisch (und auch ein bisschen Deutsch), um dann in Japan zu studieren. Grüße aus Deutschland

    By boucletemporelle on Apr 17, 2011

  3. Have you seen Yabla? It’s a subscription-based website that takes video clips — sometimes from TV, sometimes they’re made in-house — and adds transcription to them.

    You can slow the videos down, and you can click on the transcribed text to see a little dictionary definition pop up. Could be a good option for working on your lipreading, with the exception of videos with voiceover.

    good luck!

    By Sunny Widerman on Mar 29, 2012

What do you think?