The Speech is magically understandable, but it's not magically writable; the symbols take an ordinary amount of practice and memorization. On the other hand, if he writes out a word correctly and looks back at it later, it's just as transparent to his mind as the version in the book.