I think you're overselling Perfect Memory a fair bit here. Just because you can perfectly recall something you've seen, doesn't necessarily mean you know how to use it. E.g. just because you've memorised a manual on working a forklift, doesn't mean you're suddenly qualified to work as a forklift operator.

Languages, especially non-Latin based languages, require a whole different way of thinking about things that you won't get from pure memory.