I agree with your opinion about learning a new language.
From my experience, I can say that being in a place where the language is used is very helpful; so I do think that doing speaking and listening is very effective. However, after experiencing Juken, I do think that doing grammar is also very important. Knowing grammer made me feel much comfortable using English. I think grammar and structure are still complexing, but interesting to learn :)
