Basically you need a working visa. But Japanese spouse or permanent resident does’t need one.
A lot of people get around this by under-the-table language lessons.But that's hardly a regular-paying job, and it's not legal to work in any capacity on a (usually 90 day) tourist visa.
Besides working visa, working holiday visa and student visa (up 28 hours/week) are also allow you working in Japan.
A question and answer community for people thinking about moving to a new city
and locals who are proud to help their new neighbours out.