Contact the prefecture and work out a payment plan, you'll be fine... If you dont pay they WILL seize you bank account in Japan, I know people who been through that, its not fun...
Tax office has special access of all bank transactions over 100,000 yen... They will find you.