I was always under the impression that it was illegal to own guns in Japan. I found this interesting article that very clearly provides folks with information about the lengthy process of obtaining a license for gun and ammunition ownership. The article clearly states that gun ownership is for hunting and sports competitions only.
Alternate link.