Manga: Shojoji no tanuki-bayashi Dan Dan'emon

A young samurai accepts a job to clear out a haunted castle, only to find it inhabited by beautiful women. The women are secretly a group of tanuki that try to divert the young warrior from his mission.

(Source: AniDB)