The markup should go on the page where the thing you are describing resides. So if your company is described on the homepage, the organization markup goes there. If you are describing your contact information, then the contact point would go there, and so on.
Google: You can add LocalBusiness structured data to any page on your site, though it may make more sense to put it on a page that contains information about your business.