The word is attested in English since c.1330, deriving from Old French province (13c.), itself from Latin provincia "territory under Roman domination". This is derived from pro- ("on behalf of") and vincere ("to take control")--in other words, a province is a territory or function that a Roman magistrate took control of on behalf of his government.
More on [ Province ]