Sure. But, I would say that the final decision is up to the GM - based on what is possible for the setting that he is running. I can easily see some human cultures where the average height is in the 6'-7' range and others where height averages 4'6" to 5'.
The same for Dwarves having the occasional individual who is a bit taller than the norm, though if he is too tall, you might want to give him a "Giantism" talent to account for that size increase.